Sep 16 14:35:25.542796 ip-10-0-132-120 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 14:35:25.899689 ip-10-0-132-120 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 14:35:25.899689 ip-10-0-132-120 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 14:35:25.899689 ip-10-0-132-120 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 14:35:25.899689 ip-10-0-132-120 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 14:35:25.899689 ip-10-0-132-120 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 14:35:25.901656 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.901578    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 14:35:25.905380 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905364    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:35:25.905380 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905380    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905384    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905387    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905391    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905394    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905397    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905400    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905403    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905407    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905410    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905418    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905421    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905423    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905426    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905429    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905432    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905434    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905437    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905440    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905443    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:35:25.905453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905445    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905448    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905450    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905453    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905456    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905458    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905461    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905464    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905467    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905470    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905473    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905475    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905478    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905480    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905483    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905485    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905499    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905502    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905505    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905508    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:35:25.905967 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905510    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905513    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905515    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905518    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905520    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905523    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905525    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905528    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905530    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905533    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905535    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905537    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905540    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905542    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905546    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905549    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905552    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905554    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905558    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905561    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:35:25.906453 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905563    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905566    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905569    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905571    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905574    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905576    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905579    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905581    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905584    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905587    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905590    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905593    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905595    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905598    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905600    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905603    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905605    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905608    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905612    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:35:25.906960 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905615    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905618    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905621    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905623    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905626    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905628    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905631    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905634    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905637    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905640    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905642    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905645    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905649    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905651    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905655    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905660    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905663    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905666    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.905669    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:35:25.907521 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906401    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906408    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906411    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906414    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906417    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906420    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906423    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906427    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906430    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906434    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906437    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906439    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906442    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906445    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906448    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906450    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906453    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906455    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906458    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:35:25.907981 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906461    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906464    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906468    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906470    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906473    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906476    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906478    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906481    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906484    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906486    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906504    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906507    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906509    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906514    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906518    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906521    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906524    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906527    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906529    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:35:25.908477 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906533    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906535    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906538    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906540    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906543    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906545    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906548    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906550    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906553    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906555    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906558    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906561    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906563    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906566    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906570    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906574    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906577    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906580    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906583    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:35:25.908976 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906586    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906588    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906591    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906594    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906596    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906599    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906602    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906604    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906607    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906609    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906612    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906614    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906617    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906619    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906623    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906625    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906628    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906630    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906633    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906636    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:35:25.909468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906639    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906641    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906644    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906646    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906649    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906651    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906653    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906658    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906661    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906663    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906666    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906668    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906671    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906673    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906676    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906679    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906681    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906684    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906687    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906689    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:35:25.909998 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906692    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.906695    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907062    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907067    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907070    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907073    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907077    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907080    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907083    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907086    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907088    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907091    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907094    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907097    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907099    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907101    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907104    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907107    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907109    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907114    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:35:25.910484 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907116    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907119    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907122    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907124    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907127    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907130    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907132    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907135    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907137    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907140    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907143    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907145    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907148    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907151    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907155    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907158    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907161    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907165    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:35:25.911001 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907168    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907172    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907176    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907179    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907181    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907184    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907187    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907190    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907192    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907195    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907198    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907200    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907202    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907206    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907209    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907211    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907214    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907216    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907219    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907221    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:35:25.911439 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907224    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907227    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907229    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907231    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907234    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907237    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907241    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907244    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907247    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907250    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907252    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907255    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907257    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907260    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907263    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907265    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907268    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907273    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907275    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907278    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:35:25.911956 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907280    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907283    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907285    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907288    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907290    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907294    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907297    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907299    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907302    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907304    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907307    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907310    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907312    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907315    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907317    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907320    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907322    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907325    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907327    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907329    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:35:25.912515 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907332    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907335    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.907337    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907406    2569 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907439    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907445    2569 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907449    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907454    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907457    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907462    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907467    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907470    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907473    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907476    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907479    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907482    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907485    2569 flags.go:64] FLAG: --cgroup-root=""
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907503    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907506    2569 flags.go:64] FLAG: --client-ca-file=""
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907509    2569 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907512    2569 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907517    2569 flags.go:64] FLAG: --cluster-domain=""
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907520    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907523    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 14:35:25.912997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907526    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907529    2569 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907533    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907540    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907544    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907547    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907550    2569 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907553    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907556    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907559    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907562    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907566    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907569    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907571    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907574    2569 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907577    2569 flags.go:64] FLAG: --enable-server="true"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907580    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907586    2569 flags.go:64] FLAG: --event-burst="100"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907589    2569 flags.go:64] FLAG: --event-qps="50"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907592    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907595    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907598    2569 flags.go:64] FLAG: --eviction-hard=""
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907601    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907605    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907608    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 14:35:25.913640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907612    2569 flags.go:64] FLAG: --eviction-soft=""
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907615    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907618    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907621    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907624    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907627    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907630    2569 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907632    2569 flags.go:64] FLAG: --feature-gates=""
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907636    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907639    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907642    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907645    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907648    2569 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907652    2569 flags.go:64] FLAG: --help="false"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907654    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-132-120.ec2.internal"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907657    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907660    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907663    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907666    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907669    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907672    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907675    2569 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907677    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 14:35:25.914311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907680    2569 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907685    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907688    2569 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907691    2569 flags.go:64] FLAG: --kube-reserved=""
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907694    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907697    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907700    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907702    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907705    2569 flags.go:64] FLAG: --lock-file=""
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907709    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907713    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907715    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907721    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907724    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907726    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907729    2569 flags.go:64] FLAG: --logging-format="text"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907732    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907735    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907738    2569 flags.go:64] FLAG: --manifest-url=""
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907741    2569 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907745    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907748    2569 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907752    2569 flags.go:64] FLAG: --max-pods="110"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907755    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907758    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 14:35:25.915363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907761    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907764    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907767    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907770    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907773    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907780    2569 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907783    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907786    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907790    2569 flags.go:64] FLAG: --pod-cidr=""
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907793    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907799    2569 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907802    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907805    2569 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907808    2569 flags.go:64] FLAG: --port="10250"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907811    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907814    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-067c6138c04525b04"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907817    2569 flags.go:64] FLAG: --qos-reserved=""
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907821    2569 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907824    2569 flags.go:64] FLAG: --register-node="true"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907827    2569 flags.go:64] FLAG: --register-with-taints=""
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907830    2569 flags.go:64] FLAG: --registry-burst="10"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907833    2569 flags.go:64] FLAG: --registry-qps="5"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907836    2569 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907839    2569 flags.go:64] FLAG: --reserved-memory=""
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907842    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 14:35:25.916421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907845    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907848    2569 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907851    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907854    2569 flags.go:64] FLAG: --runonce="false"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907857    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907860    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907862    2569 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907865    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907868    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907871    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907874    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907877    2569 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907880    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907883    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907886    2569 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907889    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907892    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907896    2569 flags.go:64] FLAG: --system-cgroups=""
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907898    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907903    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907906    2569 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907909    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907913    2569 flags.go:64] FLAG: --tls-min-version=""
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907916    2569 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907920    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 14:35:25.917138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907923    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907925    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907928    2569 flags.go:64] FLAG: --v="2"
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907932    2569 flags.go:64] FLAG: --version="false"
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907936    2569 flags.go:64] FLAG: --vmodule=""
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907940    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.907943    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908064    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908068    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908071    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908074    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908077    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908080    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908083    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908085    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908088    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908090    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908093    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908096    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908099    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908101    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:35:25.918210 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908104    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908107    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908110    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908112    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908115    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908118    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908121    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908123    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908126    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908128    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908132    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908134    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908137    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908140    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908143    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908145    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908148    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908152    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908155    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:35:25.919020 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908158    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908161    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908164    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908167    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908170    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908172    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908175    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908178    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908180    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908183    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908185    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908188    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908190    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908193    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908196    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908198    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908201    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908204    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908207    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908210    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:35:25.919681 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908213    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908215    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908218    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908222    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908225    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908228    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908231    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908235    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908238    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908241    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908244    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908247    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908249    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908252    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908255    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908258    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908261    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908263    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908266    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:35:25.920542 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908269    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908271    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908274    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908277    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908279    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908283    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908287    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908289    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908292    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908295    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908297    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908300    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908303    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908305    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908308    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908310    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908315    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908317    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908320    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908323    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:35:25.921126 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908325    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908328    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908330    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908333    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908335    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908338    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.908340    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.908780    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.916381    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.916565    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.917262    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.917275    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917363    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917371    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:35:25.921799 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917376    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917381    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917386    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917390    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917395    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917401    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917406    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917411    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917416    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917421    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917430    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917435    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917439    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917443    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917447    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917454    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917459    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917464    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917468    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917472    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:35:25.922166 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917476    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917481    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917485    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917504    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917509    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917513    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917517    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917521    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917525    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917530    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917534    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917538    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917543    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917547    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917551    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917555    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917560    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917564    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917569    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917573    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:35:25.922822 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917577    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917582    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917586    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917591    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917595    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917600    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917604    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917609    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917613    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917617    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917622    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917626    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917630    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917635    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917639    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917644    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917648    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917652    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917656    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917661    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:35:25.923413 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917665    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917669    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917674    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917678    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917683    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917688    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917692    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917696    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917701    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917704    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917709    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917714    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917718    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917722    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917726    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917731    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917736    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917740    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917745    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917749    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:35:25.923964 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917753    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917758    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917764    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917770    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917775    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917780    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917784    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917789    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917793    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917797    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917801    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917807    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917814    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917820    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917824    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917829    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:35:25.924545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.917833    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.917842    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918022    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918030    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918035    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918040    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918045    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918051    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918056    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918060    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918064    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918068    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918073    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918078    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918082    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:35:25.925213 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918086    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918091    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918095    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918099    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918103    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918107    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918112    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918116    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918120    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918125    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918129    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918133    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918138    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918144    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918148    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918152    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918156    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918160    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918164    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918169    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918173    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:35:25.925634 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918178    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918182    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918187    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918191    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918195    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918199    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918204    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918207    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918212    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918216    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918221    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918226    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918230    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918234    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918238    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918243    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918247    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918251    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918256    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918260    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:35:25.926374 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918265    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918269    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918274    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918278    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918282    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918286    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918290    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918294    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918299    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918303    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918307    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918311    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918315    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918319    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918324    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918328    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918332    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918337    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918341    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918345    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:35:25.927225 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918349    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918353    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918360    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918366    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918371    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918375    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918380    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918384    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918388    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918392    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918396    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918400    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918404    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918409    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918415    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918420    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918425    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918429    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:35:25.927849 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918434    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918440    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918446    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918450    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918454    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918458    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:25.918463    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.918471    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.918624    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.921451    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.922446    2569 server.go:1019] "Starting client certificate rotation"
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.922924    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.922959    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 14:35:25.928298 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.925151    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 14:35:25.928824 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.927485    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 14:35:25.940226 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.940206    2569 log.go:25] "Validated CRI v1 runtime API"
Sep 16 14:35:25.943942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.943918    2569 log.go:25] "Validated CRI v1 image API"
Sep 16 14:35:25.944697 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.944673    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 14:35:25.947999 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.947974    2569 fs.go:135] Filesystem UUIDs: map[2eb9efbb-9a70-4575-af66-5ed9db6da2e4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f122327b-6238-4b4a-886d-65a6db03161f:/dev/nvme0n1p4]
Sep 16 14:35:25.948078 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.947997    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 14:35:25.953668 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.953504    2569 manager.go:216] Machine: {Timestamp:2026-09-16 14:35:25.952374246 +0000 UTC m=+0.303655945 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098563 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28f098583d34bcf116639f9ba7d49f SystemUUID:ec28f098-583d-34bc-f116-639f9ba7d49f BootID:7382a8bd-5779-4f24-88d2-26409072487a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e3:ad:92:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e3:ad:92:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:fc:b6:26:97:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 14:35:25.953668 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.953666    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 14:35:25.953789 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.953777    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 14:35:25.954925 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.954905    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 14:35:25.955072 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.954930    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-120.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 14:35:25.955846 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.955836    2569 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 14:35:25.955886 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.955849    2569 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 14:35:25.955886 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.955858    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 14:35:25.956522 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.956513    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 14:35:25.956988 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.956972    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 14:35:25.957472 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.957462    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 14:35:25.961203 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.961192    2569 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 14:35:25.961450 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.961440    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 14:35:25.961485 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.961474    2569 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 14:35:25.961529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.961509    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 14:35:25.961529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.961527    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 14:35:25.961581 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.961547    2569 kubelet.go:398] "Adding apiserver pod source"
Sep 16 14:35:25.961581 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.961563    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 14:35:25.961890 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.961879    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 14:35:25.961921 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.961902    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 14:35:25.963750 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.963734    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 14:35:25.966463 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.966451    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 14:35:25.966524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.966480    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 14:35:25.967819 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.967808    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 14:35:25.967853 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.967823    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 14:35:25.967853 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.967829    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 14:35:25.967853 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.967834    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 14:35:25.967853 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.967843    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 14:35:25.967853 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.967849    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 14:35:25.967983 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.967862    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 14:35:25.967983 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.967868    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 14:35:25.967983 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.967874    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 14:35:25.967983 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.967879    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 14:35:25.967983 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.967888    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 14:35:25.967983 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.967893    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 14:35:25.968558 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.968549    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 14:35:25.968558 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.968558    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 14:35:25.971966 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.971954    2569 server.go:1268] "Started kubelet"
Sep 16 14:35:25.972094 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.972051    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 14:35:25.975368 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.975336    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 14:35:25.975537 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.975425    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 14:35:25.975980 ip-10-0-132-120 systemd[1]: Started Kubernetes Kubelet.
Sep 16 14:35:25.978544 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:25.976792    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 14:35:25.978544 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:25.976868    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 14:35:25.978544 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.977191    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-120.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 14:35:25.978544 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.977444    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 14:35:25.978870 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.978810    2569 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 14:35:25.979312 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:25.979144    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 14:35:25.982246 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:25.981567    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-120.ec2.internal.18d5d3d2077df82d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-120.ec2.internal,UID:ip-10-0-132-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-120.ec2.internal,},FirstTimestamp:2026-09-16 14:35:25.971929133 +0000 UTC m=+0.323210832,LastTimestamp:2026-09-16 14:35:25.971929133 +0000 UTC m=+0.323210832,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-120.ec2.internal,}"
Sep 16 14:35:25.986303 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.986286    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 14:35:25.986656 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.986639    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 14:35:25.986790 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:25.986771    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-120.ec2.internal\" not found"
Sep 16 14:35:25.987441 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.987420    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 14:35:25.987441 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.987423    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 14:35:25.987617 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.987449    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 14:35:25.987617 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.987549    2569 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 14:35:25.987617 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.987556    2569 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 14:35:25.987754 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.987722    2569 factory.go:153] Registering CRI-O factory
Sep 16 14:35:25.987754 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.987737    2569 factory.go:223] Registration of the crio container factory successfully
Sep 16 14:35:25.987850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.987775    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 14:35:25.987850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.987783    2569 factory.go:55] Registering systemd factory
Sep 16 14:35:25.987850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.987790    2569 factory.go:223] Registration of the systemd container factory successfully
Sep 16 14:35:25.987850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.987811    2569 factory.go:103] Registering Raw factory
Sep 16 14:35:25.987850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.987828    2569 manager.go:1196] Started watching for new ooms in manager
Sep 16 14:35:25.988159 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.988147    2569 manager.go:349] Starting recovery of all containers
Sep 16 14:35:25.990616 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.990579    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q2q65"
Sep 16 14:35:25.997640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.997624    2569 manager.go:354] Recovery completed
Sep 16 14:35:25.998659 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:25.998632    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 14:35:25.998764 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:25.998645    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 14:35:25.999625 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:25.999604    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q2q65"
Sep 16 14:35:26.002046 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.002033    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:26.004125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.004109    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:26.004210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.004142    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:26.004210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.004158    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:26.004798 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.004784    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 14:35:26.004798 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.004797    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 14:35:26.004939 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.004814    2569 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 14:35:26.004939 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.004834    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:26.005590 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.005570    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:26.005679 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.005601    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:26.005679 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.005612    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:26.005897 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.005885    2569 policy_none.go:49] "None policy: Start"
Sep 16 14:35:26.005944 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.005900    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 14:35:26.005944 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.005909    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 14:35:26.006848 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.006836    2569 policy_none.go:47] "Start"
Sep 16 14:35:26.036713 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.036696    2569 manager.go:337] "Starting Device Plugin manager"
Sep 16 14:35:26.052482 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.036735    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 14:35:26.052482 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.036748    2569 server.go:87] "Starting device plugin registration server"
Sep 16 14:35:26.052482 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.037062    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 14:35:26.052482 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.037091    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 14:35:26.052482 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.037180    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 14:35:26.052482 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.037271    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 14:35:26.052482 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.037284    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 14:35:26.052482 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.039155    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 14:35:26.052482 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.039206    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-120.ec2.internal\" not found"
Sep 16 14:35:26.079979 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.079947    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 14:35:26.081135 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.081115    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 14:35:26.081233 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.081165    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 14:35:26.081233 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.081207    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 14:35:26.081320 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.081249    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 14:35:26.083370 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.083351    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:35:26.137621 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.137607    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:26.138434 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.138415    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:26.138540 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.138449    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:26.138540 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.138466    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:26.138540 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.138504    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.146610 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.146595    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.146684 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.146615    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-120.ec2.internal\": node \"ip-10-0-132-120.ec2.internal\" not found"
Sep 16 14:35:26.165887 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.165814    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-120.ec2.internal\" not found"
Sep 16 14:35:26.181897 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.181875    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-120.ec2.internal"]
Sep 16 14:35:26.181962 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.181953    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:26.183311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.183294    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:26.183403 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.183325    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:26.183403 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.183337    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:26.184630 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.184618    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:26.184755 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.184740    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.184810 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.184778    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:26.185314 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.185301    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:26.185314 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.185311    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:26.185441 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.185329    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:26.185441 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.185330    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:26.185441 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.185338    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:26.185441 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.185344    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:26.186561 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.186546    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.186640 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.186575    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:26.187278 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.187256    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:26.187355 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.187282    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:26.187355 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.187295    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:26.189587 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.189572    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6259ee5272bc846d91ed86974cef52f5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-120.ec2.internal\" (UID: \"6259ee5272bc846d91ed86974cef52f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.189661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.189599    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40b89c34b1ad409b39f0d9961132e9c5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal\" (UID: \"40b89c34b1ad409b39f0d9961132e9c5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.189661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.189627    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40b89c34b1ad409b39f0d9961132e9c5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal\" (UID: \"40b89c34b1ad409b39f0d9961132e9c5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.212052 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.212027    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-120.ec2.internal\" not found" node="ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.216162 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.216148    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-120.ec2.internal\" not found" node="ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.266561 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.266535    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-120.ec2.internal\" not found"
Sep 16 14:35:26.290613 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.290591    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40b89c34b1ad409b39f0d9961132e9c5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal\" (UID: \"40b89c34b1ad409b39f0d9961132e9c5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.290697 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.290612    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40b89c34b1ad409b39f0d9961132e9c5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal\" (UID: \"40b89c34b1ad409b39f0d9961132e9c5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.290697 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.290649    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40b89c34b1ad409b39f0d9961132e9c5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal\" (UID: \"40b89c34b1ad409b39f0d9961132e9c5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.290697 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.290676    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6259ee5272bc846d91ed86974cef52f5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-120.ec2.internal\" (UID: \"6259ee5272bc846d91ed86974cef52f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.290792 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.290709    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6259ee5272bc846d91ed86974cef52f5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-120.ec2.internal\" (UID: \"6259ee5272bc846d91ed86974cef52f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.290792 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.290739    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40b89c34b1ad409b39f0d9961132e9c5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal\" (UID: \"40b89c34b1ad409b39f0d9961132e9c5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.366822 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.366776    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-120.ec2.internal\" not found"
Sep 16 14:35:26.467537 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.467471    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-120.ec2.internal\" not found"
Sep 16 14:35:26.514906 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.514876    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.520007 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.519986    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:26.568102 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.568073    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-120.ec2.internal\" not found"
Sep 16 14:35:26.668686 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.668654    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-120.ec2.internal\" not found"
Sep 16 14:35:26.769389 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.769300    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-120.ec2.internal\" not found"
Sep 16 14:35:26.870473 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.870439    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-120.ec2.internal\" not found"
Sep 16 14:35:26.922360 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.922317    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 14:35:26.922919 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:26.922483    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 14:35:26.971527 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:26.971278    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-120.ec2.internal\" not found"
Sep 16 14:35:27.004726 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.004693    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 14:30:26 +0000 UTC" deadline="2028-06-07 14:46:03.576300174 +0000 UTC"
Sep 16 14:35:27.004726 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.004722    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15120h10m36.571581247s"
Sep 16 14:35:27.037799 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.037726    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:35:27.059127 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:27.059097    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b89c34b1ad409b39f0d9961132e9c5.slice/crio-da1487d39e3e342f699442d377aa6db0ba7c9ef7ba6f34b7d23a3d2488d0fe7a WatchSource:0}: Error finding container da1487d39e3e342f699442d377aa6db0ba7c9ef7ba6f34b7d23a3d2488d0fe7a: Status 404 returned error can't find the container with id da1487d39e3e342f699442d377aa6db0ba7c9ef7ba6f34b7d23a3d2488d0fe7a
Sep 16 14:35:27.059595 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:27.059576    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6259ee5272bc846d91ed86974cef52f5.slice/crio-fe4f94666213bd42a38523315d743e8d9b78bad4eef33d4f462b477457a927ea WatchSource:0}: Error finding container fe4f94666213bd42a38523315d743e8d9b78bad4eef33d4f462b477457a927ea: Status 404 returned error can't find the container with id fe4f94666213bd42a38523315d743e8d9b78bad4eef33d4f462b477457a927ea
Sep 16 14:35:27.063363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.063345    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:35:27.084111 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.084065    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal" event={"ID":"40b89c34b1ad409b39f0d9961132e9c5","Type":"ContainerStarted","Data":"da1487d39e3e342f699442d377aa6db0ba7c9ef7ba6f34b7d23a3d2488d0fe7a"}
Sep 16 14:35:27.085185 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.085166    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-120.ec2.internal" event={"ID":"6259ee5272bc846d91ed86974cef52f5","Type":"ContainerStarted","Data":"fe4f94666213bd42a38523315d743e8d9b78bad4eef33d4f462b477457a927ea"}
Sep 16 14:35:27.087434 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.087419    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:27.100636 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.100621    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 14:35:27.102453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.102439    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-120.ec2.internal"
Sep 16 14:35:27.112516 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.112488    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 14:35:27.188213 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.188183    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:35:27.537962 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.536475    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:35:27.962530 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.962433    2569 apiserver.go:52] "Watching apiserver"
Sep 16 14:35:27.972096 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.972059    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 14:35:27.974290 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.974250    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-trltk","kube-system/konnectivity-agent-h2ffq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg","openshift-cluster-node-tuning-operator/tuned-82wfh","openshift-dns/node-resolver-j4ngp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal","openshift-multus/multus-additional-cni-plugins-4tn9j","openshift-multus/network-metrics-daemon-5nlwp","kube-system/global-pull-secret-syncer-5vnp2","kube-system/kube-apiserver-proxy-ip-10-0-132-120.ec2.internal","openshift-image-registry/node-ca-q29pw","openshift-multus/multus-rj6h4","openshift-network-diagnostics/network-check-target-s6ffq","openshift-network-operator/iptables-alerter-z9mkc"]
Sep 16 14:35:27.977307 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.976137    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:27.978631 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.977714    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:27.978631 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:27.977798    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:27.980424 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.979022    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:27.980424 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.979760    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 14:35:27.980424 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.979788    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 14:35:27.980424 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.979992    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 14:35:27.980424 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.980008    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wfwkk\""
Sep 16 14:35:27.980424 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.980135    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:27.980424 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.980279    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 14:35:27.981840 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.981476    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j4ngp"
Sep 16 14:35:27.982451 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.982434    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 14:35:27.982687 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.982667    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z9mkc"
Sep 16 14:35:27.984505 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.984403    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:27.984505 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:27.984470    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:27.986522 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.985945    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:27.987291 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.986657    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 14:35:27.987501 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.987477    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h2ffq"
Sep 16 14:35:27.989188 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.989165    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:27.989282 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:27.989235    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:27.990877 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.990828    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q29pw"
Sep 16 14:35:27.992894 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.991972    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.994817    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.994958    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995105    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995168    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995297    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995387    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995399    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-94nwr\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995400    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995486    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995499    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995530    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995537    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995616    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nq28b\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995636    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995740    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qzb5x\""
Sep 16 14:35:27.995748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995762    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 14:35:27.996615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995782    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 14:35:27.996615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995871    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:35:27.996615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.995992    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8jjlz\""
Sep 16 14:35:27.996615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.996002    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 14:35:27.996615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.996151    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vz2m7\""
Sep 16 14:35:27.996615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.996266    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xpn8q\""
Sep 16 14:35:27.996615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.996299    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lzrlt\""
Sep 16 14:35:27.996615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.996345    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 14:35:27.996615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.996381    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 14:35:27.996615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.996426    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 14:35:27.996615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.996352    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 14:35:27.996615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.996449    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-swlm9\""
Sep 16 14:35:27.997226 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.997109    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 14:35:27.997583 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:27.997549    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001374    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc6z5\" (UniqueName: \"kubernetes.io/projected/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-kube-api-access-xc6z5\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001416    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6716baee-485b-4a83-8592-281958c483cc-etc-tuned\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001453    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fblvj\" (UniqueName: \"kubernetes.io/projected/998db70f-12dc-4e57-bac1-f8e9a58b6090-kube-api-access-fblvj\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001487    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-registration-dir\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001519    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b463d21f-f69e-41ed-b884-321fe2df59df-tmp-dir\") pod \"node-resolver-j4ngp\" (UID: \"b463d21f-f69e-41ed-b884-321fe2df59df\") " pod="openshift-dns/node-resolver-j4ngp"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001579    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-run-openvswitch\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001637    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-env-overrides\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001668    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-cnibin\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001721    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-lib-modules\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001750    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-run-netns\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001781    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-ovn-node-metrics-cert\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001809    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr8zv\" (UniqueName: \"kubernetes.io/projected/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-kube-api-access-tr8zv\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001837    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6afe989a-88b5-4b2d-afae-72c949abfbc2-konnectivity-ca\") pod \"konnectivity-agent-h2ffq\" (UID: \"6afe989a-88b5-4b2d-afae-72c949abfbc2\") " pod="kube-system/konnectivity-agent-h2ffq"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001869    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-system-cni-dir\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.001938    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.002528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.002052    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-device-dir\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.002096    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-sysctl-conf\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.002132    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-kubelet\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.002300    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-systemd-units\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.003883    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89w8g\" (UniqueName: \"kubernetes.io/projected/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-kube-api-access-89w8g\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.003944    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-host\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.003997    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.004030    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.004422    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59w7s\" (UniqueName: \"kubernetes.io/projected/6716baee-485b-4a83-8592-281958c483cc-kube-api-access-59w7s\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.004456    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vc2\" (UniqueName: \"kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2\") pod \"network-check-target-s6ffq\" (UID: \"e48d1272-a0fc-4220-b418-cea7875f093e\") " pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.004489    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-var-lib-openvswitch\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.004575    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-cni-netd\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.004596    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-sys-fs\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.004616    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-var-lib-kubelet\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.004634    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b463d21f-f69e-41ed-b884-321fe2df59df-hosts-file\") pod \"node-resolver-j4ngp\" (UID: \"b463d21f-f69e-41ed-b884-321fe2df59df\") " pod="openshift-dns/node-resolver-j4ngp"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.004653    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-sysconfig\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.004969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.004669    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-run\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.005801 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.004742    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62-iptables-alerter-script\") pod \"iptables-alerter-z9mkc\" (UID: \"b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62\") " pod="openshift-network-operator/iptables-alerter-z9mkc"
Sep 16 14:35:28.005801 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.004803    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-node-log\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.005884 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.005838    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-cni-bin\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.005933 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.005882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.005933 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.005909    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-sysctl-d\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.006041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.005934    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6716baee-485b-4a83-8592-281958c483cc-tmp\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.006041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.005961    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4082bab8-63bc-4409-82a6-7252cfa0c27e-dbus\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:28.006041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.005993    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:28.006041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006024    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcpbm\" (UniqueName: \"kubernetes.io/projected/b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62-kube-api-access-fcpbm\") pod \"iptables-alerter-z9mkc\" (UID: \"b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62\") " pod="openshift-network-operator/iptables-alerter-z9mkc"
Sep 16 14:35:28.006242 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006068    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-slash\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.006242 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006101    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-systemd\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.006242 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006128    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4082bab8-63bc-4409-82a6-7252cfa0c27e-kubelet-config\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:28.006242 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006159    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-run-systemd\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.006242 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.006242 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006224    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-modprobe-d\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.006538 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006253    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.006538 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006285    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-ovnkube-config\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.006538 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6afe989a-88b5-4b2d-afae-72c949abfbc2-agent-certs\") pod \"konnectivity-agent-h2ffq\" (UID: \"6afe989a-88b5-4b2d-afae-72c949abfbc2\") " pod="kube-system/konnectivity-agent-h2ffq"
Sep 16 14:35:28.006538 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006466    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-kubernetes\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.006538 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006525    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-log-socket\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.006858 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006560    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.006858 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006611    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.006858 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006645    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-socket-dir\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.006858 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006678    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62-host-slash\") pod \"iptables-alerter-z9mkc\" (UID: \"b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62\") " pod="openshift-network-operator/iptables-alerter-z9mkc"
Sep 16 14:35:28.006858 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006713    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-run-ovn\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.006858 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006741    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-ovnkube-script-lib\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.006858 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006815    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.007194 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006879    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-sys\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.007194 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006923    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrxbk\" (UniqueName: \"kubernetes.io/projected/b463d21f-f69e-41ed-b884-321fe2df59df-kube-api-access-mrxbk\") pod \"node-resolver-j4ngp\" (UID: \"b463d21f-f69e-41ed-b884-321fe2df59df\") " pod="openshift-dns/node-resolver-j4ngp"
Sep 16 14:35:28.007194 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.006964    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-etc-openvswitch\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.012554 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.012530    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 14:35:28.041794 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.041745    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vmwcg"
Sep 16 14:35:28.052794 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.052615    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vmwcg"
Sep 16 14:35:28.088371 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.088331    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 14:35:28.107272 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107247    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.107399 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107288    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-run-multus-certs\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.107399 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107320    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59w7s\" (UniqueName: \"kubernetes.io/projected/6716baee-485b-4a83-8592-281958c483cc-kube-api-access-59w7s\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.107399 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107348    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vc2\" (UniqueName: \"kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2\") pod \"network-check-target-s6ffq\" (UID: \"e48d1272-a0fc-4220-b418-cea7875f093e\") " pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:28.107399 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107373    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-var-lib-openvswitch\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.107399 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107396    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-cni-netd\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.107720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107422    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-sys-fs\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.107720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107447    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-var-lib-kubelet\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.107720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107470    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b463d21f-f69e-41ed-b884-321fe2df59df-hosts-file\") pod \"node-resolver-j4ngp\" (UID: \"b463d21f-f69e-41ed-b884-321fe2df59df\") " pod="openshift-dns/node-resolver-j4ngp"
Sep 16 14:35:28.107720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107515    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-run-k8s-cni-cncf-io\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.107720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107577    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-sysconfig\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.107720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107603    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-run\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.107720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107631    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62-iptables-alerter-script\") pod \"iptables-alerter-z9mkc\" (UID: \"b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62\") " pod="openshift-network-operator/iptables-alerter-z9mkc"
Sep 16 14:35:28.107720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107656    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-node-log\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.107720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107686    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-cni-bin\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.107720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107722    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107748    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/63e35c5c-3c44-41d6-bf8d-d4d12f854062-serviceca\") pod \"node-ca-q29pw\" (UID: \"63e35c5c-3c44-41d6-bf8d-d4d12f854062\") " pod="openshift-image-registry/node-ca-q29pw"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107790    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65t6n\" (UniqueName: \"kubernetes.io/projected/613d42e6-e82c-4056-b1f0-76c9a310b374-kube-api-access-65t6n\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107817    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-sysctl-d\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107841    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6716baee-485b-4a83-8592-281958c483cc-tmp\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107872    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4082bab8-63bc-4409-82a6-7252cfa0c27e-dbus\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107902    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107929    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcpbm\" (UniqueName: \"kubernetes.io/projected/b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62-kube-api-access-fcpbm\") pod \"iptables-alerter-z9mkc\" (UID: \"b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62\") " pod="openshift-network-operator/iptables-alerter-z9mkc"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107954    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-slash\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.107979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-run-netns\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108004    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-var-lib-cni-bin\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108022    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-systemd\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108043    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4082bab8-63bc-4409-82a6-7252cfa0c27e-kubelet-config\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108059    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-run-systemd\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108074    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-modprobe-d\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108105    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.108228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108120    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-ovnkube-config\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6afe989a-88b5-4b2d-afae-72c949abfbc2-agent-certs\") pod \"konnectivity-agent-h2ffq\" (UID: \"6afe989a-88b5-4b2d-afae-72c949abfbc2\") " pod="kube-system/konnectivity-agent-h2ffq"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-var-lib-kubelet\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108170    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-kubernetes\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108187    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-log-socket\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108221    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108237    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-socket-dir\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108253    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62-host-slash\") pod \"iptables-alerter-z9mkc\" (UID: \"b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62\") " pod="openshift-network-operator/iptables-alerter-z9mkc"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108270    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-run-ovn\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108285    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-ovnkube-script-lib\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108301    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108320    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/613d42e6-e82c-4056-b1f0-76c9a310b374-multus-daemon-config\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108344    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/613d42e6-e82c-4056-b1f0-76c9a310b374-cni-binary-copy\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108360    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-sys\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108377    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrxbk\" (UniqueName: \"kubernetes.io/projected/b463d21f-f69e-41ed-b884-321fe2df59df-kube-api-access-mrxbk\") pod \"node-resolver-j4ngp\" (UID: \"b463d21f-f69e-41ed-b884-321fe2df59df\") " pod="openshift-dns/node-resolver-j4ngp"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108392    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-etc-openvswitch\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.109087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108414    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc6z5\" (UniqueName: \"kubernetes.io/projected/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-kube-api-access-xc6z5\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108429    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-system-cni-dir\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108445    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-cnibin\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108460    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-etc-kubernetes\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6716baee-485b-4a83-8592-281958c483cc-etc-tuned\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fblvj\" (UniqueName: \"kubernetes.io/projected/998db70f-12dc-4e57-bac1-f8e9a58b6090-kube-api-access-fblvj\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108549    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-registration-dir\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-multus-cni-dir\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108617    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b463d21f-f69e-41ed-b884-321fe2df59df-tmp-dir\") pod \"node-resolver-j4ngp\" (UID: \"b463d21f-f69e-41ed-b884-321fe2df59df\") " pod="openshift-dns/node-resolver-j4ngp"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108633    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-run-openvswitch\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108649    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-env-overrides\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108665    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-cnibin\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108682    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-multus-socket-dir-parent\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-lib-modules\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108716    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-run-netns\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108758    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-ovn-node-metrics-cert\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108803    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr8zv\" (UniqueName: \"kubernetes.io/projected/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-kube-api-access-tr8zv\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.109942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108820    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6afe989a-88b5-4b2d-afae-72c949abfbc2-konnectivity-ca\") pod \"konnectivity-agent-h2ffq\" (UID: \"6afe989a-88b5-4b2d-afae-72c949abfbc2\") " pod="kube-system/konnectivity-agent-h2ffq"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108847    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-system-cni-dir\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108891    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108912    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-device-dir\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63e35c5c-3c44-41d6-bf8d-d4d12f854062-host\") pod \"node-ca-q29pw\" (UID: \"63e35c5c-3c44-41d6-bf8d-d4d12f854062\") " pod="openshift-image-registry/node-ca-q29pw"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108960    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnn9w\" (UniqueName: \"kubernetes.io/projected/63e35c5c-3c44-41d6-bf8d-d4d12f854062-kube-api-access-rnn9w\") pod \"node-ca-q29pw\" (UID: \"63e35c5c-3c44-41d6-bf8d-d4d12f854062\") " pod="openshift-image-registry/node-ca-q29pw"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108980    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-sysctl-conf\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.108999    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-kubelet\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109016    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-systemd-units\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109033    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89w8g\" (UniqueName: \"kubernetes.io/projected/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-kube-api-access-89w8g\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109072    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-var-lib-cni-multus\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109088    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-hostroot\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109104    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-multus-conf-dir\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109120    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-host\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109137    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.109242    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.109300    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret podName:4082bab8-63bc-4409-82a6-7252cfa0c27e nodeName:}" failed. No retries permitted until 2026-09-16 14:35:28.609276102 +0000 UTC m=+2.960557804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret") pod "global-pull-secret-syncer-5vnp2" (UID: "4082bab8-63bc-4409-82a6-7252cfa0c27e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:28.110805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109506    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.111661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109820    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-var-lib-openvswitch\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.111661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109850    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-cni-netd\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.111661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109883    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-sys-fs\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.111661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109926    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-var-lib-kubelet\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.111661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.109967    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b463d21f-f69e-41ed-b884-321fe2df59df-hosts-file\") pod \"node-resolver-j4ngp\" (UID: \"b463d21f-f69e-41ed-b884-321fe2df59df\") " pod="openshift-dns/node-resolver-j4ngp"
Sep 16 14:35:28.111661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.110010    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-sysconfig\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.111661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.110085    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-run\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.111661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.110537    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62-iptables-alerter-script\") pod \"iptables-alerter-z9mkc\" (UID: \"b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62\") " pod="openshift-network-operator/iptables-alerter-z9mkc"
Sep 16 14:35:28.111661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.110620    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-node-log\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.111661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.110666    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-cni-bin\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.111661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.111199    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.111661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.111626    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-etc-openvswitch\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.112304 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.111797    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-sysctl-d\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.112583 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.112545    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 14:35:28.112991 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.112965    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-slash\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.113037 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.112776    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:28.113084 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.113049    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs podName:998db70f-12dc-4e57-bac1-f8e9a58b6090 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:28.61303043 +0000 UTC m=+2.964312122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs") pod "network-metrics-daemon-5nlwp" (UID: "998db70f-12dc-4e57-bac1-f8e9a58b6090") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:28.113084 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.112699    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4082bab8-63bc-4409-82a6-7252cfa0c27e-dbus\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:28.113182 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.113092    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-systemd\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.113182 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.113151    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4082bab8-63bc-4409-82a6-7252cfa0c27e-kubelet-config\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:28.113250 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.113204    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-run-systemd\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.113351 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.113333    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.113387 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.113352    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-modprobe-d\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.113423 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.113405    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.113703 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.113677    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-kubernetes\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.113772 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.113741    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-log-socket\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.113824 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.113799    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.113994 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.113966    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-ovnkube-config\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.114069 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.114043    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62-host-slash\") pod \"iptables-alerter-z9mkc\" (UID: \"b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62\") " pod="openshift-network-operator/iptables-alerter-z9mkc"
Sep 16 14:35:28.114069 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.114050    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-socket-dir\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.114176 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.114091    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-run-ovn\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.114304 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.114280    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-sys\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.114377 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.114354    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.114585 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.114548    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-ovnkube-script-lib\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.114663 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.114636    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.114920 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.114899    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-registration-dir\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.115063 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.115043    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-run-openvswitch\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.115157 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.115139    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b463d21f-f69e-41ed-b884-321fe2df59df-tmp-dir\") pod \"node-resolver-j4ngp\" (UID: \"b463d21f-f69e-41ed-b884-321fe2df59df\") " pod="openshift-dns/node-resolver-j4ngp"
Sep 16 14:35:28.115219 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.115207    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-cnibin\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.115326 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.115278    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-lib-modules\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.115326 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.115310    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-run-netns\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.115441 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.115390    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-etc-sysctl-conf\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.115441 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.115406    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-env-overrides\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.115684 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.115644    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-system-cni-dir\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.115837 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.115723    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.115837 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.115770    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-device-dir\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.115837 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.115808    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-host-kubelet\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.116017 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.115849    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-systemd-units\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.116077 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.116031    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6afe989a-88b5-4b2d-afae-72c949abfbc2-konnectivity-ca\") pod \"konnectivity-agent-h2ffq\" (UID: \"6afe989a-88b5-4b2d-afae-72c949abfbc2\") " pod="kube-system/konnectivity-agent-h2ffq"
Sep 16 14:35:28.116244 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.116077    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6716baee-485b-4a83-8592-281958c483cc-host\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.119292 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.119270    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-ovn-node-metrics-cert\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.119444 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.119423    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6afe989a-88b5-4b2d-afae-72c949abfbc2-agent-certs\") pod \"konnectivity-agent-h2ffq\" (UID: \"6afe989a-88b5-4b2d-afae-72c949abfbc2\") " pod="kube-system/konnectivity-agent-h2ffq"
Sep 16 14:35:28.119933 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.119910    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6716baee-485b-4a83-8592-281958c483cc-tmp\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.120816 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.120767    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:28.120816 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.120791    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:28.120816 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.120796    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6716baee-485b-4a83-8592-281958c483cc-etc-tuned\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.121072 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.120804    2569 projected.go:196] Error preparing data for projected volume kube-api-access-49vc2 for pod openshift-network-diagnostics/network-check-target-s6ffq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:28.121072 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.120889    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2 podName:e48d1272-a0fc-4220-b418-cea7875f093e nodeName:}" failed. No retries permitted until 2026-09-16 14:35:28.620872706 +0000 UTC m=+2.972154400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-49vc2" (UniqueName: "kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2") pod "network-check-target-s6ffq" (UID: "e48d1272-a0fc-4220-b418-cea7875f093e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:28.132117 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.132094    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59w7s\" (UniqueName: \"kubernetes.io/projected/6716baee-485b-4a83-8592-281958c483cc-kube-api-access-59w7s\") pod \"tuned-82wfh\" (UID: \"6716baee-485b-4a83-8592-281958c483cc\") " pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.141234 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.141208    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcpbm\" (UniqueName: \"kubernetes.io/projected/b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62-kube-api-access-fcpbm\") pod \"iptables-alerter-z9mkc\" (UID: \"b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62\") " pod="openshift-network-operator/iptables-alerter-z9mkc"
Sep 16 14:35:28.143398 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.143374    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr8zv\" (UniqueName: \"kubernetes.io/projected/4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6-kube-api-access-tr8zv\") pod \"ovnkube-node-trltk\" (UID: \"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.143847 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.143815    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc6z5\" (UniqueName: \"kubernetes.io/projected/06917eb6-6c54-4c78-ac7f-d5ddbda3844b-kube-api-access-xc6z5\") pod \"multus-additional-cni-plugins-4tn9j\" (UID: \"06917eb6-6c54-4c78-ac7f-d5ddbda3844b\") " pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.144105 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.144084    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89w8g\" (UniqueName: \"kubernetes.io/projected/39ecef4e-c0d2-4864-8be1-fa5a560fddc3-kube-api-access-89w8g\") pod \"aws-ebs-csi-driver-node-ktwwg\" (UID: \"39ecef4e-c0d2-4864-8be1-fa5a560fddc3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.146365 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.146345    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fblvj\" (UniqueName: \"kubernetes.io/projected/998db70f-12dc-4e57-bac1-f8e9a58b6090-kube-api-access-fblvj\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:28.147669 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.147628    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrxbk\" (UniqueName: \"kubernetes.io/projected/b463d21f-f69e-41ed-b884-321fe2df59df-kube-api-access-mrxbk\") pod \"node-resolver-j4ngp\" (UID: \"b463d21f-f69e-41ed-b884-321fe2df59df\") " pod="openshift-dns/node-resolver-j4ngp"
Sep 16 14:35:28.210200 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210155    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-run-netns\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210200 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210198    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-var-lib-cni-bin\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210233    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-var-lib-kubelet\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210265    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/613d42e6-e82c-4056-b1f0-76c9a310b374-multus-daemon-config\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210290    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/613d42e6-e82c-4056-b1f0-76c9a310b374-cni-binary-copy\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210319    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-system-cni-dir\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210342    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-cnibin\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210367    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-etc-kubernetes\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210400    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-multus-cni-dir\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210428    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-multus-socket-dir-parent\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210459    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63e35c5c-3c44-41d6-bf8d-d4d12f854062-host\") pod \"node-ca-q29pw\" (UID: \"63e35c5c-3c44-41d6-bf8d-d4d12f854062\") " pod="openshift-image-registry/node-ca-q29pw"
Sep 16 14:35:28.210807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210483    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnn9w\" (UniqueName: \"kubernetes.io/projected/63e35c5c-3c44-41d6-bf8d-d4d12f854062-kube-api-access-rnn9w\") pod \"node-ca-q29pw\" (UID: \"63e35c5c-3c44-41d6-bf8d-d4d12f854062\") " pod="openshift-image-registry/node-ca-q29pw"
Sep 16 14:35:28.210807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210511    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-var-lib-cni-multus\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210533    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-hostroot\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210575    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-multus-conf-dir\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210615    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-run-multus-certs\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-run-k8s-cni-cncf-io\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210687    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/63e35c5c-3c44-41d6-bf8d-d4d12f854062-serviceca\") pod \"node-ca-q29pw\" (UID: \"63e35c5c-3c44-41d6-bf8d-d4d12f854062\") " pod="openshift-image-registry/node-ca-q29pw"
Sep 16 14:35:28.210807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210711    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65t6n\" (UniqueName: \"kubernetes.io/projected/613d42e6-e82c-4056-b1f0-76c9a310b374-kube-api-access-65t6n\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.210807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210802    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-run-netns\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210869    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-var-lib-kubelet\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210901    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-hostroot\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210923    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-system-cni-dir\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210962    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-var-lib-cni-bin\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.210974    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63e35c5c-3c44-41d6-bf8d-d4d12f854062-host\") pod \"node-ca-q29pw\" (UID: \"63e35c5c-3c44-41d6-bf8d-d4d12f854062\") " pod="openshift-image-registry/node-ca-q29pw"
Sep 16 14:35:28.211288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.211011    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-cnibin\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.211013    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-multus-conf-dir\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.211050    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-run-multus-certs\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.211096    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-run-k8s-cni-cncf-io\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.211225    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-host-var-lib-cni-multus\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.211290    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-multus-cni-dir\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211890 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.211342    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-multus-socket-dir-parent\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211890 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.211379    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/613d42e6-e82c-4056-b1f0-76c9a310b374-etc-kubernetes\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211890 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.211554    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/613d42e6-e82c-4056-b1f0-76c9a310b374-cni-binary-copy\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.211890 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.211553    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/63e35c5c-3c44-41d6-bf8d-d4d12f854062-serviceca\") pod \"node-ca-q29pw\" (UID: \"63e35c5c-3c44-41d6-bf8d-d4d12f854062\") " pod="openshift-image-registry/node-ca-q29pw"
Sep 16 14:35:28.211890 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.211553    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/613d42e6-e82c-4056-b1f0-76c9a310b374-multus-daemon-config\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.223676 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.223616    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnn9w\" (UniqueName: \"kubernetes.io/projected/63e35c5c-3c44-41d6-bf8d-d4d12f854062-kube-api-access-rnn9w\") pod \"node-ca-q29pw\" (UID: \"63e35c5c-3c44-41d6-bf8d-d4d12f854062\") " pod="openshift-image-registry/node-ca-q29pw"
Sep 16 14:35:28.225890 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.225867    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65t6n\" (UniqueName: \"kubernetes.io/projected/613d42e6-e82c-4056-b1f0-76c9a310b374-kube-api-access-65t6n\") pod \"multus-rj6h4\" (UID: \"613d42e6-e82c-4056-b1f0-76c9a310b374\") " pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.294350 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.294309    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4tn9j"
Sep 16 14:35:28.303845 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.303661    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg"
Sep 16 14:35:28.313232 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.313211    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82wfh"
Sep 16 14:35:28.319590 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.319560    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j4ngp"
Sep 16 14:35:28.330667 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.330646    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z9mkc"
Sep 16 14:35:28.339883 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.339864    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:28.346576 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.346555    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h2ffq"
Sep 16 14:35:28.355932 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.355916    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q29pw"
Sep 16 14:35:28.361452 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.361426    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:35:28.362595 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.362578    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rj6h4"
Sep 16 14:35:28.613137 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.613053    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:28.613137 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.613119    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:28.613351 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.613170    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:28.613351 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.613224    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:28.613351 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.613253    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret podName:4082bab8-63bc-4409-82a6-7252cfa0c27e nodeName:}" failed. No retries permitted until 2026-09-16 14:35:29.613232129 +0000 UTC m=+3.964513835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret") pod "global-pull-secret-syncer-5vnp2" (UID: "4082bab8-63bc-4409-82a6-7252cfa0c27e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:28.613351 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.613280    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs podName:998db70f-12dc-4e57-bac1-f8e9a58b6090 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:29.613262507 +0000 UTC m=+3.964544209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs") pod "network-metrics-daemon-5nlwp" (UID: "998db70f-12dc-4e57-bac1-f8e9a58b6090") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:28.713967 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:28.713927    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vc2\" (UniqueName: \"kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2\") pod \"network-check-target-s6ffq\" (UID: \"e48d1272-a0fc-4220-b418-cea7875f093e\") " pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:28.714172 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.714067    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:28.714172 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.714092    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:28.714172 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.714107    2569 projected.go:196] Error preparing data for projected volume kube-api-access-49vc2 for pod openshift-network-diagnostics/network-check-target-s6ffq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:28.714172 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:28.714167    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2 podName:e48d1272-a0fc-4220-b418-cea7875f093e nodeName:}" failed. No retries permitted until 2026-09-16 14:35:29.714141737 +0000 UTC m=+4.065423443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-49vc2" (UniqueName: "kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2") pod "network-check-target-s6ffq" (UID: "e48d1272-a0fc-4220-b418-cea7875f093e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:29.056133 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:29.056042    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 14:30:28 +0000 UTC" deadline="2028-05-03 18:16:43.90798232 +0000 UTC"
Sep 16 14:35:29.056133 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:29.056078    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14283h41m14.85190831s"
Sep 16 14:35:29.298550 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:29.298517    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6716baee_485b_4a83_8592_281958c483cc.slice/crio-32eec9983ea339fe18591d989dee3a78e854e4add5a65951f301db28f3936b73 WatchSource:0}: Error finding container 32eec9983ea339fe18591d989dee3a78e854e4add5a65951f301db28f3936b73: Status 404 returned error can't find the container with id 32eec9983ea339fe18591d989dee3a78e854e4add5a65951f301db28f3936b73
Sep 16 14:35:29.299666 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:29.299639    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06917eb6_6c54_4c78_ac7f_d5ddbda3844b.slice/crio-73476ac1b2ee0ccede3c4602112e34a6ce05f3595385e2f0acbd329c046c6603 WatchSource:0}: Error finding container 73476ac1b2ee0ccede3c4602112e34a6ce05f3595385e2f0acbd329c046c6603: Status 404 returned error can't find the container with id 73476ac1b2ee0ccede3c4602112e34a6ce05f3595385e2f0acbd329c046c6603
Sep 16 14:35:29.300955 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:29.300892    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8a7d0b_cdfe_4dee_a7c2_88d0e21070b6.slice/crio-1852c293f3a5486e0a73b6d9b58ff2715f20c77dc0026c475716bef8af3bcd61 WatchSource:0}: Error finding container 1852c293f3a5486e0a73b6d9b58ff2715f20c77dc0026c475716bef8af3bcd61: Status 404 returned error can't find the container with id 1852c293f3a5486e0a73b6d9b58ff2715f20c77dc0026c475716bef8af3bcd61
Sep 16 14:35:29.302627 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:29.302490    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e35c5c_3c44_41d6_bf8d_d4d12f854062.slice/crio-851916201edfd992303bb978102426d22655589c651f6f295e65878fe0e6f8a9 WatchSource:0}: Error finding container 851916201edfd992303bb978102426d22655589c651f6f295e65878fe0e6f8a9: Status 404 returned error can't find the container with id 851916201edfd992303bb978102426d22655589c651f6f295e65878fe0e6f8a9
Sep 16 14:35:29.303008 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:29.302985    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ecef4e_c0d2_4864_8be1_fa5a560fddc3.slice/crio-5e38e94f9360ccf2b18923490a7ef4e4055c802cbf72a99813865654a3f2a38d WatchSource:0}: Error finding container 5e38e94f9360ccf2b18923490a7ef4e4055c802cbf72a99813865654a3f2a38d: Status 404 returned error can't find the container with id 5e38e94f9360ccf2b18923490a7ef4e4055c802cbf72a99813865654a3f2a38d
Sep 16 14:35:29.303917 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:35:29.303894    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afe989a_88b5_4b2d_afae_72c949abfbc2.slice/crio-bf2f037112dc668434ea44833107c5c74ff6e598a2d2905926cc85e285f3117f WatchSource:0}: Error finding container bf2f037112dc668434ea44833107c5c74ff6e598a2d2905926cc85e285f3117f: Status 404 returned error can't find the container with id bf2f037112dc668434ea44833107c5c74ff6e598a2d2905926cc85e285f3117f
Sep 16 14:35:29.621791 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:29.621764    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:29.621904 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:29.621813    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:29.621958 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:29.621912    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:29.621958 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:29.621914    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:29.622021 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:29.621962    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs podName:998db70f-12dc-4e57-bac1-f8e9a58b6090 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:31.621948791 +0000 UTC m=+5.973230479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs") pod "network-metrics-daemon-5nlwp" (UID: "998db70f-12dc-4e57-bac1-f8e9a58b6090") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:29.622021 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:29.621976    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret podName:4082bab8-63bc-4409-82a6-7252cfa0c27e nodeName:}" failed. No retries permitted until 2026-09-16 14:35:31.621969481 +0000 UTC m=+5.973251169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret") pod "global-pull-secret-syncer-5vnp2" (UID: "4082bab8-63bc-4409-82a6-7252cfa0c27e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:29.722520 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:29.722478    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vc2\" (UniqueName: \"kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2\") pod \"network-check-target-s6ffq\" (UID: \"e48d1272-a0fc-4220-b418-cea7875f093e\") " pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:29.722692 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:29.722651    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:29.722692 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:29.722685    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:29.722790 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:29.722700    2569 projected.go:196] Error preparing data for projected volume kube-api-access-49vc2 for pod openshift-network-diagnostics/network-check-target-s6ffq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:29.722790 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:29.722763    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2 podName:e48d1272-a0fc-4220-b418-cea7875f093e nodeName:}" failed. No retries permitted until 2026-09-16 14:35:31.722747614 +0000 UTC m=+6.074029309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-49vc2" (UniqueName: "kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2") pod "network-check-target-s6ffq" (UID: "e48d1272-a0fc-4220-b418-cea7875f093e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:30.056951 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.056819    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 14:30:28 +0000 UTC" deadline="2028-06-14 05:06:14.609737812 +0000 UTC"
Sep 16 14:35:30.056951 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.056880    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15278h30m44.552862694s"
Sep 16 14:35:30.084239 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.082688    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:30.084239 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:30.082827    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:30.084239 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.083252    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:30.084239 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:30.083351    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:30.084239 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.083422    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:30.084239 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:30.083521    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:30.095332 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.095296    2569 generic.go:356] "Generic (PLEG): container finished" podID="40b89c34b1ad409b39f0d9961132e9c5" containerID="f17d2acc32c71e89a46f8276463cb43e1507ff3685870c2cb04b6fce8845aff8" exitCode=0
Sep 16 14:35:30.095455 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.095380    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal" event={"ID":"40b89c34b1ad409b39f0d9961132e9c5","Type":"ContainerDied","Data":"f17d2acc32c71e89a46f8276463cb43e1507ff3685870c2cb04b6fce8845aff8"}
Sep 16 14:35:30.102812 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.102773    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-120.ec2.internal" event={"ID":"6259ee5272bc846d91ed86974cef52f5","Type":"ContainerStarted","Data":"03467a35b0a70415b6eff602cf83690903e68ee92bf010c4abf60828def401d7"}
Sep 16 14:35:30.105226 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.105126    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z9mkc" event={"ID":"b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62","Type":"ContainerStarted","Data":"1abe89e97132eb81efe03e5265289d94c90046eb9dadc99ba316e1aa79d3a678"}
Sep 16 14:35:30.107707 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.107629    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q29pw" event={"ID":"63e35c5c-3c44-41d6-bf8d-d4d12f854062","Type":"ContainerStarted","Data":"851916201edfd992303bb978102426d22655589c651f6f295e65878fe0e6f8a9"}
Sep 16 14:35:30.110034 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.109958    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tn9j" event={"ID":"06917eb6-6c54-4c78-ac7f-d5ddbda3844b","Type":"ContainerStarted","Data":"73476ac1b2ee0ccede3c4602112e34a6ce05f3595385e2f0acbd329c046c6603"}
Sep 16 14:35:30.119359 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.119239    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trltk" event={"ID":"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6","Type":"ContainerStarted","Data":"1852c293f3a5486e0a73b6d9b58ff2715f20c77dc0026c475716bef8af3bcd61"}
Sep 16 14:35:30.121551 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.121527    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j4ngp" event={"ID":"b463d21f-f69e-41ed-b884-321fe2df59df","Type":"ContainerStarted","Data":"a6921d9d11ae6796646b2dd014f000bcc1fa6abb44d6affdab7c53bc6fa9f812"}
Sep 16 14:35:30.123895 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.123862    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rj6h4" event={"ID":"613d42e6-e82c-4056-b1f0-76c9a310b374","Type":"ContainerStarted","Data":"40eed67349eb4861db7f5b2260e96fb8a6b7e46ac0e62e154e3fbebbd25f2270"}
Sep 16 14:35:30.129848 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.129770    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h2ffq" event={"ID":"6afe989a-88b5-4b2d-afae-72c949abfbc2","Type":"ContainerStarted","Data":"bf2f037112dc668434ea44833107c5c74ff6e598a2d2905926cc85e285f3117f"}
Sep 16 14:35:30.132482 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.132412    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg" event={"ID":"39ecef4e-c0d2-4864-8be1-fa5a560fddc3","Type":"ContainerStarted","Data":"5e38e94f9360ccf2b18923490a7ef4e4055c802cbf72a99813865654a3f2a38d"}
Sep 16 14:35:30.135049 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:30.134995    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82wfh" event={"ID":"6716baee-485b-4a83-8592-281958c483cc","Type":"ContainerStarted","Data":"32eec9983ea339fe18591d989dee3a78e854e4add5a65951f301db28f3936b73"}
Sep 16 14:35:31.155105 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:31.154862    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal" event={"ID":"40b89c34b1ad409b39f0d9961132e9c5","Type":"ContainerStarted","Data":"127fdafda5270f9677ff4aa185cb5a373f43995295a13cb613e7909a75f1e241"}
Sep 16 14:35:31.173300 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:31.173149    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-120.ec2.internal" podStartSLOduration=4.173129993 podStartE2EDuration="4.173129993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:30.155260995 +0000 UTC m=+4.506542709" watchObservedRunningTime="2026-09-16 14:35:31.173129993 +0000 UTC m=+5.524411705"
Sep 16 14:35:31.641050 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:31.640974    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:31.641050 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:31.641021    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:31.641277 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:31.641130    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:31.641277 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:31.641145    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:31.641277 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:31.641187    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs podName:998db70f-12dc-4e57-bac1-f8e9a58b6090 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:35.641172928 +0000 UTC m=+9.992454615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs") pod "network-metrics-daemon-5nlwp" (UID: "998db70f-12dc-4e57-bac1-f8e9a58b6090") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:31.641277 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:31.641212    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret podName:4082bab8-63bc-4409-82a6-7252cfa0c27e nodeName:}" failed. No retries permitted until 2026-09-16 14:35:35.641192822 +0000 UTC m=+9.992474519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret") pod "global-pull-secret-syncer-5vnp2" (UID: "4082bab8-63bc-4409-82a6-7252cfa0c27e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:31.741963 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:31.741928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vc2\" (UniqueName: \"kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2\") pod \"network-check-target-s6ffq\" (UID: \"e48d1272-a0fc-4220-b418-cea7875f093e\") " pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:31.742131 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:31.742117    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:31.742208 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:31.742140    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:31.742208 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:31.742153    2569 projected.go:196] Error preparing data for projected volume kube-api-access-49vc2 for pod openshift-network-diagnostics/network-check-target-s6ffq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:31.742318 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:31.742210    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2 podName:e48d1272-a0fc-4220-b418-cea7875f093e nodeName:}" failed. No retries permitted until 2026-09-16 14:35:35.742192265 +0000 UTC m=+10.093473971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-49vc2" (UniqueName: "kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2") pod "network-check-target-s6ffq" (UID: "e48d1272-a0fc-4220-b418-cea7875f093e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:32.083474 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:32.082691    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:32.083474 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:32.082821    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:32.083474 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:32.083260    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:32.083474 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:32.083361    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:32.084117 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:32.083874    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:32.084117 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:32.083985    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:34.083005 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:34.082721    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:34.083005 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:34.082853    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:34.083005 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:34.082919    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:34.083571 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:34.083034    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:34.083571 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:34.083210    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:34.083571 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:34.083304    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:35.674329 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:35.674291    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:35.674750 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:35.674376    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:35.674750 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:35.674525    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:35.674750 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:35.674589    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret podName:4082bab8-63bc-4409-82a6-7252cfa0c27e nodeName:}" failed. No retries permitted until 2026-09-16 14:35:43.674571815 +0000 UTC m=+18.025853519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret") pod "global-pull-secret-syncer-5vnp2" (UID: "4082bab8-63bc-4409-82a6-7252cfa0c27e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:35.674750 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:35.674659    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:35.674750 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:35.674692    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs podName:998db70f-12dc-4e57-bac1-f8e9a58b6090 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:43.674680856 +0000 UTC m=+18.025962560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs") pod "network-metrics-daemon-5nlwp" (UID: "998db70f-12dc-4e57-bac1-f8e9a58b6090") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:35.775532 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:35.775468    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vc2\" (UniqueName: \"kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2\") pod \"network-check-target-s6ffq\" (UID: \"e48d1272-a0fc-4220-b418-cea7875f093e\") " pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:35.775715 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:35.775668    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:35.775715 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:35.775694    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:35.775715 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:35.775708    2569 projected.go:196] Error preparing data for projected volume kube-api-access-49vc2 for pod openshift-network-diagnostics/network-check-target-s6ffq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:35.775880 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:35.775765    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2 podName:e48d1272-a0fc-4220-b418-cea7875f093e nodeName:}" failed. No retries permitted until 2026-09-16 14:35:43.775747371 +0000 UTC m=+18.127029072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-49vc2" (UniqueName: "kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2") pod "network-check-target-s6ffq" (UID: "e48d1272-a0fc-4220-b418-cea7875f093e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:36.081897 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:36.081810    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:36.081897 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:36.081811    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:36.083571 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:36.082971    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:36.083571 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:36.083389    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:36.083571 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:36.083437    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:36.083571 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:36.083538    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:38.082720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:38.082693    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:38.083153 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:38.082798    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:38.083229 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:38.083188    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:38.083335 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:38.083291    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:38.083455 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:38.083377    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:38.083526 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:38.083454    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:40.081778 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:40.081652    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:40.082204 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:40.081781    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:40.082204 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:40.081785    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:40.082204 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:40.081821    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:40.082204 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:40.081877    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:40.082204 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:40.081959    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:42.081934 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:42.081898    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:42.082382 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:42.081907    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:42.082382 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:42.082022    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:42.082382 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:42.082030    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:42.082382 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:42.082109    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:42.082382 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:42.082193    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:43.741699 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:43.741660    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:43.742205 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:43.741731    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:43.742205 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:43.741870    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:43.742205 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:43.741930    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs podName:998db70f-12dc-4e57-bac1-f8e9a58b6090 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:59.741915859 +0000 UTC m=+34.093197546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs") pod "network-metrics-daemon-5nlwp" (UID: "998db70f-12dc-4e57-bac1-f8e9a58b6090") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:43.742344 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:43.742306    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:43.742386 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:43.742353    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret podName:4082bab8-63bc-4409-82a6-7252cfa0c27e nodeName:}" failed. No retries permitted until 2026-09-16 14:35:59.742339248 +0000 UTC m=+34.093620938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret") pod "global-pull-secret-syncer-5vnp2" (UID: "4082bab8-63bc-4409-82a6-7252cfa0c27e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:43.843056 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:43.843015    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vc2\" (UniqueName: \"kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2\") pod \"network-check-target-s6ffq\" (UID: \"e48d1272-a0fc-4220-b418-cea7875f093e\") " pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:43.843241 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:43.843159    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:43.843241 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:43.843187    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:43.843241 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:43.843197    2569 projected.go:196] Error preparing data for projected volume kube-api-access-49vc2 for pod openshift-network-diagnostics/network-check-target-s6ffq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:43.843409 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:43.843250    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2 podName:e48d1272-a0fc-4220-b418-cea7875f093e nodeName:}" failed. No retries permitted until 2026-09-16 14:35:59.843234879 +0000 UTC m=+34.194516579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-49vc2" (UniqueName: "kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2") pod "network-check-target-s6ffq" (UID: "e48d1272-a0fc-4220-b418-cea7875f093e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:44.082116 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:44.082030    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:44.082116 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:44.082029    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:44.082325 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:44.082165    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:44.082325 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:44.082169    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:44.082325 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:44.082263    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:44.082473 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:44.082337    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:46.082877 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:46.082842    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:46.083382 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:46.082940    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:46.083382 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:46.083355    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:46.083521 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:46.083444    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:46.083521 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:46.083516    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:46.083629 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:46.083585    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:47.189837 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:47.189802    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q29pw" event={"ID":"63e35c5c-3c44-41d6-bf8d-d4d12f854062","Type":"ContainerStarted","Data":"73bccf0fd42d12c36a54e1b17038fd0c4c08dd23bcb5bd831e1edf4ad8a2f136"}
Sep 16 14:35:47.191664 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:47.191619    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tn9j" event={"ID":"06917eb6-6c54-4c78-ac7f-d5ddbda3844b","Type":"ContainerStarted","Data":"f5e371ebd3746b339d286df5feec64f5d69a2a8575ce3f5818dba306568ea33e"}
Sep 16 14:35:47.194929 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:47.194842    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j4ngp" event={"ID":"b463d21f-f69e-41ed-b884-321fe2df59df","Type":"ContainerStarted","Data":"1744f2157b18d8e481433483305a877d887cfa8b2bcc9abb307119e3b9153625"}
Sep 16 14:35:47.196922 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:47.196902    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h2ffq" event={"ID":"6afe989a-88b5-4b2d-afae-72c949abfbc2","Type":"ContainerStarted","Data":"5bb6772db5b8ab2aba33a8cb622fabec739aaa8f6730b5154e7b26d423bdf5bd"}
Sep 16 14:35:47.232081 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:47.231852    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-120.ec2.internal" podStartSLOduration=20.231831087 podStartE2EDuration="20.231831087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:31.173475571 +0000 UTC m=+5.524757283" watchObservedRunningTime="2026-09-16 14:35:47.231831087 +0000 UTC m=+21.583112797"
Sep 16 14:35:47.232511 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:47.232371    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q29pw" podStartSLOduration=3.631073889 podStartE2EDuration="21.232358654s" totalImagesPullingTime="17.601284765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:47.230569411 +0000 UTC m=+21.581851120" watchObservedRunningTime="2026-09-16 14:35:47.232358654 +0000 UTC m=+21.583640364"
Sep 16 14:35:47.281855 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:47.281812    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h2ffq" podStartSLOduration=3.637227942 podStartE2EDuration="21.281797275s" totalImagesPullingTime="17.644569333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:47.281157199 +0000 UTC m=+21.632438908" watchObservedRunningTime="2026-09-16 14:35:47.281797275 +0000 UTC m=+21.633078983"
Sep 16 14:35:47.314947 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:47.314909    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j4ngp" podStartSLOduration=3.688602775 podStartE2EDuration="21.31489532s" totalImagesPullingTime="17.626292545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:47.314481677 +0000 UTC m=+21.665763389" watchObservedRunningTime="2026-09-16 14:35:47.31489532 +0000 UTC m=+21.666177028"
Sep 16 14:35:48.081792 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.081545    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:48.081912 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.081545    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:48.081912 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:48.081858    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:48.082021 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.081568    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:48.082021 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:48.081948    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:48.082094 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:48.082015    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:48.200191 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.200165    2569 generic.go:356] "Generic (PLEG): container finished" podID="06917eb6-6c54-4c78-ac7f-d5ddbda3844b" containerID="f5e371ebd3746b339d286df5feec64f5d69a2a8575ce3f5818dba306568ea33e" exitCode=0
Sep 16 14:35:48.200898 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.200233    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tn9j" event={"ID":"06917eb6-6c54-4c78-ac7f-d5ddbda3844b","Type":"ContainerDied","Data":"f5e371ebd3746b339d286df5feec64f5d69a2a8575ce3f5818dba306568ea33e"}
Sep 16 14:35:48.203247 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.203229    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 14:35:48.203649 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.203630    2569 generic.go:356] "Generic (PLEG): container finished" podID="4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6" containerID="6235d6bd9cd5e8b929b1d2893fcc61a4a3d2b9c8b9b8009902f80a0df295182f" exitCode=1
Sep 16 14:35:48.203723 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.203699    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trltk" event={"ID":"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6","Type":"ContainerStarted","Data":"89f0fe09e621bdc1ac478051bd709e471c5c401c4275d5127b0fa8c03ef62edc"}
Sep 16 14:35:48.203813 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.203752    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trltk" event={"ID":"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6","Type":"ContainerStarted","Data":"cfff1141db7062378c3dea4f6d1cf670073a9d7f695f43858dc1099160f7a75b"}
Sep 16 14:35:48.203813 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.203788    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trltk" event={"ID":"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6","Type":"ContainerStarted","Data":"413c022dbb644a47aaeac8a7be72e42c6c09f447e63106ad6950dad213d45ba5"}
Sep 16 14:35:48.203884 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.203830    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trltk" event={"ID":"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6","Type":"ContainerStarted","Data":"913f94a10af4b1036c1d0942bb21d1fda14386a0b0dd61bb06e455af29f21cc7"}
Sep 16 14:35:48.203884 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.203858    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trltk" event={"ID":"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6","Type":"ContainerDied","Data":"6235d6bd9cd5e8b929b1d2893fcc61a4a3d2b9c8b9b8009902f80a0df295182f"}
Sep 16 14:35:48.203962 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.203897    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trltk" event={"ID":"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6","Type":"ContainerStarted","Data":"8ab46c4a743bf3b000bccece47e14c9df9072f38b7753f9c4f3f1be769ed33ec"}
Sep 16 14:35:48.205236 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.205220    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rj6h4" event={"ID":"613d42e6-e82c-4056-b1f0-76c9a310b374","Type":"ContainerStarted","Data":"78e8aa42933810586901c629cd15793e1cb160efe325d5d441a9e8e9a01b7fca"}
Sep 16 14:35:48.206572 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.206554    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg" event={"ID":"39ecef4e-c0d2-4864-8be1-fa5a560fddc3","Type":"ContainerStarted","Data":"08bf0820d77d3dc9a0f942241992a6d497ed6bc8a731f419f4450d0a04dac5c7"}
Sep 16 14:35:48.207954 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.207932    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82wfh" event={"ID":"6716baee-485b-4a83-8592-281958c483cc","Type":"ContainerStarted","Data":"99b7e5c6175b74d13f8eec99293dc74b3f32c98fdd3160bac031c92d04253ee5"}
Sep 16 14:35:48.288299 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.288263    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-82wfh" podStartSLOduration=4.636294384 podStartE2EDuration="22.288251003s" totalImagesPullingTime="17.651956619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:48.25502082 +0000 UTC m=+22.606302529" watchObservedRunningTime="2026-09-16 14:35:48.288251003 +0000 UTC m=+22.639532740"
Sep 16 14:35:48.288576 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.288556    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rj6h4" podStartSLOduration=4.05357406 podStartE2EDuration="22.288548017s" totalImagesPullingTime="18.234973957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:48.288165643 +0000 UTC m=+22.639447352" watchObservedRunningTime="2026-09-16 14:35:48.288548017 +0000 UTC m=+22.639829726"
Sep 16 14:35:48.318421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.318406    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h2ffq"
Sep 16 14:35:48.318915 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.318899    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h2ffq"
Sep 16 14:35:48.678938 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:48.678915    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 14:35:49.050941 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:49.050767    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T14:35:48.67893447Z","UUID":"504e5637-5e7f-4fdc-93f8-a1d78208e352","Handler":null,"Name":"","Endpoint":""}
Sep 16 14:35:49.052197 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:49.052168    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 14:35:49.052197 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:49.052198    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 14:35:49.211752 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:49.211716    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z9mkc" event={"ID":"b95ed16e-05d1-41a6-ae2a-7e1cc7bf3d62","Type":"ContainerStarted","Data":"d34ad50b51813e4ee3b748c9b932b7b2bc87c17f9395b0cadb40c57cd8fe880c"}
Sep 16 14:35:49.213721 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:49.213688    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg" event={"ID":"39ecef4e-c0d2-4864-8be1-fa5a560fddc3","Type":"ContainerStarted","Data":"ebc81e69441d0eb88ba2c1e1b20a1beecbdda741d4935f6b5d1edf34333c80da"}
Sep 16 14:35:49.214409 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:49.214389    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h2ffq"
Sep 16 14:35:49.214536 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:49.214484    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h2ffq"
Sep 16 14:35:49.275914 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:49.275868    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z9mkc" podStartSLOduration=5.630562039 podStartE2EDuration="23.275849846s" totalImagesPullingTime="17.645287807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:49.245074553 +0000 UTC m=+23.596356262" watchObservedRunningTime="2026-09-16 14:35:49.275849846 +0000 UTC m=+23.627131555"
Sep 16 14:35:50.081805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:50.081784    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:50.081941 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:50.081905    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:50.082103 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:50.082020    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:50.082205 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:50.082144    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:50.082308 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:50.082288    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:50.082389 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:50.082375    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:50.219229 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:50.219204    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 14:35:50.219669 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:50.219643    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trltk" event={"ID":"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6","Type":"ContainerStarted","Data":"267d896cd745703065b69297d2891cb0662093a019934af5c708a7821876ddc4"}
Sep 16 14:35:50.222033 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:50.222003    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg" event={"ID":"39ecef4e-c0d2-4864-8be1-fa5a560fddc3","Type":"ContainerStarted","Data":"7febb20cd49b1763a143934f475e798f49693c58dd61e7e1d6d9b73b5c06c25c"}
Sep 16 14:35:50.242846 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:50.242799    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktwwg" podStartSLOduration=3.996139975 podStartE2EDuration="24.242781904s" totalImagesPullingTime="20.246641929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:50.242690089 +0000 UTC m=+24.593971802" watchObservedRunningTime="2026-09-16 14:35:50.242781904 +0000 UTC m=+24.594063614"
Sep 16 14:35:51.732247 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:51.732088    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j4ngp_b463d21f-f69e-41ed-b884-321fe2df59df/dns-node-resolver/0.log"
Sep 16 14:35:52.082356 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:52.082276    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:52.082356 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:52.082324    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:52.082575 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:52.082413    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:52.082575 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:52.082276    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:52.082575 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:52.082510    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:52.082701 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:52.082576    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:52.693851 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:52.693823    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q29pw_63e35c5c-3c44-41d6-bf8d-d4d12f854062/node-ca/0.log"
Sep 16 14:35:53.232854 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:53.232686    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 14:35:53.233577 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:53.233109    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trltk" event={"ID":"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6","Type":"ContainerStarted","Data":"108258b4a43ff459a3fb5ef8541abebad9bfc8a9bc4d3bd0733f4339e0b6c2b3"}
Sep 16 14:35:53.233671 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:53.233653    2569 scope.go:117] "RemoveContainer" containerID="6235d6bd9cd5e8b929b1d2893fcc61a4a3d2b9c8b9b8009902f80a0df295182f"
Sep 16 14:35:53.233834 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:53.233815    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:53.233885 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:53.233874    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:53.233934 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:53.233904    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:53.252223 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:53.252170    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:53.252354 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:53.252262    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:35:54.082221 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:54.082188    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:54.082221 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:54.082208    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:54.082461 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:54.082187    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:54.082461 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:54.082300    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:54.082461 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:54.082395    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:54.082604 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:54.082514    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:54.238100 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:54.238027    2569 generic.go:356] "Generic (PLEG): container finished" podID="06917eb6-6c54-4c78-ac7f-d5ddbda3844b" containerID="0cab0e38cfb83bca13c13e7bd7928386d975237939ccf7ed1c45b37656612c75" exitCode=0
Sep 16 14:35:54.238506 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:54.238298    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tn9j" event={"ID":"06917eb6-6c54-4c78-ac7f-d5ddbda3844b","Type":"ContainerDied","Data":"0cab0e38cfb83bca13c13e7bd7928386d975237939ccf7ed1c45b37656612c75"}
Sep 16 14:35:54.243666 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:54.243486    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 14:35:54.244085 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:54.244058    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trltk" event={"ID":"4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6","Type":"ContainerStarted","Data":"e6687c6d6c324a143725f7d94592cf49a4032d30879259d4b1ae51d407acbfd5"}
Sep 16 14:35:54.329013 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:54.328945    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-trltk" podStartSLOduration=10.656747696 podStartE2EDuration="28.328927667s" totalImagesPullingTime="17.672179971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:54.323284171 +0000 UTC m=+28.674565861" watchObservedRunningTime="2026-09-16 14:35:54.328927667 +0000 UTC m=+28.680209396"
Sep 16 14:35:55.027167 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:55.027141    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5nlwp"]
Sep 16 14:35:55.027291 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:55.027275    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:55.027427 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:55.027403    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:55.043745 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:55.043707    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5vnp2"]
Sep 16 14:35:55.043893 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:55.043823    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:55.043994 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:55.043935    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:55.044831 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:55.044808    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s6ffq"]
Sep 16 14:35:55.044937 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:55.044888    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:55.044983 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:55.044963    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:55.248396 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:55.248361    2569 generic.go:356] "Generic (PLEG): container finished" podID="06917eb6-6c54-4c78-ac7f-d5ddbda3844b" containerID="3472a196d2cb05cf74213badcbb9ff3255c73616d2e1a0a2650c17b8ebc084e2" exitCode=0
Sep 16 14:35:55.248833 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:55.248441    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tn9j" event={"ID":"06917eb6-6c54-4c78-ac7f-d5ddbda3844b","Type":"ContainerDied","Data":"3472a196d2cb05cf74213badcbb9ff3255c73616d2e1a0a2650c17b8ebc084e2"}
Sep 16 14:35:56.253012 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:56.252981    2569 generic.go:356] "Generic (PLEG): container finished" podID="06917eb6-6c54-4c78-ac7f-d5ddbda3844b" containerID="f15a119322635b417c72da1d19a6ac793261f5d1f9806176edf9af1b4c7eef1c" exitCode=0
Sep 16 14:35:56.253391 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:56.253028    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tn9j" event={"ID":"06917eb6-6c54-4c78-ac7f-d5ddbda3844b","Type":"ContainerDied","Data":"f15a119322635b417c72da1d19a6ac793261f5d1f9806176edf9af1b4c7eef1c"}
Sep 16 14:35:57.081845 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:57.081676    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:57.082013 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:57.081678    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:57.082013 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:57.081921    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:57.082013 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:57.081687    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:57.082013 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:57.081988    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:57.082180 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:57.082123    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:59.081927 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:59.081889    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:59.082303 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:59.081889    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:59.082303 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:59.081889    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:59.082303 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:59.082051    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:35:59.082303 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:59.082158    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:35:59.082303 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:59.082218    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:35:59.763721 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:59.763683    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:35:59.764001 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:59.763756    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:35:59.764001 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:59.763865    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:59.764001 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:59.763951    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret podName:4082bab8-63bc-4409-82a6-7252cfa0c27e nodeName:}" failed. No retries permitted until 2026-09-16 14:36:31.763930854 +0000 UTC m=+66.115212560 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret") pod "global-pull-secret-syncer-5vnp2" (UID: "4082bab8-63bc-4409-82a6-7252cfa0c27e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:59.764001 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:59.763871    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:59.764223 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:59.764007    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs podName:998db70f-12dc-4e57-bac1-f8e9a58b6090 nodeName:}" failed. No retries permitted until 2026-09-16 14:36:31.763994823 +0000 UTC m=+66.115276522 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs") pod "network-metrics-daemon-5nlwp" (UID: "998db70f-12dc-4e57-bac1-f8e9a58b6090") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:59.864828 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:35:59.864791    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vc2\" (UniqueName: \"kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2\") pod \"network-check-target-s6ffq\" (UID: \"e48d1272-a0fc-4220-b418-cea7875f093e\") " pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:35:59.865003 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:59.864984    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:59.865048 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:59.865010    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:59.865048 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:59.865024    2569 projected.go:196] Error preparing data for projected volume kube-api-access-49vc2 for pod openshift-network-diagnostics/network-check-target-s6ffq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:59.865124 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:35:59.865090    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2 podName:e48d1272-a0fc-4220-b418-cea7875f093e nodeName:}" failed. No retries permitted until 2026-09-16 14:36:31.865070487 +0000 UTC m=+66.216352194 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-49vc2" (UniqueName: "kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2") pod "network-check-target-s6ffq" (UID: "e48d1272-a0fc-4220-b418-cea7875f093e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:36:01.082304 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:01.082272    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:01.082585 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:01.082370    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:36:01.082585 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:01.082385    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:36:01.082585 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:01.082386    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:36:01.082585 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:01.082446    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:36:01.082585 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:01.082525    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:36:01.268395 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:01.268338    2569 generic.go:356] "Generic (PLEG): container finished" podID="06917eb6-6c54-4c78-ac7f-d5ddbda3844b" containerID="d25849ece3a107f3c6538f487abb49d76ce5d9a3eb62bf5696d52fb2de15c2c4" exitCode=0
Sep 16 14:36:01.268480 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:01.268394    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tn9j" event={"ID":"06917eb6-6c54-4c78-ac7f-d5ddbda3844b","Type":"ContainerDied","Data":"d25849ece3a107f3c6538f487abb49d76ce5d9a3eb62bf5696d52fb2de15c2c4"}
Sep 16 14:36:02.273305 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:02.273273    2569 generic.go:356] "Generic (PLEG): container finished" podID="06917eb6-6c54-4c78-ac7f-d5ddbda3844b" containerID="b46b848825c556d18a0f51c107e1ab1b08970a0bc4b84acafc906992beb7fae6" exitCode=0
Sep 16 14:36:02.273833 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:02.273339    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tn9j" event={"ID":"06917eb6-6c54-4c78-ac7f-d5ddbda3844b","Type":"ContainerDied","Data":"b46b848825c556d18a0f51c107e1ab1b08970a0bc4b84acafc906992beb7fae6"}
Sep 16 14:36:03.082320 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:03.082287    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:03.082513 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:03.082287    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:36:03.082513 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:03.082290    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:36:03.082513 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:03.082479    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:36:03.082656 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:03.082547    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:36:03.082656 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:03.082374    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:36:03.278899 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:03.278870    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tn9j" event={"ID":"06917eb6-6c54-4c78-ac7f-d5ddbda3844b","Type":"ContainerStarted","Data":"62bc920924a2a6f752dbb69788c8bed4e56509fec653c5b976f2492b9a7754a4"}
Sep 16 14:36:03.341126 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:03.341042    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4tn9j" podStartSLOduration=8.725171063 podStartE2EDuration="37.341028493s" totalImagesPullingTime="28.61585743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:03.340892586 +0000 UTC m=+37.692174306" watchObservedRunningTime="2026-09-16 14:36:03.341028493 +0000 UTC m=+37.692310202"
Sep 16 14:36:05.083321 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:05.083288    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:05.083763 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:05.083332    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:36:05.083763 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:05.083306    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:36:05.083763 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:05.083401    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:36:05.083763 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:05.083468    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:36:05.083763 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:05.083550    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:36:07.082390 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:07.082362    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:07.082837 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:07.082453    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:36:07.082837 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:07.082460    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:36:07.082837 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:07.082547    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:36:07.082837 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:07.082554    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:36:07.082837 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:07.082611    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:36:09.081803 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:09.081762    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:09.082274 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:09.081856    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:36:09.082274 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:09.081863    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:36:09.082274 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:09.081941    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:36:09.082274 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:09.081862    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:36:09.082274 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:09.082081    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:36:11.082243 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:11.082208    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:11.082243 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:11.082237    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:36:11.082656 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:11.082292    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:36:11.082656 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:11.082304    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:36:11.082656 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:11.082373    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:36:11.082656 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:11.082413    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:36:13.082180 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:13.082144    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:36:13.082665 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:13.082146    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:36:13.082665 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:13.082267    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:36:13.082665 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:13.082144    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:13.082665 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:13.082330    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:36:13.082665 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:13.082392    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:36:15.081831 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:15.081799    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:15.081831 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:15.081830    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:36:15.082208 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:15.081908    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:36:15.082208 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:15.081913    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s6ffq" podUID="e48d1272-a0fc-4220-b418-cea7875f093e"
Sep 16 14:36:15.082208 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:15.081986    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vnp2" podUID="4082bab8-63bc-4409-82a6-7252cfa0c27e"
Sep 16 14:36:15.082208 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:15.082071    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nlwp" podUID="998db70f-12dc-4e57-bac1-f8e9a58b6090"
Sep 16 14:36:15.942338 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:15.942312    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-120.ec2.internal" event="NodeReady"
Sep 16 14:36:15.942563 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:15.942468    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 14:36:16.016315 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.016284    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6549888cd5-7z96d"]
Sep 16 14:36:16.021375 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.021359    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.026090 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.026065    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 14:36:16.026221 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.026194    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w8n7p\""
Sep 16 14:36:16.026409 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.026381    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 14:36:16.026920 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.026900    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 14:36:16.030209 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.030191    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 14:36:16.037534 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.037485    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6549888cd5-7z96d"]
Sep 16 14:36:16.047428 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.047406    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kqp8w"]
Sep 16 14:36:16.053325 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.053307    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m4b88"]
Sep 16 14:36:16.053426 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.053412    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.057405 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.057389    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.058710 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.058693    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 14:36:16.058805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.058696    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 14:36:16.059760 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.059740    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fbx5d\""
Sep 16 14:36:16.059991 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.059976    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 14:36:16.060051 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.060035    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 14:36:16.060177 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.060163    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fz4cv\""
Sep 16 14:36:16.060455 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.060442    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 14:36:16.061913 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.061896    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 14:36:16.078194 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.078172    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kqp8w"]
Sep 16 14:36:16.079588 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079569    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-trusted-ca\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.079685 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079598    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-image-registry-private-configuration\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.079685 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079613    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-ca-trust-extracted\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.079685 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079640    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a50075ec-e341-4ca1-9081-d678815edde3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.079809 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079699    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3880abc-8efe-4e1f-a02f-ba7ca90ced99-config-volume\") pod \"dns-default-kqp8w\" (UID: \"e3880abc-8efe-4e1f-a02f-ba7ca90ced99\") " pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.079809 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079735    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-installation-pull-secrets\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.079809 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079767    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-bound-sa-token\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.079809 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079782    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj7xz\" (UniqueName: \"kubernetes.io/projected/a50075ec-e341-4ca1-9081-d678815edde3-kube-api-access-nj7xz\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.079985 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079855    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3880abc-8efe-4e1f-a02f-ba7ca90ced99-metrics-tls\") pod \"dns-default-kqp8w\" (UID: \"e3880abc-8efe-4e1f-a02f-ba7ca90ced99\") " pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.079985 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079880    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5xdv\" (UniqueName: \"kubernetes.io/projected/e3880abc-8efe-4e1f-a02f-ba7ca90ced99-kube-api-access-s5xdv\") pod \"dns-default-kqp8w\" (UID: \"e3880abc-8efe-4e1f-a02f-ba7ca90ced99\") " pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.079985 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079899    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-registry-tls\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.079985 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079917    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-registry-certificates\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.080125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.079985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3880abc-8efe-4e1f-a02f-ba7ca90ced99-tmp-dir\") pod \"dns-default-kqp8w\" (UID: \"e3880abc-8efe-4e1f-a02f-ba7ca90ced99\") " pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.080125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.080020    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a50075ec-e341-4ca1-9081-d678815edde3-crio-socket\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.080125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.080039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a50075ec-e341-4ca1-9081-d678815edde3-data-volume\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.080125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.080061    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a50075ec-e341-4ca1-9081-d678815edde3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.080125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.080081    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqpdw\" (UniqueName: \"kubernetes.io/projected/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-kube-api-access-zqpdw\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.082435 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.082421    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:16.085437 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.085418    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 14:36:16.085551 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.085485    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 14:36:16.085657 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.085641    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sr586\""
Sep 16 14:36:16.086628 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.086611    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m4b88"]
Sep 16 14:36:16.150331 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.150273    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x689k"]
Sep 16 14:36:16.164264 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.164247    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x689k"
Sep 16 14:36:16.167971 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.167953    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 14:36:16.168150 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.168132    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8jq45\""
Sep 16 14:36:16.168298 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.168280    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 14:36:16.168345 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.168323    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 14:36:16.174421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.174400    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x689k"]
Sep 16 14:36:16.180337 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180313    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a50075ec-e341-4ca1-9081-d678815edde3-data-volume\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.180424 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180350    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a50075ec-e341-4ca1-9081-d678815edde3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.180424 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180374    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqpdw\" (UniqueName: \"kubernetes.io/projected/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-kube-api-access-zqpdw\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.180576 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180554    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-trusted-ca\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.180646 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180599    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-image-registry-private-configuration\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.180646 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180627    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-ca-trust-extracted\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.180747 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180657    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a50075ec-e341-4ca1-9081-d678815edde3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.180747 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180686    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3880abc-8efe-4e1f-a02f-ba7ca90ced99-config-volume\") pod \"dns-default-kqp8w\" (UID: \"e3880abc-8efe-4e1f-a02f-ba7ca90ced99\") " pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.180747 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180700    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a50075ec-e341-4ca1-9081-d678815edde3-data-volume\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.180747 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180709    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-installation-pull-secrets\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.180978 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb17e6bc-80c5-42da-b03d-cbdf1384a028-cert\") pod \"ingress-canary-x689k\" (UID: \"fb17e6bc-80c5-42da-b03d-cbdf1384a028\") " pod="openshift-ingress-canary/ingress-canary-x689k"
Sep 16 14:36:16.180978 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180797    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-bound-sa-token\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.180978 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180826    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj7xz\" (UniqueName: \"kubernetes.io/projected/a50075ec-e341-4ca1-9081-d678815edde3-kube-api-access-nj7xz\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.180978 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxjhm\" (UniqueName: \"kubernetes.io/projected/fb17e6bc-80c5-42da-b03d-cbdf1384a028-kube-api-access-cxjhm\") pod \"ingress-canary-x689k\" (UID: \"fb17e6bc-80c5-42da-b03d-cbdf1384a028\") " pod="openshift-ingress-canary/ingress-canary-x689k"
Sep 16 14:36:16.180978 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180895    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3880abc-8efe-4e1f-a02f-ba7ca90ced99-metrics-tls\") pod \"dns-default-kqp8w\" (UID: \"e3880abc-8efe-4e1f-a02f-ba7ca90ced99\") " pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.180978 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180935    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xdv\" (UniqueName: \"kubernetes.io/projected/e3880abc-8efe-4e1f-a02f-ba7ca90ced99-kube-api-access-s5xdv\") pod \"dns-default-kqp8w\" (UID: \"e3880abc-8efe-4e1f-a02f-ba7ca90ced99\") " pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.180978 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180960    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-registry-tls\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.181277 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.180984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-registry-certificates\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.181277 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.181024    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3880abc-8efe-4e1f-a02f-ba7ca90ced99-tmp-dir\") pod \"dns-default-kqp8w\" (UID: \"e3880abc-8efe-4e1f-a02f-ba7ca90ced99\") " pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.181277 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.181036    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a50075ec-e341-4ca1-9081-d678815edde3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.181277 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.181049    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a50075ec-e341-4ca1-9081-d678815edde3-crio-socket\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.181909 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.181700    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3880abc-8efe-4e1f-a02f-ba7ca90ced99-config-volume\") pod \"dns-default-kqp8w\" (UID: \"e3880abc-8efe-4e1f-a02f-ba7ca90ced99\") " pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.182287 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.182265    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-trusted-ca\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.183193 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.183168    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-registry-certificates\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.184453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.184309    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a50075ec-e341-4ca1-9081-d678815edde3-crio-socket\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.184453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.184402    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3880abc-8efe-4e1f-a02f-ba7ca90ced99-tmp-dir\") pod \"dns-default-kqp8w\" (UID: \"e3880abc-8efe-4e1f-a02f-ba7ca90ced99\") " pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.184453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.184424    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-ca-trust-extracted\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.185221 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.185162    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-image-registry-private-configuration\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.185221 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.185175    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3880abc-8efe-4e1f-a02f-ba7ca90ced99-metrics-tls\") pod \"dns-default-kqp8w\" (UID: \"e3880abc-8efe-4e1f-a02f-ba7ca90ced99\") " pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.185221 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.185188    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a50075ec-e341-4ca1-9081-d678815edde3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.185221 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.185197    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-installation-pull-secrets\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.186747 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.186727    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-registry-tls\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.195535 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.195511    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj7xz\" (UniqueName: \"kubernetes.io/projected/a50075ec-e341-4ca1-9081-d678815edde3-kube-api-access-nj7xz\") pod \"insights-runtime-extractor-m4b88\" (UID: \"a50075ec-e341-4ca1-9081-d678815edde3\") " pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.196785 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.196768    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqpdw\" (UniqueName: \"kubernetes.io/projected/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-kube-api-access-zqpdw\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.197510 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.197469    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fd81b2c-f0b8-4af9-9302-822a7233b6b6-bound-sa-token\") pod \"image-registry-6549888cd5-7z96d\" (UID: \"3fd81b2c-f0b8-4af9-9302-822a7233b6b6\") " pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.210340 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.210321    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5xdv\" (UniqueName: \"kubernetes.io/projected/e3880abc-8efe-4e1f-a02f-ba7ca90ced99-kube-api-access-s5xdv\") pod \"dns-default-kqp8w\" (UID: \"e3880abc-8efe-4e1f-a02f-ba7ca90ced99\") " pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.281562 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.281535    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb17e6bc-80c5-42da-b03d-cbdf1384a028-cert\") pod \"ingress-canary-x689k\" (UID: \"fb17e6bc-80c5-42da-b03d-cbdf1384a028\") " pod="openshift-ingress-canary/ingress-canary-x689k"
Sep 16 14:36:16.281654 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.281567    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxjhm\" (UniqueName: \"kubernetes.io/projected/fb17e6bc-80c5-42da-b03d-cbdf1384a028-kube-api-access-cxjhm\") pod \"ingress-canary-x689k\" (UID: \"fb17e6bc-80c5-42da-b03d-cbdf1384a028\") " pod="openshift-ingress-canary/ingress-canary-x689k"
Sep 16 14:36:16.283524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.283484    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb17e6bc-80c5-42da-b03d-cbdf1384a028-cert\") pod \"ingress-canary-x689k\" (UID: \"fb17e6bc-80c5-42da-b03d-cbdf1384a028\") " pod="openshift-ingress-canary/ingress-canary-x689k"
Sep 16 14:36:16.301643 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.301622    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxjhm\" (UniqueName: \"kubernetes.io/projected/fb17e6bc-80c5-42da-b03d-cbdf1384a028-kube-api-access-cxjhm\") pod \"ingress-canary-x689k\" (UID: \"fb17e6bc-80c5-42da-b03d-cbdf1384a028\") " pod="openshift-ingress-canary/ingress-canary-x689k"
Sep 16 14:36:16.329926 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.329908    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:16.361874 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.361856    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:16.366986 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.366966    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m4b88"
Sep 16 14:36:16.471926 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.471901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x689k"
Sep 16 14:36:16.677030 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.676950    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kqp8w"]
Sep 16 14:36:16.681237 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:16.681213    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3880abc_8efe_4e1f_a02f_ba7ca90ced99.slice/crio-2d06203b9a209b23ce2275da5ab53be27aa96d3d7e86e0eed0c826f8fb2163f7 WatchSource:0}: Error finding container 2d06203b9a209b23ce2275da5ab53be27aa96d3d7e86e0eed0c826f8fb2163f7: Status 404 returned error can't find the container with id 2d06203b9a209b23ce2275da5ab53be27aa96d3d7e86e0eed0c826f8fb2163f7
Sep 16 14:36:16.687706 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:16.687684    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda50075ec_e341_4ca1_9081_d678815edde3.slice/crio-047bb05938a8b90bbec3c15d326cc77c2998248aa1004002cc91ff078c8aad8d WatchSource:0}: Error finding container 047bb05938a8b90bbec3c15d326cc77c2998248aa1004002cc91ff078c8aad8d: Status 404 returned error can't find the container with id 047bb05938a8b90bbec3c15d326cc77c2998248aa1004002cc91ff078c8aad8d
Sep 16 14:36:16.690524 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:16.689022    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd81b2c_f0b8_4af9_9302_822a7233b6b6.slice/crio-cd0b88d72e5953bd5a25ca37300be645179c153b62e91131c7c9e6f4ccb1231a WatchSource:0}: Error finding container cd0b88d72e5953bd5a25ca37300be645179c153b62e91131c7c9e6f4ccb1231a: Status 404 returned error can't find the container with id cd0b88d72e5953bd5a25ca37300be645179c153b62e91131c7c9e6f4ccb1231a
Sep 16 14:36:16.690524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.689241    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m4b88"]
Sep 16 14:36:16.690524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.690137    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6549888cd5-7z96d"]
Sep 16 14:36:16.808845 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:16.808822    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x689k"]
Sep 16 14:36:16.813002 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:16.812969    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb17e6bc_80c5_42da_b03d_cbdf1384a028.slice/crio-13c72d98f04fb1cfc37ee4f4c3db8dcb89d61a7a20b9f4813fb2d735c2de8421 WatchSource:0}: Error finding container 13c72d98f04fb1cfc37ee4f4c3db8dcb89d61a7a20b9f4813fb2d735c2de8421: Status 404 returned error can't find the container with id 13c72d98f04fb1cfc37ee4f4c3db8dcb89d61a7a20b9f4813fb2d735c2de8421
Sep 16 14:36:17.081514 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.081464    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:36:17.081514 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.081506    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:36:17.091822 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.091796    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bf8l5\""
Sep 16 14:36:17.092174 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.091872    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 14:36:17.092679 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.092655    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 14:36:17.311734 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.311696    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m4b88" event={"ID":"a50075ec-e341-4ca1-9081-d678815edde3","Type":"ContainerStarted","Data":"434644f9669ab5081bf5a1ca7ba922389724205cebeb3dd373f77481fc03815c"}
Sep 16 14:36:17.311905 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.311830    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m4b88" event={"ID":"a50075ec-e341-4ca1-9081-d678815edde3","Type":"ContainerStarted","Data":"047bb05938a8b90bbec3c15d326cc77c2998248aa1004002cc91ff078c8aad8d"}
Sep 16 14:36:17.313451 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.313423    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6549888cd5-7z96d" event={"ID":"3fd81b2c-f0b8-4af9-9302-822a7233b6b6","Type":"ContainerStarted","Data":"ed9e341f9f119f30d39730a5b7b2edfdf33d397be2fee762880d00e8a5483558"}
Sep 16 14:36:17.313634 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.313466    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6549888cd5-7z96d" event={"ID":"3fd81b2c-f0b8-4af9-9302-822a7233b6b6","Type":"ContainerStarted","Data":"cd0b88d72e5953bd5a25ca37300be645179c153b62e91131c7c9e6f4ccb1231a"}
Sep 16 14:36:17.313634 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.313558    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:17.314857 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.314832    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x689k" event={"ID":"fb17e6bc-80c5-42da-b03d-cbdf1384a028","Type":"ContainerStarted","Data":"13c72d98f04fb1cfc37ee4f4c3db8dcb89d61a7a20b9f4813fb2d735c2de8421"}
Sep 16 14:36:17.316075 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.316053    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kqp8w" event={"ID":"e3880abc-8efe-4e1f-a02f-ba7ca90ced99","Type":"ContainerStarted","Data":"2d06203b9a209b23ce2275da5ab53be27aa96d3d7e86e0eed0c826f8fb2163f7"}
Sep 16 14:36:17.364141 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:17.364053    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6549888cd5-7z96d" podStartSLOduration=2.364032944 podStartE2EDuration="2.364032944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:17.363777428 +0000 UTC m=+51.715059140" watchObservedRunningTime="2026-09-16 14:36:17.364032944 +0000 UTC m=+51.715314654"
Sep 16 14:36:18.321782 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:18.321746    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m4b88" event={"ID":"a50075ec-e341-4ca1-9081-d678815edde3","Type":"ContainerStarted","Data":"4bc6e44c0a104e45ed16f8f5a2c1ce3c07f980a4540627985d4cb10eb6b2e176"}
Sep 16 14:36:20.328830 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:20.328792    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x689k" event={"ID":"fb17e6bc-80c5-42da-b03d-cbdf1384a028","Type":"ContainerStarted","Data":"86aeafa3857f2eaa2b2c65d98f3b7104e8fa6a1a38140df7ae969c5df78c8e11"}
Sep 16 14:36:20.330757 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:20.330731    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kqp8w" event={"ID":"e3880abc-8efe-4e1f-a02f-ba7ca90ced99","Type":"ContainerStarted","Data":"d299b04b58fd851249f1f229616b107d960703d6032cd964bd0cb6a7d8d6f327"}
Sep 16 14:36:20.330880 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:20.330780    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:20.330880 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:20.330796    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kqp8w" event={"ID":"e3880abc-8efe-4e1f-a02f-ba7ca90ced99","Type":"ContainerStarted","Data":"9c5a39e7e50a79ff0001a953511328bd4a7a883de85ba9f3ef2cab29d37ef7b8"}
Sep 16 14:36:20.332720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:20.332690    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m4b88" event={"ID":"a50075ec-e341-4ca1-9081-d678815edde3","Type":"ContainerStarted","Data":"bcdd6cc7ce141af6ebef1a7c4a1fb535071cdd01cbb216e37a66ae36c59865c9"}
Sep 16 14:36:20.358145 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:20.358110    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x689k" podStartSLOduration=1.4215124000000001 podStartE2EDuration="4.358097006s" totalImagesPullingTime="2.936584606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:20.356203166 +0000 UTC m=+54.707484874" watchObservedRunningTime="2026-09-16 14:36:20.358097006 +0000 UTC m=+54.709378705"
Sep 16 14:36:20.402418 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:20.402378    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kqp8w" podStartSLOduration=1.351760399 podStartE2EDuration="4.40236638s" totalImagesPullingTime="3.050605981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:20.402179662 +0000 UTC m=+54.753461371" watchObservedRunningTime="2026-09-16 14:36:20.40236638 +0000 UTC m=+54.753648118"
Sep 16 14:36:20.443882 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:20.443845    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m4b88" podStartSLOduration=1.557698955 podStartE2EDuration="4.443832554s" totalImagesPullingTime="2.886133599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:36:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:20.443565067 +0000 UTC m=+54.794846776" watchObservedRunningTime="2026-09-16 14:36:20.443832554 +0000 UTC m=+54.795114262"
Sep 16 14:36:25.260150 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:25.260116    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trltk"
Sep 16 14:36:27.092617 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.092579    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"]
Sep 16 14:36:27.097069 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.097040    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.105754 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.105735    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 16 14:36:27.105840 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.105738    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 14:36:27.106379 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.106361    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 14:36:27.106442 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.106406    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 16 14:36:27.108913 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.108899    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ffvtt\""
Sep 16 14:36:27.109560 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.109544    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 14:36:27.128417 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.128395    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"]
Sep 16 14:36:27.157911 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.157887    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9066b8f-e848-43a7-880a-2b900858484e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.158011 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.157922    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9066b8f-e848-43a7-880a-2b900858484e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.158011 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.157953    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9066b8f-e848-43a7-880a-2b900858484e-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.158011 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.157969    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fpmz\" (UniqueName: \"kubernetes.io/projected/d9066b8f-e848-43a7-880a-2b900858484e-kube-api-access-8fpmz\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.161687 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.161667    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"]
Sep 16 14:36:27.163657 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.163639    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.167853 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.167835    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bzb5k\""
Sep 16 14:36:27.167948 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.167888    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 16 14:36:27.168012 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.168000    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 16 14:36:27.168107 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.168092    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 16 14:36:27.185340 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.185315    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"]
Sep 16 14:36:27.186067 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.186048    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5zn4w"]
Sep 16 14:36:27.188235 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.188219    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.194533 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.194511    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 14:36:27.194628 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.194555    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 14:36:27.194628 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.194607    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 14:36:27.196729 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.196715    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tdjzx\""
Sep 16 14:36:27.258268 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258243    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9066b8f-e848-43a7-880a-2b900858484e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.258357 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258310    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-root\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.258357 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258344    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tdb4\" (UniqueName: \"kubernetes.io/projected/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-kube-api-access-6tdb4\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.258433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258368    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-sys\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.258433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258391    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-accelerators-collector-config\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.258433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258425    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-tls\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.258563 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258453    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx5zw\" (UniqueName: \"kubernetes.io/projected/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-kube-api-access-qx5zw\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.258563 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258480    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.258563 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258543    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-textfile\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.258669 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258588    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.258669 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258610    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-wtmp\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.258669 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258632    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-metrics-client-ca\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.258669 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258649    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9066b8f-e848-43a7-880a-2b900858484e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.258812 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258705    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9066b8f-e848-43a7-880a-2b900858484e-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.258812 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:27.258711    2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 16 14:36:27.258812 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258726    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fpmz\" (UniqueName: \"kubernetes.io/projected/d9066b8f-e848-43a7-880a-2b900858484e-kube-api-access-8fpmz\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.258812 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:27.258753    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9066b8f-e848-43a7-880a-2b900858484e-openshift-state-metrics-tls podName:d9066b8f-e848-43a7-880a-2b900858484e nodeName:}" failed. No retries permitted until 2026-09-16 14:36:27.758737998 +0000 UTC m=+62.110019685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d9066b8f-e848-43a7-880a-2b900858484e-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-wgh9n" (UID: "d9066b8f-e848-43a7-880a-2b900858484e") : secret "openshift-state-metrics-tls" not found
Sep 16 14:36:27.258812 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258770    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.258812 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258799    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.259039 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258830    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.259039 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.258857    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.259292 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.259277    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9066b8f-e848-43a7-880a-2b900858484e-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.260532 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.260515    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9066b8f-e848-43a7-880a-2b900858484e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.270536 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.270516    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fpmz\" (UniqueName: \"kubernetes.io/projected/d9066b8f-e848-43a7-880a-2b900858484e-kube-api-access-8fpmz\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.359969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.359908    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.359969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.359958    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-root\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.359982    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tdb4\" (UniqueName: \"kubernetes.io/projected/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-kube-api-access-6tdb4\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.360125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360033    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-root\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360081    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-sys\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360108    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-accelerators-collector-config\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360379 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360129    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-tls\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360379 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360162    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx5zw\" (UniqueName: \"kubernetes.io/projected/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-kube-api-access-qx5zw\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360379 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360177    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-sys\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360379 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360199    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.360379 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360223    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-textfile\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360379 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360249    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.360379 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360273    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-wtmp\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360379 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360309    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-metrics-client-ca\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360379 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360366    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.360850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360390    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.360850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360422    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360507    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-wtmp\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360751    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.360850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360791    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-accelerators-collector-config\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.360850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360800    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.361095 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.360991    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-metrics-client-ca\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.361095 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.361048    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-textfile\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.361451 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.361421    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.362743 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.362718    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.362865 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.362846    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.362928 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.362887    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.363178 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.363160    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-node-exporter-tls\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.373376 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.373356    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx5zw\" (UniqueName: \"kubernetes.io/projected/76a76f0e-65e1-40e0-a891-dcb2b4c3ca17-kube-api-access-qx5zw\") pod \"node-exporter-5zn4w\" (UID: \"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17\") " pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.374512 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.374476    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tdb4\" (UniqueName: \"kubernetes.io/projected/1fbd2fee-ab0a-411c-bfc5-90e0e5095b98-kube-api-access-6tdb4\") pod \"kube-state-metrics-59fbdd77d-8jks4\" (UID: \"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.472018 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.471986    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"
Sep 16 14:36:27.496784 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.496760    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5zn4w"
Sep 16 14:36:27.506076 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:27.506049    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a76f0e_65e1_40e0_a891_dcb2b4c3ca17.slice/crio-53b120618a29bb8c0d3d64f7a5a23af7a153f522e32a1fbea7363f46c3164c5f WatchSource:0}: Error finding container 53b120618a29bb8c0d3d64f7a5a23af7a153f522e32a1fbea7363f46c3164c5f: Status 404 returned error can't find the container with id 53b120618a29bb8c0d3d64f7a5a23af7a153f522e32a1fbea7363f46c3164c5f
Sep 16 14:36:27.743300 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.743268    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4"]
Sep 16 14:36:27.746286 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:27.746261    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fbd2fee_ab0a_411c_bfc5_90e0e5095b98.slice/crio-fcd4fbfceefc013caa8b145acbd9a464e3153f49651310758b46c313e751bd5b WatchSource:0}: Error finding container fcd4fbfceefc013caa8b145acbd9a464e3153f49651310758b46c313e751bd5b: Status 404 returned error can't find the container with id fcd4fbfceefc013caa8b145acbd9a464e3153f49651310758b46c313e751bd5b
Sep 16 14:36:27.764296 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:27.764274    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9066b8f-e848-43a7-880a-2b900858484e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:27.764431 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:27.764413    2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 16 14:36:27.764487 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:27.764472    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9066b8f-e848-43a7-880a-2b900858484e-openshift-state-metrics-tls podName:d9066b8f-e848-43a7-880a-2b900858484e nodeName:}" failed. No retries permitted until 2026-09-16 14:36:28.764453401 +0000 UTC m=+63.115735088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d9066b8f-e848-43a7-880a-2b900858484e-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-wgh9n" (UID: "d9066b8f-e848-43a7-880a-2b900858484e") : secret "openshift-state-metrics-tls" not found
Sep 16 14:36:28.358196 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:28.358140    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zn4w" event={"ID":"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17","Type":"ContainerStarted","Data":"53b120618a29bb8c0d3d64f7a5a23af7a153f522e32a1fbea7363f46c3164c5f"}
Sep 16 14:36:28.359507 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:28.359456    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4" event={"ID":"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98","Type":"ContainerStarted","Data":"fcd4fbfceefc013caa8b145acbd9a464e3153f49651310758b46c313e751bd5b"}
Sep 16 14:36:28.771820 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:28.771790    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9066b8f-e848-43a7-880a-2b900858484e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:28.773810 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:28.773790    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9066b8f-e848-43a7-880a-2b900858484e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-wgh9n\" (UID: \"d9066b8f-e848-43a7-880a-2b900858484e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:28.904993 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:28.904967    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"
Sep 16 14:36:29.183625 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.183581    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n"]
Sep 16 14:36:29.185569 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:29.185542    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9066b8f_e848_43a7_880a_2b900858484e.slice/crio-69ba6e8565b9d5be2c749df0cebd4615708d891f8e62968cb9247b4f1392ae55 WatchSource:0}: Error finding container 69ba6e8565b9d5be2c749df0cebd4615708d891f8e62968cb9247b4f1392ae55: Status 404 returned error can't find the container with id 69ba6e8565b9d5be2c749df0cebd4615708d891f8e62968cb9247b4f1392ae55
Sep 16 14:36:29.367836 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.367797    2569 generic.go:356] "Generic (PLEG): container finished" podID="76a76f0e-65e1-40e0-a891-dcb2b4c3ca17" containerID="3123a91ba0be7f6b46f961f5bcf1ee3c55a3a5bcde3d1c4af20572daad20c1f5" exitCode=0
Sep 16 14:36:29.368287 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.367850    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zn4w" event={"ID":"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17","Type":"ContainerDied","Data":"3123a91ba0be7f6b46f961f5bcf1ee3c55a3a5bcde3d1c4af20572daad20c1f5"}
Sep 16 14:36:29.370463 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.370426    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n" event={"ID":"d9066b8f-e848-43a7-880a-2b900858484e","Type":"ContainerStarted","Data":"aa85b4b5674ea0d9ebe2d31cab6a38720c85d8380c98d438d6c26851553a884d"}
Sep 16 14:36:29.370567 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.370472    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n" event={"ID":"d9066b8f-e848-43a7-880a-2b900858484e","Type":"ContainerStarted","Data":"b41860a7ebceb28a8ad8165fc718690f2bf4dd0a772b61544f1dedb69a05039e"}
Sep 16 14:36:29.370567 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.370511    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n" event={"ID":"d9066b8f-e848-43a7-880a-2b900858484e","Type":"ContainerStarted","Data":"69ba6e8565b9d5be2c749df0cebd4615708d891f8e62968cb9247b4f1392ae55"}
Sep 16 14:36:29.387517 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.387479    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"]
Sep 16 14:36:29.390707 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.390687    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.396480 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.396459    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 16 14:36:29.396869 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.396844    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 16 14:36:29.396869 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.396865    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 16 14:36:29.397005 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.396988    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wx2rd\""
Sep 16 14:36:29.397057 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.397027    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 16 14:36:29.397181 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.397164    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fcq6nbscjeccf\""
Sep 16 14:36:29.400074 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.400058    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 16 14:36:29.439758 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.439732    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"]
Sep 16 14:36:29.478850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.478814    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-tls\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.479044 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.478965    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.479044 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.479001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-grpc-tls\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.479044 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.479035    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.479205 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.479067    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxghs\" (UniqueName: \"kubernetes.io/projected/91312d23-33c1-41e2-8779-56df58e024a3-kube-api-access-gxghs\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.479205 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.479155    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.479205 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.479186    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91312d23-33c1-41e2-8779-56df58e024a3-metrics-client-ca\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.479359 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.479214    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.580242 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.580208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.580433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.580252    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91312d23-33c1-41e2-8779-56df58e024a3-metrics-client-ca\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.580433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.580282    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.580433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.580332    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-tls\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.580433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.580394    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.580433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.580420    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-grpc-tls\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.580719 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.580449    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.580719 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.580477    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxghs\" (UniqueName: \"kubernetes.io/projected/91312d23-33c1-41e2-8779-56df58e024a3-kube-api-access-gxghs\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.581184 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.581154    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91312d23-33c1-41e2-8779-56df58e024a3-metrics-client-ca\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.583261 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.583217    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.583651 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.583628    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.583747 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.583726    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.584259 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.584235    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-tls\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.584259 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.584256    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-grpc-tls\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.584388 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.584298    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/91312d23-33c1-41e2-8779-56df58e024a3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.600015 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.599979    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxghs\" (UniqueName: \"kubernetes.io/projected/91312d23-33c1-41e2-8779-56df58e024a3-kube-api-access-gxghs\") pod \"thanos-querier-bdbb9f644-8z7xf\" (UID: \"91312d23-33c1-41e2-8779-56df58e024a3\") " pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:29.714637 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:29.714613    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:30.044682 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:30.044646    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"]
Sep 16 14:36:30.045154 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:30.045117    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91312d23_33c1_41e2_8779_56df58e024a3.slice/crio-21dfe40ae6b005ec017830286bc82329a5e625cb424406e40f353bd53e0e5ac9 WatchSource:0}: Error finding container 21dfe40ae6b005ec017830286bc82329a5e625cb424406e40f353bd53e0e5ac9: Status 404 returned error can't find the container with id 21dfe40ae6b005ec017830286bc82329a5e625cb424406e40f353bd53e0e5ac9
Sep 16 14:36:30.337513 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:30.337426    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kqp8w"
Sep 16 14:36:30.378330 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:30.378296    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zn4w" event={"ID":"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17","Type":"ContainerStarted","Data":"c09cfc3fb1e54cc8db6b06f862922724245407edbfcc4ce7678244a4e1f307b6"}
Sep 16 14:36:30.378769 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:30.378355    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zn4w" event={"ID":"76a76f0e-65e1-40e0-a891-dcb2b4c3ca17","Type":"ContainerStarted","Data":"3777a51932ca2437c0c3fbde7f82eb08ef3f71918f5cdc50d88bfe0bd08ef87b"}
Sep 16 14:36:30.379559 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:30.379526    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf" event={"ID":"91312d23-33c1-41e2-8779-56df58e024a3","Type":"ContainerStarted","Data":"21dfe40ae6b005ec017830286bc82329a5e625cb424406e40f353bd53e0e5ac9"}
Sep 16 14:36:30.381715 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:30.381690    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4" event={"ID":"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98","Type":"ContainerStarted","Data":"ef8fd4c752bada690592624e3b6835c8b4b2df0f5328de2393950eb658327c24"}
Sep 16 14:36:30.381848 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:30.381737    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4" event={"ID":"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98","Type":"ContainerStarted","Data":"16d875b7c5b87372934851753b98cd2dccde04ac9ea66cbdfb36962d0876c83d"}
Sep 16 14:36:30.381848 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:30.381759    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4" event={"ID":"1fbd2fee-ab0a-411c-bfc5-90e0e5095b98","Type":"ContainerStarted","Data":"e0a1cc2f7230b3f2dcb6985d5af90a43aabde6e1e366f12d5a25c0ba8fad7934"}
Sep 16 14:36:30.410205 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:30.410144    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5zn4w" podStartSLOduration=2.3887486669999998 podStartE2EDuration="3.41012249s" totalImagesPullingTime="962.107169ms" totalInitContainerRuntime="59.266654ms" isStatefulPod=true podCreationTimestamp="2026-09-16 14:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:30.409228067 +0000 UTC m=+64.760509775" watchObservedRunningTime="2026-09-16 14:36:30.41012249 +0000 UTC m=+64.761404199"
Sep 16 14:36:30.440683 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:30.440631    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8jks4" podStartSLOduration=1.449097644 podStartE2EDuration="3.440612754s" totalImagesPullingTime="1.99151511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:30.438618148 +0000 UTC m=+64.789899856" watchObservedRunningTime="2026-09-16 14:36:30.440612754 +0000 UTC m=+64.791894462"
Sep 16 14:36:31.799937 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.799892    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:36:31.800421 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.800010    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:36:31.802442 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.802416    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 14:36:31.803245 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.803227    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 14:36:31.813350 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.813294    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4082bab8-63bc-4409-82a6-7252cfa0c27e-original-pull-secret\") pod \"global-pull-secret-syncer-5vnp2\" (UID: \"4082bab8-63bc-4409-82a6-7252cfa0c27e\") " pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:36:31.813350 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.813302    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998db70f-12dc-4e57-bac1-f8e9a58b6090-metrics-certs\") pod \"network-metrics-daemon-5nlwp\" (UID: \"998db70f-12dc-4e57-bac1-f8e9a58b6090\") " pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:36:31.889370 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.889337    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"]
Sep 16 14:36:31.900399 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.900363    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vc2\" (UniqueName: \"kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2\") pod \"network-check-target-s6ffq\" (UID: \"e48d1272-a0fc-4220-b418-cea7875f093e\") " pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:31.904553 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.904517    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 14:36:31.912878 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.912851    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 14:36:31.923722 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.923693    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vc2\" (UniqueName: \"kubernetes.io/projected/e48d1272-a0fc-4220-b418-cea7875f093e-kube-api-access-49vc2\") pod \"network-check-target-s6ffq\" (UID: \"e48d1272-a0fc-4220-b418-cea7875f093e\") " pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:31.924339 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.924310    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"]
Sep 16 14:36:31.924440 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.924425    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"
Sep 16 14:36:31.927406 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.927267    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 16 14:36:31.927406 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.927317    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-nj4xg\""
Sep 16 14:36:31.994276 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:31.994240    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sr586\""
Sep 16 14:36:32.001641 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.001608    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4f5aaf-3db9-4aa1-8816-5582584733e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-g9l22\" (UID: \"be4f5aaf-3db9-4aa1-8816-5582584733e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"
Sep 16 14:36:32.001816 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.001651    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:32.001816 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.001674    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr8qv\" (UniqueName: \"kubernetes.io/projected/be4f5aaf-3db9-4aa1-8816-5582584733e6-kube-api-access-gr8qv\") pod \"monitoring-plugin-5d85778b9d-g9l22\" (UID: \"be4f5aaf-3db9-4aa1-8816-5582584733e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"
Sep 16 14:36:32.092953 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.092872    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bf8l5\""
Sep 16 14:36:32.098427 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.098402    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vnp2"
Sep 16 14:36:32.101544 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.101518    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nlwp"
Sep 16 14:36:32.102915 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.102889    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr8qv\" (UniqueName: \"kubernetes.io/projected/be4f5aaf-3db9-4aa1-8816-5582584733e6-kube-api-access-gr8qv\") pod \"monitoring-plugin-5d85778b9d-g9l22\" (UID: \"be4f5aaf-3db9-4aa1-8816-5582584733e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"
Sep 16 14:36:32.103024 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.102951    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4f5aaf-3db9-4aa1-8816-5582584733e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-g9l22\" (UID: \"be4f5aaf-3db9-4aa1-8816-5582584733e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"
Sep 16 14:36:32.103077 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:32.103058    2569 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 16 14:36:32.103145 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:36:32.103132    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be4f5aaf-3db9-4aa1-8816-5582584733e6-monitoring-plugin-cert podName:be4f5aaf-3db9-4aa1-8816-5582584733e6 nodeName:}" failed. No retries permitted until 2026-09-16 14:36:32.603111129 +0000 UTC m=+66.954392839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/be4f5aaf-3db9-4aa1-8816-5582584733e6-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-g9l22" (UID: "be4f5aaf-3db9-4aa1-8816-5582584733e6") : secret "monitoring-plugin-cert" not found
Sep 16 14:36:32.128681 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.128652    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr8qv\" (UniqueName: \"kubernetes.io/projected/be4f5aaf-3db9-4aa1-8816-5582584733e6-kube-api-access-gr8qv\") pod \"monitoring-plugin-5d85778b9d-g9l22\" (UID: \"be4f5aaf-3db9-4aa1-8816-5582584733e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"
Sep 16 14:36:32.392353 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.392322    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n" event={"ID":"d9066b8f-e848-43a7-880a-2b900858484e","Type":"ContainerStarted","Data":"9bc567abaa36fb809e5ca4f71afdc341969a76badef65a2308537394b0c488fd"}
Sep 16 14:36:32.393887 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.393856    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf" event={"ID":"91312d23-33c1-41e2-8779-56df58e024a3","Type":"ContainerStarted","Data":"1d20014bdd92b6aaee931fa23d3c403fe1682daf7ddbf8ff853f4943001cee1a"}
Sep 16 14:36:32.418341 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.418293    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wgh9n" podStartSLOduration=3.165976992 podStartE2EDuration="5.418273362s" totalImagesPullingTime="2.25229637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:32.415946908 +0000 UTC m=+66.767228649" watchObservedRunningTime="2026-09-16 14:36:32.418273362 +0000 UTC m=+66.769555070"
Sep 16 14:36:32.505792 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.505764    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5nlwp"]
Sep 16 14:36:32.508771 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:32.508736    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998db70f_12dc_4e57_bac1_f8e9a58b6090.slice/crio-d23120dee28bb1e878f8a1fdc844f5c6c0f6e731514936233391b6948fa8d84f WatchSource:0}: Error finding container d23120dee28bb1e878f8a1fdc844f5c6c0f6e731514936233391b6948fa8d84f: Status 404 returned error can't find the container with id d23120dee28bb1e878f8a1fdc844f5c6c0f6e731514936233391b6948fa8d84f
Sep 16 14:36:32.512637 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.512616    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5vnp2"]
Sep 16 14:36:32.513483 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.513466    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s6ffq"]
Sep 16 14:36:32.514516 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:32.514480    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4082bab8_63bc_4409_82a6_7252cfa0c27e.slice/crio-07d22d35f8e162e7128431be5383a0bb9a7963f659fbae5ba485c3185e86691a WatchSource:0}: Error finding container 07d22d35f8e162e7128431be5383a0bb9a7963f659fbae5ba485c3185e86691a: Status 404 returned error can't find the container with id 07d22d35f8e162e7128431be5383a0bb9a7963f659fbae5ba485c3185e86691a
Sep 16 14:36:32.515174 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:32.515154    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48d1272_a0fc_4220_b418_cea7875f093e.slice/crio-9f2d94c17e4335e5e2ed5ef20a2dc02bd54db97d34a98e0c67e95924dc83ff0b WatchSource:0}: Error finding container 9f2d94c17e4335e5e2ed5ef20a2dc02bd54db97d34a98e0c67e95924dc83ff0b: Status 404 returned error can't find the container with id 9f2d94c17e4335e5e2ed5ef20a2dc02bd54db97d34a98e0c67e95924dc83ff0b
Sep 16 14:36:32.608035 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.607944    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4f5aaf-3db9-4aa1-8816-5582584733e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-g9l22\" (UID: \"be4f5aaf-3db9-4aa1-8816-5582584733e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"
Sep 16 14:36:32.611023 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.610998    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be4f5aaf-3db9-4aa1-8816-5582584733e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-g9l22\" (UID: \"be4f5aaf-3db9-4aa1-8816-5582584733e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"
Sep 16 14:36:32.838002 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:32.837960    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"
Sep 16 14:36:33.133566 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:33.133459    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"]
Sep 16 14:36:33.145570 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:33.141529    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4f5aaf_3db9_4aa1_8816_5582584733e6.slice/crio-cbe4573c6ddbe5ae2e4c951bc72e3f01454c96934ff187e82cd0bf6643ab98e7 WatchSource:0}: Error finding container cbe4573c6ddbe5ae2e4c951bc72e3f01454c96934ff187e82cd0bf6643ab98e7: Status 404 returned error can't find the container with id cbe4573c6ddbe5ae2e4c951bc72e3f01454c96934ff187e82cd0bf6643ab98e7
Sep 16 14:36:33.400786 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:33.400732    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22" event={"ID":"be4f5aaf-3db9-4aa1-8816-5582584733e6","Type":"ContainerStarted","Data":"cbe4573c6ddbe5ae2e4c951bc72e3f01454c96934ff187e82cd0bf6643ab98e7"}
Sep 16 14:36:33.402568 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:33.402459    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5vnp2" event={"ID":"4082bab8-63bc-4409-82a6-7252cfa0c27e","Type":"ContainerStarted","Data":"07d22d35f8e162e7128431be5383a0bb9a7963f659fbae5ba485c3185e86691a"}
Sep 16 14:36:33.404808 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:33.404723    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5nlwp" event={"ID":"998db70f-12dc-4e57-bac1-f8e9a58b6090","Type":"ContainerStarted","Data":"d23120dee28bb1e878f8a1fdc844f5c6c0f6e731514936233391b6948fa8d84f"}
Sep 16 14:36:33.409021 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:33.408394    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s6ffq" event={"ID":"e48d1272-a0fc-4220-b418-cea7875f093e","Type":"ContainerStarted","Data":"9f2d94c17e4335e5e2ed5ef20a2dc02bd54db97d34a98e0c67e95924dc83ff0b"}
Sep 16 14:36:33.411881 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:33.411860    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf" event={"ID":"91312d23-33c1-41e2-8779-56df58e024a3","Type":"ContainerStarted","Data":"64ec9a34bf20eb04640a3a0a9d7d01412ccb97dbcb02d39288f432d8f7490ec3"}
Sep 16 14:36:33.412015 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:33.411923    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf" event={"ID":"91312d23-33c1-41e2-8779-56df58e024a3","Type":"ContainerStarted","Data":"929ce7296fd2273328b3681c35bbd291e262e77068eec9d8ac84e555e742a4d8"}
Sep 16 14:36:34.422244 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:34.422203    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf" event={"ID":"91312d23-33c1-41e2-8779-56df58e024a3","Type":"ContainerStarted","Data":"a57a90c8e866b54aa0dc81e46f94a501e27ec302b40e9af8f4f88bb66d1679e3"}
Sep 16 14:36:34.422726 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:34.422297    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf" event={"ID":"91312d23-33c1-41e2-8779-56df58e024a3","Type":"ContainerStarted","Data":"08c03a0bdaf3cbed7a8f6e17eb66fa755b521740e09b37b0d72b285215c470f1"}
Sep 16 14:36:34.422726 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:34.422339    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf" event={"ID":"91312d23-33c1-41e2-8779-56df58e024a3","Type":"ContainerStarted","Data":"0cc8de60310572080d1ea63057c45201c8dceb76e735a202ee4ed81ba1d7e8cb"}
Sep 16 14:36:34.422726 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:34.422522    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:34.425367 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:34.425336    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5nlwp" event={"ID":"998db70f-12dc-4e57-bac1-f8e9a58b6090","Type":"ContainerStarted","Data":"5fcdf633fda306239011d7e75bde038611b0527efde24c1ac60978599125863f"}
Sep 16 14:36:34.425519 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:34.425388    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5nlwp" event={"ID":"998db70f-12dc-4e57-bac1-f8e9a58b6090","Type":"ContainerStarted","Data":"1e3170b0661c337fd2b69312dbe0234a5c1be7b34479c4f83aedc29c63dd60e6"}
Sep 16 14:36:34.472156 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:34.472097    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf" podStartSLOduration=2.001836375 podStartE2EDuration="5.472073466s" totalImagesPullingTime="3.470237091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:34.471323611 +0000 UTC m=+68.822605323" watchObservedRunningTime="2026-09-16 14:36:34.472073466 +0000 UTC m=+68.823355176"
Sep 16 14:36:34.520374 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:34.520316    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5nlwp" podStartSLOduration=67.341413772 podStartE2EDuration="1m8.520296214s" totalImagesPullingTime="1.178882442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:34.519622118 +0000 UTC m=+68.870903825" watchObservedRunningTime="2026-09-16 14:36:34.520296214 +0000 UTC m=+68.871577925"
Sep 16 14:36:36.222521 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.222472    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b55ccccb8-5q248"]
Sep 16 14:36:36.226974 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.226944    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.231694 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.231672    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 14:36:36.231836 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.231696    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 14:36:36.232524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.232483    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 14:36:36.233596 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.233575    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 14:36:36.233743 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.233724    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b2vv8\""
Sep 16 14:36:36.233960 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.233938    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 14:36:36.234321 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.234152    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 14:36:36.234321 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.234250    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 14:36:36.243447 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.243425    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 14:36:36.267243 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.267217    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b55ccccb8-5q248"]
Sep 16 14:36:36.336950 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.336916    2569 patch_prober.go:28] interesting pod/image-registry-6549888cd5-7z96d container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 16 14:36:36.337103 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.336963    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6549888cd5-7z96d" podUID="3fd81b2c-f0b8-4af9-9302-822a7233b6b6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:36:36.338050 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.338021    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-oauth-config\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.338174 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.338109    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-service-ca\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.338174 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.338132    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-trusted-ca-bundle\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.338174 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.338162    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8g2j\" (UniqueName: \"kubernetes.io/projected/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-kube-api-access-g8g2j\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.338295 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.338184    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-serving-cert\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.338295 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.338211    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-oauth-serving-cert\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.338295 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.338233    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-config\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.439116 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.439086    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-oauth-config\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.439266 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.439145    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-service-ca\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.439266 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.439173    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-trusted-ca-bundle\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.439266 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.439193    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8g2j\" (UniqueName: \"kubernetes.io/projected/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-kube-api-access-g8g2j\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.439266 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.439213    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-serving-cert\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.439266 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.439242    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-oauth-serving-cert\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.439266 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.439268    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-config\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.440015 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.439951    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-config\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.440015 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.439953    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-service-ca\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.440193 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.440080    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-trusted-ca-bundle\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.440248 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.440187    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-oauth-serving-cert\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.441969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.441951    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-oauth-config\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.442178 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.442161    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-serving-cert\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.456376 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.456350    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8g2j\" (UniqueName: \"kubernetes.io/projected/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-kube-api-access-g8g2j\") pod \"console-6b55ccccb8-5q248\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") " pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:36.537470 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:36.537435    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:37.825405 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:37.825337    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b55ccccb8-5q248"]
Sep 16 14:36:37.828341 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:36:37.828314    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab412d4_7e8c_48d8_9a76_03a88f4d5cd3.slice/crio-6fee62e3001d321475ff102d2e14dc296fa8754debfd4376c1a5a290a8aae667 WatchSource:0}: Error finding container 6fee62e3001d321475ff102d2e14dc296fa8754debfd4376c1a5a290a8aae667: Status 404 returned error can't find the container with id 6fee62e3001d321475ff102d2e14dc296fa8754debfd4376c1a5a290a8aae667
Sep 16 14:36:38.326091 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:38.326065    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6549888cd5-7z96d"
Sep 16 14:36:38.447257 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:38.447224    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22" event={"ID":"be4f5aaf-3db9-4aa1-8816-5582584733e6","Type":"ContainerStarted","Data":"6549efb98aedbb166e6568a728e700bb7b20d8113be9a60753b6c67c676d3b68"}
Sep 16 14:36:38.447807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:38.447657    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"
Sep 16 14:36:38.449922 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:38.449884    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5vnp2" event={"ID":"4082bab8-63bc-4409-82a6-7252cfa0c27e","Type":"ContainerStarted","Data":"101beb0d35a7d0f89eceabc795d941c57ba8628703f18169bce8212307554c27"}
Sep 16 14:36:38.451589 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:38.451563    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b55ccccb8-5q248" event={"ID":"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3","Type":"ContainerStarted","Data":"6fee62e3001d321475ff102d2e14dc296fa8754debfd4376c1a5a290a8aae667"}
Sep 16 14:36:38.453539 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:38.453515    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22"
Sep 16 14:36:38.454087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:38.454053    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s6ffq" event={"ID":"e48d1272-a0fc-4220-b418-cea7875f093e","Type":"ContainerStarted","Data":"a5e951cddcfa25a69175ab6c2a2b25d5e69d2c2d69370e4e45828247d8af1c48"}
Sep 16 14:36:38.454716 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:38.454479    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:36:38.499246 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:38.499165    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-g9l22" podStartSLOduration=3.09476088 podStartE2EDuration="7.499146287s" totalImagesPullingTime="4.404385407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:38.496565929 +0000 UTC m=+72.847847638" watchObservedRunningTime="2026-09-16 14:36:38.499146287 +0000 UTC m=+72.850427998"
Sep 16 14:36:38.561510 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:38.561453    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s6ffq" podStartSLOduration=67.530296147 podStartE2EDuration="1m12.561436845s" totalImagesPullingTime="5.031140698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:38.523588556 +0000 UTC m=+72.874870266" watchObservedRunningTime="2026-09-16 14:36:38.561436845 +0000 UTC m=+72.912718556"
Sep 16 14:36:38.602955 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:38.602856    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5vnp2" podStartSLOduration=67.561565705 podStartE2EDuration="1m12.602841266s" totalImagesPullingTime="5.041275561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:38.602190677 +0000 UTC m=+72.953472386" watchObservedRunningTime="2026-09-16 14:36:38.602841266 +0000 UTC m=+72.954122975"
Sep 16 14:36:40.437772 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:40.437742    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-bdbb9f644-8z7xf"
Sep 16 14:36:41.467850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:41.467819    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b55ccccb8-5q248" event={"ID":"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3","Type":"ContainerStarted","Data":"4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa"}
Sep 16 14:36:41.487337 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:41.487290    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b55ccccb8-5q248" podStartSLOduration=2.637046076 podStartE2EDuration="5.487274795s" totalImagesPullingTime="2.850228719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:41.486000209 +0000 UTC m=+75.837281952" watchObservedRunningTime="2026-09-16 14:36:41.487274795 +0000 UTC m=+75.838556503"
Sep 16 14:36:46.538080 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:46.538043    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:46.538443 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:46.538139    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:46.542610 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:46.542591    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:36:47.491927 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:36:47.491899    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:37:10.465579 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:10.465548    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s6ffq"
Sep 16 14:37:51.835179 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.835144    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"]
Sep 16 14:37:51.837209 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.837193    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.842481 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.842454    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7gbfq\""
Sep 16 14:37:51.842636 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.842516    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 16 14:37:51.842636 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.842557    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 16 14:37:51.842636 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.842594    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 16 14:37:51.842825 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.842654    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 16 14:37:51.842825 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.842700    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 16 14:37:51.848084 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.848060    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 16 14:37:51.859780 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.859753    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"]
Sep 16 14:37:51.867326 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.867305    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58f7f3cb-5205-4454-81b8-5b03042513b4-serving-certs-ca-bundle\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.867434 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.867333    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wdx9\" (UniqueName: \"kubernetes.io/projected/58f7f3cb-5205-4454-81b8-5b03042513b4-kube-api-access-2wdx9\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.867434 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.867353    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58f7f3cb-5205-4454-81b8-5b03042513b4-telemeter-client-tls\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.867434 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.867374    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58f7f3cb-5205-4454-81b8-5b03042513b4-federate-client-tls\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.867434 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.867394    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58f7f3cb-5205-4454-81b8-5b03042513b4-metrics-client-ca\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.867623 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.867454    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58f7f3cb-5205-4454-81b8-5b03042513b4-secret-telemeter-client\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.867623 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.867518    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58f7f3cb-5205-4454-81b8-5b03042513b4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.867623 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.867551    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58f7f3cb-5205-4454-81b8-5b03042513b4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.968411 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.968378    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58f7f3cb-5205-4454-81b8-5b03042513b4-telemeter-client-tls\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.968411 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.968414    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58f7f3cb-5205-4454-81b8-5b03042513b4-federate-client-tls\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.968662 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.968435    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58f7f3cb-5205-4454-81b8-5b03042513b4-metrics-client-ca\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.968662 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.968456    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58f7f3cb-5205-4454-81b8-5b03042513b4-secret-telemeter-client\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.968662 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.968474    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58f7f3cb-5205-4454-81b8-5b03042513b4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.968662 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.968526    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58f7f3cb-5205-4454-81b8-5b03042513b4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.968662 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.968556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58f7f3cb-5205-4454-81b8-5b03042513b4-serving-certs-ca-bundle\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.968662 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.968578    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wdx9\" (UniqueName: \"kubernetes.io/projected/58f7f3cb-5205-4454-81b8-5b03042513b4-kube-api-access-2wdx9\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.969271 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.969247    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58f7f3cb-5205-4454-81b8-5b03042513b4-metrics-client-ca\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.969366 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.969306    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58f7f3cb-5205-4454-81b8-5b03042513b4-serving-certs-ca-bundle\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.969675 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.969650    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58f7f3cb-5205-4454-81b8-5b03042513b4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.971096 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.971072    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58f7f3cb-5205-4454-81b8-5b03042513b4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.971195 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.971168    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58f7f3cb-5205-4454-81b8-5b03042513b4-federate-client-tls\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.971449 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.971428    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58f7f3cb-5205-4454-81b8-5b03042513b4-telemeter-client-tls\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.971897 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.971878    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58f7f3cb-5205-4454-81b8-5b03042513b4-secret-telemeter-client\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:51.977192 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:51.977171    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wdx9\" (UniqueName: \"kubernetes.io/projected/58f7f3cb-5205-4454-81b8-5b03042513b4-kube-api-access-2wdx9\") pod \"telemeter-client-5dff78d8db-ckh2l\" (UID: \"58f7f3cb-5205-4454-81b8-5b03042513b4\") " pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:52.154943 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:52.154858    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"
Sep 16 14:37:52.430968 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:52.430838    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5dff78d8db-ckh2l"]
Sep 16 14:37:52.433177 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:37:52.433150    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f7f3cb_5205_4454_81b8_5b03042513b4.slice/crio-4fd20c91d8dfbb1efb6a387da6787a88a8ca4206caab63452cece5295093da7a WatchSource:0}: Error finding container 4fd20c91d8dfbb1efb6a387da6787a88a8ca4206caab63452cece5295093da7a: Status 404 returned error can't find the container with id 4fd20c91d8dfbb1efb6a387da6787a88a8ca4206caab63452cece5295093da7a
Sep 16 14:37:52.717741 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:52.717650    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l" event={"ID":"58f7f3cb-5205-4454-81b8-5b03042513b4","Type":"ContainerStarted","Data":"4fd20c91d8dfbb1efb6a387da6787a88a8ca4206caab63452cece5295093da7a"}
Sep 16 14:37:54.726334 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:54.726307    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l" event={"ID":"58f7f3cb-5205-4454-81b8-5b03042513b4","Type":"ContainerStarted","Data":"55a2805dd1c190768a3828cdf22ebf9e8c1465ab15de82ecbc701a2946c20bb5"}
Sep 16 14:37:56.736064 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.736025    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l" event={"ID":"58f7f3cb-5205-4454-81b8-5b03042513b4","Type":"ContainerStarted","Data":"b6718081398bdb2880a88b7e8c0bbbaaaec4dec466c4f921f2fb985071c8902b"}
Sep 16 14:37:56.736413 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.736089    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l" event={"ID":"58f7f3cb-5205-4454-81b8-5b03042513b4","Type":"ContainerStarted","Data":"e2b23684515cfb04371f69cbf7b15df51a23ac9c9435235152fddfc46790274b"}
Sep 16 14:37:56.759814 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.759754    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5dff78d8db-ckh2l" podStartSLOduration=2.446556882 podStartE2EDuration="5.759733542s" totalImagesPullingTime="3.31317666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:37:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:37:56.757788591 +0000 UTC m=+151.109070301" watchObservedRunningTime="2026-09-16 14:37:56.759733542 +0000 UTC m=+151.111015245"
Sep 16 14:37:56.842791 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.842753    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69fb4d856-xgrz8"]
Sep 16 14:37:56.845140 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.845117    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:56.858467 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.858441    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69fb4d856-xgrz8"]
Sep 16 14:37:56.910043 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.910005    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/897f10ac-41f7-406d-9050-07eab98ea728-console-oauth-config\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:56.910043 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.910042    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-service-ca\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:56.910288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.910066    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-oauth-serving-cert\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:56.910288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.910176    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/897f10ac-41f7-406d-9050-07eab98ea728-console-serving-cert\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:56.910288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.910221    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-console-config\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:56.910288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.910281    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjkzg\" (UniqueName: \"kubernetes.io/projected/897f10ac-41f7-406d-9050-07eab98ea728-kube-api-access-jjkzg\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:56.910418 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:56.910302    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-trusted-ca-bundle\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.011304 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.011274    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/897f10ac-41f7-406d-9050-07eab98ea728-console-oauth-config\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.011476 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.011311    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-service-ca\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.011476 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.011327    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-oauth-serving-cert\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.011476 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.011364    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/897f10ac-41f7-406d-9050-07eab98ea728-console-serving-cert\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.011476 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.011392    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-console-config\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.011476 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.011430    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjkzg\" (UniqueName: \"kubernetes.io/projected/897f10ac-41f7-406d-9050-07eab98ea728-kube-api-access-jjkzg\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.011476 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.011459    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-trusted-ca-bundle\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.012200 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.012170    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-oauth-serving-cert\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.012200 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.012185    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-service-ca\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.012329 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.012173    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-console-config\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.012329 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.012314    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-trusted-ca-bundle\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.014200 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.014175    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/897f10ac-41f7-406d-9050-07eab98ea728-console-serving-cert\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.014336 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.014313    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/897f10ac-41f7-406d-9050-07eab98ea728-console-oauth-config\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.019501 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.019475    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjkzg\" (UniqueName: \"kubernetes.io/projected/897f10ac-41f7-406d-9050-07eab98ea728-kube-api-access-jjkzg\") pod \"console-69fb4d856-xgrz8\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") " pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.153963 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.153919    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:37:57.423766 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.423690    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69fb4d856-xgrz8"]
Sep 16 14:37:57.427600 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:37:57.427572    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod897f10ac_41f7_406d_9050_07eab98ea728.slice/crio-f0f7a711c07d7bf5e4cbd34eb9ea2f8848cbe7d43eb02fd82c00bf99aa0abbb9 WatchSource:0}: Error finding container f0f7a711c07d7bf5e4cbd34eb9ea2f8848cbe7d43eb02fd82c00bf99aa0abbb9: Status 404 returned error can't find the container with id f0f7a711c07d7bf5e4cbd34eb9ea2f8848cbe7d43eb02fd82c00bf99aa0abbb9
Sep 16 14:37:57.741824 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.741792    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fb4d856-xgrz8" event={"ID":"897f10ac-41f7-406d-9050-07eab98ea728","Type":"ContainerStarted","Data":"0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396"}
Sep 16 14:37:57.742223 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.741839    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fb4d856-xgrz8" event={"ID":"897f10ac-41f7-406d-9050-07eab98ea728","Type":"ContainerStarted","Data":"f0f7a711c07d7bf5e4cbd34eb9ea2f8848cbe7d43eb02fd82c00bf99aa0abbb9"}
Sep 16 14:37:57.760527 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:37:57.760457    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69fb4d856-xgrz8" podStartSLOduration=1.760439034 podStartE2EDuration="1.760439034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:37:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:37:57.759009195 +0000 UTC m=+152.110290904" watchObservedRunningTime="2026-09-16 14:37:57.760439034 +0000 UTC m=+152.111720812"
Sep 16 14:38:07.154357 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:07.154317    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:38:07.154876 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:07.154382    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:38:07.159084 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:07.159058    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:38:07.782585 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:07.782554    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:38:07.897400 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:07.897364    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b55ccccb8-5q248"]
Sep 16 14:38:32.916012 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:32.915904    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b55ccccb8-5q248" podUID="8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" containerName="console" containerID="cri-o://4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa" gracePeriod=15
Sep 16 14:38:33.160453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.160430    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:38:33.299511 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.299457    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-trusted-ca-bundle\") pod \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") "
Sep 16 14:38:33.299688 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.299523    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-serving-cert\") pod \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") "
Sep 16 14:38:33.299688 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.299553    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8g2j\" (UniqueName: \"kubernetes.io/projected/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-kube-api-access-g8g2j\") pod \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") "
Sep 16 14:38:33.299688 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.299614    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-config\") pod \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") "
Sep 16 14:38:33.299688 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.299656    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-service-ca\") pod \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") "
Sep 16 14:38:33.299899 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.299715    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-oauth-config\") pod \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") "
Sep 16 14:38:33.299899 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.299740    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-oauth-serving-cert\") pod \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\" (UID: \"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3\") "
Sep 16 14:38:33.300009 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.299982    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" (UID: "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:38:33.300140 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.300107    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-config" (OuterVolumeSpecName: "console-config") pod "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" (UID: "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:38:33.300219 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.300146    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-service-ca" (OuterVolumeSpecName: "service-ca") pod "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" (UID: "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:38:33.300284 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.300263    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" (UID: "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:38:33.301847 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.301821    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-kube-api-access-g8g2j" (OuterVolumeSpecName: "kube-api-access-g8g2j") pod "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" (UID: "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3"). InnerVolumeSpecName "kube-api-access-g8g2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:38:33.301847 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.301838    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" (UID: "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:38:33.301984 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.301880    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" (UID: "8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:38:33.400641 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.400607    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-oauth-config\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:38:33.400641 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.400634    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-oauth-serving-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:38:33.400641 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.400644    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-trusted-ca-bundle\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:38:33.400854 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.400654    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-serving-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:38:33.400854 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.400664    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8g2j\" (UniqueName: \"kubernetes.io/projected/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-kube-api-access-g8g2j\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:38:33.400854 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.400673    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-console-config\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:38:33.400854 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.400681    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3-service-ca\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:38:33.882149 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.882109    2569 generic.go:356] "Generic (PLEG): container finished" podID="8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" containerID="4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa" exitCode=0
Sep 16 14:38:33.882310 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.882157    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b55ccccb8-5q248" event={"ID":"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3","Type":"ContainerDied","Data":"4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa"}
Sep 16 14:38:33.882310 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.882198    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b55ccccb8-5q248" event={"ID":"8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3","Type":"ContainerDied","Data":"6fee62e3001d321475ff102d2e14dc296fa8754debfd4376c1a5a290a8aae667"}
Sep 16 14:38:33.882310 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.882229    2569 scope.go:117] "RemoveContainer" containerID="4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa"
Sep 16 14:38:33.882310 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.882161    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b55ccccb8-5q248"
Sep 16 14:38:33.891265 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.891241    2569 scope.go:117] "RemoveContainer" containerID="4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa"
Sep 16 14:38:33.891539 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:38:33.891518    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa\": container with ID starting with 4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa not found: ID does not exist" containerID="4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa"
Sep 16 14:38:33.891598 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.891547    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa"} err="failed to get container status \"4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa\": rpc error: code = NotFound desc = could not find container \"4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa\": container with ID starting with 4a21b3e8091048b640fda41505693eb886b0c18315419739fa74a07c1b4f11aa not found: ID does not exist"
Sep 16 14:38:33.901681 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.901657    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b55ccccb8-5q248"]
Sep 16 14:38:33.905635 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:33.905616    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b55ccccb8-5q248"]
Sep 16 14:38:34.086529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:38:34.086481    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" path="/var/lib/kubelet/pods/8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3/volumes"
Sep 16 14:39:14.515409 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.515371    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-859f7bb74f-h75xv"]
Sep 16 14:39:14.515949 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.515814    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" containerName="console"
Sep 16 14:39:14.515949 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.515836    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" containerName="console"
Sep 16 14:39:14.515949 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.515909    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ab412d4-7e8c-48d8-9a76-03a88f4d5cd3" containerName="console"
Sep 16 14:39:14.519131 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.519109    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.529983 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.529960    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-859f7bb74f-h75xv"]
Sep 16 14:39:14.572794 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.572771    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/768d4809-c730-449c-abbc-599c261e59e8-console-serving-cert\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.572921 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.572803    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-trusted-ca-bundle\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.572921 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.572830    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t7nf\" (UniqueName: \"kubernetes.io/projected/768d4809-c730-449c-abbc-599c261e59e8-kube-api-access-9t7nf\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.572921 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.572895    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/768d4809-c730-449c-abbc-599c261e59e8-console-oauth-config\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.573023 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.572927    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-service-ca\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.573023 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.572960    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-console-config\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.573023 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.572983    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-oauth-serving-cert\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.674137 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.674100    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-console-config\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.674241 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.674139    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-oauth-serving-cert\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.674241 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.674193    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/768d4809-c730-449c-abbc-599c261e59e8-console-serving-cert\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.674241 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.674220    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-trusted-ca-bundle\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.674364 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.674253    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t7nf\" (UniqueName: \"kubernetes.io/projected/768d4809-c730-449c-abbc-599c261e59e8-kube-api-access-9t7nf\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.674364 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.674284    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/768d4809-c730-449c-abbc-599c261e59e8-console-oauth-config\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.674364 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.674311    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-service-ca\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.674998 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.674967    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-console-config\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.675123 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.674999    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-oauth-serving-cert\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.675123 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.675011    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-service-ca\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.675123 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.675109    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-trusted-ca-bundle\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.676606 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.676579    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/768d4809-c730-449c-abbc-599c261e59e8-console-serving-cert\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.676702 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.676669    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/768d4809-c730-449c-abbc-599c261e59e8-console-oauth-config\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.682185 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.682151    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t7nf\" (UniqueName: \"kubernetes.io/projected/768d4809-c730-449c-abbc-599c261e59e8-kube-api-access-9t7nf\") pod \"console-859f7bb74f-h75xv\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") " pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:14.828743 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:14.828683    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:15.098592 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:15.098380    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-859f7bb74f-h75xv"]
Sep 16 14:39:15.100944 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:39:15.100918    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768d4809_c730_449c_abbc_599c261e59e8.slice/crio-bdc111ae01eb0b591e167655390a5d89c54812b04295743fed7f183a5c5f6e77 WatchSource:0}: Error finding container bdc111ae01eb0b591e167655390a5d89c54812b04295743fed7f183a5c5f6e77: Status 404 returned error can't find the container with id bdc111ae01eb0b591e167655390a5d89c54812b04295743fed7f183a5c5f6e77
Sep 16 14:39:16.044803 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:16.044769    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859f7bb74f-h75xv" event={"ID":"768d4809-c730-449c-abbc-599c261e59e8","Type":"ContainerStarted","Data":"6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a"}
Sep 16 14:39:16.045177 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:16.044817    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859f7bb74f-h75xv" event={"ID":"768d4809-c730-449c-abbc-599c261e59e8","Type":"ContainerStarted","Data":"bdc111ae01eb0b591e167655390a5d89c54812b04295743fed7f183a5c5f6e77"}
Sep 16 14:39:16.062190 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:16.062143    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-859f7bb74f-h75xv" podStartSLOduration=2.062127281 podStartE2EDuration="2.062127281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:39:16.061049555 +0000 UTC m=+230.412331267" watchObservedRunningTime="2026-09-16 14:39:16.062127281 +0000 UTC m=+230.413408989"
Sep 16 14:39:24.829488 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:24.829431    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:24.829488 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:24.829518    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:24.834086 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:24.834063    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:25.081718 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:25.081629    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:39:25.125730 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:25.125695    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69fb4d856-xgrz8"]
Sep 16 14:39:50.145015 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.144927    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69fb4d856-xgrz8" podUID="897f10ac-41f7-406d-9050-07eab98ea728" containerName="console" containerID="cri-o://0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396" gracePeriod=15
Sep 16 14:39:50.385745 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.385719    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:39:50.540273 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.540231    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-oauth-serving-cert\") pod \"897f10ac-41f7-406d-9050-07eab98ea728\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") "
Sep 16 14:39:50.540273 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.540269    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjkzg\" (UniqueName: \"kubernetes.io/projected/897f10ac-41f7-406d-9050-07eab98ea728-kube-api-access-jjkzg\") pod \"897f10ac-41f7-406d-9050-07eab98ea728\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") "
Sep 16 14:39:50.540532 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.540327    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-service-ca\") pod \"897f10ac-41f7-406d-9050-07eab98ea728\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") "
Sep 16 14:39:50.540532 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.540346    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/897f10ac-41f7-406d-9050-07eab98ea728-console-serving-cert\") pod \"897f10ac-41f7-406d-9050-07eab98ea728\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") "
Sep 16 14:39:50.540532 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.540379    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/897f10ac-41f7-406d-9050-07eab98ea728-console-oauth-config\") pod \"897f10ac-41f7-406d-9050-07eab98ea728\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") "
Sep 16 14:39:50.540532 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.540406    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-trusted-ca-bundle\") pod \"897f10ac-41f7-406d-9050-07eab98ea728\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") "
Sep 16 14:39:50.540532 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.540429    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-console-config\") pod \"897f10ac-41f7-406d-9050-07eab98ea728\" (UID: \"897f10ac-41f7-406d-9050-07eab98ea728\") "
Sep 16 14:39:50.540788 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.540763    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "897f10ac-41f7-406d-9050-07eab98ea728" (UID: "897f10ac-41f7-406d-9050-07eab98ea728"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:39:50.540873 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.540836    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-service-ca" (OuterVolumeSpecName: "service-ca") pod "897f10ac-41f7-406d-9050-07eab98ea728" (UID: "897f10ac-41f7-406d-9050-07eab98ea728"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:39:50.540949 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.540877    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-console-config" (OuterVolumeSpecName: "console-config") pod "897f10ac-41f7-406d-9050-07eab98ea728" (UID: "897f10ac-41f7-406d-9050-07eab98ea728"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:39:50.540949 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.540918    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "897f10ac-41f7-406d-9050-07eab98ea728" (UID: "897f10ac-41f7-406d-9050-07eab98ea728"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:39:50.542742 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.542713    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/897f10ac-41f7-406d-9050-07eab98ea728-kube-api-access-jjkzg" (OuterVolumeSpecName: "kube-api-access-jjkzg") pod "897f10ac-41f7-406d-9050-07eab98ea728" (UID: "897f10ac-41f7-406d-9050-07eab98ea728"). InnerVolumeSpecName "kube-api-access-jjkzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:39:50.542958 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.542938    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/897f10ac-41f7-406d-9050-07eab98ea728-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "897f10ac-41f7-406d-9050-07eab98ea728" (UID: "897f10ac-41f7-406d-9050-07eab98ea728"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:39:50.543018 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.542957    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/897f10ac-41f7-406d-9050-07eab98ea728-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "897f10ac-41f7-406d-9050-07eab98ea728" (UID: "897f10ac-41f7-406d-9050-07eab98ea728"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:39:50.640961 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.640918    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-oauth-serving-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:39:50.640961 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.640949    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjkzg\" (UniqueName: \"kubernetes.io/projected/897f10ac-41f7-406d-9050-07eab98ea728-kube-api-access-jjkzg\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:39:50.640961 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.640959    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-service-ca\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:39:50.640961 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.640968    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/897f10ac-41f7-406d-9050-07eab98ea728-console-serving-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:39:50.641211 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.640976    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/897f10ac-41f7-406d-9050-07eab98ea728-console-oauth-config\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:39:50.641211 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.640985    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-trusted-ca-bundle\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:39:50.641211 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:50.640992    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/897f10ac-41f7-406d-9050-07eab98ea728-console-config\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:39:51.165078 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:51.165047    2569 generic.go:356] "Generic (PLEG): container finished" podID="897f10ac-41f7-406d-9050-07eab98ea728" containerID="0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396" exitCode=0
Sep 16 14:39:51.165472 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:51.165088    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fb4d856-xgrz8"
Sep 16 14:39:51.165472 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:51.165121    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fb4d856-xgrz8" event={"ID":"897f10ac-41f7-406d-9050-07eab98ea728","Type":"ContainerDied","Data":"0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396"}
Sep 16 14:39:51.165472 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:51.165156    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fb4d856-xgrz8" event={"ID":"897f10ac-41f7-406d-9050-07eab98ea728","Type":"ContainerDied","Data":"f0f7a711c07d7bf5e4cbd34eb9ea2f8848cbe7d43eb02fd82c00bf99aa0abbb9"}
Sep 16 14:39:51.165472 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:51.165174    2569 scope.go:117] "RemoveContainer" containerID="0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396"
Sep 16 14:39:51.173502 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:51.173475    2569 scope.go:117] "RemoveContainer" containerID="0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396"
Sep 16 14:39:51.173753 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:39:51.173735    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396\": container with ID starting with 0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396 not found: ID does not exist" containerID="0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396"
Sep 16 14:39:51.173818 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:51.173758    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396"} err="failed to get container status \"0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396\": rpc error: code = NotFound desc = could not find container \"0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396\": container with ID starting with 0beb778bf7fcba88d7571e4a6d6cdf4ed4e62a5c08c9c5b469a33d56442c0396 not found: ID does not exist"
Sep 16 14:39:51.184653 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:51.184632    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69fb4d856-xgrz8"]
Sep 16 14:39:51.188711 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:51.188688    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69fb4d856-xgrz8"]
Sep 16 14:39:52.087561 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:39:52.087526    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="897f10ac-41f7-406d-9050-07eab98ea728" path="/var/lib/kubelet/pods/897f10ac-41f7-406d-9050-07eab98ea728/volumes"
Sep 16 14:40:04.299697 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.299661    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"]
Sep 16 14:40:04.300052 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.299961    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="897f10ac-41f7-406d-9050-07eab98ea728" containerName="console"
Sep 16 14:40:04.300052 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.299971    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="897f10ac-41f7-406d-9050-07eab98ea728" containerName="console"
Sep 16 14:40:04.300052 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.300018    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="897f10ac-41f7-406d-9050-07eab98ea728" containerName="console"
Sep 16 14:40:04.304267 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.304249    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:04.306797 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.306773    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 14:40:04.306972 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.306960    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 14:40:04.307665 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.307644    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jsmkt\""
Sep 16 14:40:04.313012 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.312990    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"]
Sep 16 14:40:04.441284 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.441248    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8efcc07f-492c-4792-8044-6b8e515aa0b4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp\" (UID: \"8efcc07f-492c-4792-8044-6b8e515aa0b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:04.441284 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.441289    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8efcc07f-492c-4792-8044-6b8e515aa0b4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp\" (UID: \"8efcc07f-492c-4792-8044-6b8e515aa0b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:04.441514 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.441316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws8vr\" (UniqueName: \"kubernetes.io/projected/8efcc07f-492c-4792-8044-6b8e515aa0b4-kube-api-access-ws8vr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp\" (UID: \"8efcc07f-492c-4792-8044-6b8e515aa0b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:04.541659 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.541628    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8efcc07f-492c-4792-8044-6b8e515aa0b4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp\" (UID: \"8efcc07f-492c-4792-8044-6b8e515aa0b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:04.541749 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.541670    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws8vr\" (UniqueName: \"kubernetes.io/projected/8efcc07f-492c-4792-8044-6b8e515aa0b4-kube-api-access-ws8vr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp\" (UID: \"8efcc07f-492c-4792-8044-6b8e515aa0b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:04.541749 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.541717    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8efcc07f-492c-4792-8044-6b8e515aa0b4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp\" (UID: \"8efcc07f-492c-4792-8044-6b8e515aa0b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:04.541992 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.541974    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8efcc07f-492c-4792-8044-6b8e515aa0b4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp\" (UID: \"8efcc07f-492c-4792-8044-6b8e515aa0b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:04.542027 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.541998    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8efcc07f-492c-4792-8044-6b8e515aa0b4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp\" (UID: \"8efcc07f-492c-4792-8044-6b8e515aa0b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:04.549634 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.549609    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws8vr\" (UniqueName: \"kubernetes.io/projected/8efcc07f-492c-4792-8044-6b8e515aa0b4-kube-api-access-ws8vr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp\" (UID: \"8efcc07f-492c-4792-8044-6b8e515aa0b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:04.613584 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.613557    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:04.908105 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:04.908032    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"]
Sep 16 14:40:04.911084 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:40:04.911058    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efcc07f_492c_4792_8044_6b8e515aa0b4.slice/crio-de01287ff9806d62c91e5a63227832a1908be6d1fca832596925bbf91deb37f9 WatchSource:0}: Error finding container de01287ff9806d62c91e5a63227832a1908be6d1fca832596925bbf91deb37f9: Status 404 returned error can't find the container with id de01287ff9806d62c91e5a63227832a1908be6d1fca832596925bbf91deb37f9
Sep 16 14:40:05.218733 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:05.218655    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp" event={"ID":"8efcc07f-492c-4792-8044-6b8e515aa0b4","Type":"ContainerStarted","Data":"de01287ff9806d62c91e5a63227832a1908be6d1fca832596925bbf91deb37f9"}
Sep 16 14:40:10.241210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:10.241164    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp" event={"ID":"8efcc07f-492c-4792-8044-6b8e515aa0b4","Type":"ContainerStarted","Data":"4c05882d53d6cbaad3847c6f2408c83bc1e0401e42ff9bffb61317f37924d377"}
Sep 16 14:40:11.246617 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:11.246584    2569 generic.go:356] "Generic (PLEG): container finished" podID="8efcc07f-492c-4792-8044-6b8e515aa0b4" containerID="4c05882d53d6cbaad3847c6f2408c83bc1e0401e42ff9bffb61317f37924d377" exitCode=0
Sep 16 14:40:11.247001 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:11.246658    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp" event={"ID":"8efcc07f-492c-4792-8044-6b8e515aa0b4","Type":"ContainerDied","Data":"4c05882d53d6cbaad3847c6f2408c83bc1e0401e42ff9bffb61317f37924d377"}
Sep 16 14:40:14.261032 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:14.260994    2569 generic.go:356] "Generic (PLEG): container finished" podID="8efcc07f-492c-4792-8044-6b8e515aa0b4" containerID="9d068503282b1588a35cdc7e0e494badce486238b7145984e644272891fb697c" exitCode=0
Sep 16 14:40:14.261435 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:14.261081    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp" event={"ID":"8efcc07f-492c-4792-8044-6b8e515aa0b4","Type":"ContainerDied","Data":"9d068503282b1588a35cdc7e0e494badce486238b7145984e644272891fb697c"}
Sep 16 14:40:20.287547 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:20.287510    2569 generic.go:356] "Generic (PLEG): container finished" podID="8efcc07f-492c-4792-8044-6b8e515aa0b4" containerID="f0eeab8318c47ddc66294988d2c19d5dd9cdcbeac953ddc83db5a10c0ab9dde4" exitCode=0
Sep 16 14:40:20.287992 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:20.287557    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp" event={"ID":"8efcc07f-492c-4792-8044-6b8e515aa0b4","Type":"ContainerDied","Data":"f0eeab8318c47ddc66294988d2c19d5dd9cdcbeac953ddc83db5a10c0ab9dde4"}
Sep 16 14:40:21.411203 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:21.411180    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:21.483144 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:21.483117    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws8vr\" (UniqueName: \"kubernetes.io/projected/8efcc07f-492c-4792-8044-6b8e515aa0b4-kube-api-access-ws8vr\") pod \"8efcc07f-492c-4792-8044-6b8e515aa0b4\" (UID: \"8efcc07f-492c-4792-8044-6b8e515aa0b4\") "
Sep 16 14:40:21.483291 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:21.483151    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8efcc07f-492c-4792-8044-6b8e515aa0b4-bundle\") pod \"8efcc07f-492c-4792-8044-6b8e515aa0b4\" (UID: \"8efcc07f-492c-4792-8044-6b8e515aa0b4\") "
Sep 16 14:40:21.483291 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:21.483198    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8efcc07f-492c-4792-8044-6b8e515aa0b4-util\") pod \"8efcc07f-492c-4792-8044-6b8e515aa0b4\" (UID: \"8efcc07f-492c-4792-8044-6b8e515aa0b4\") "
Sep 16 14:40:21.483903 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:21.483873    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8efcc07f-492c-4792-8044-6b8e515aa0b4-bundle" (OuterVolumeSpecName: "bundle") pod "8efcc07f-492c-4792-8044-6b8e515aa0b4" (UID: "8efcc07f-492c-4792-8044-6b8e515aa0b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:21.485190 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:21.485163    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8efcc07f-492c-4792-8044-6b8e515aa0b4-kube-api-access-ws8vr" (OuterVolumeSpecName: "kube-api-access-ws8vr") pod "8efcc07f-492c-4792-8044-6b8e515aa0b4" (UID: "8efcc07f-492c-4792-8044-6b8e515aa0b4"). InnerVolumeSpecName "kube-api-access-ws8vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:40:21.488302 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:21.488278    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8efcc07f-492c-4792-8044-6b8e515aa0b4-util" (OuterVolumeSpecName: "util") pod "8efcc07f-492c-4792-8044-6b8e515aa0b4" (UID: "8efcc07f-492c-4792-8044-6b8e515aa0b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:21.584692 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:21.584610    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8efcc07f-492c-4792-8044-6b8e515aa0b4-util\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:40:21.584692 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:21.584637    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws8vr\" (UniqueName: \"kubernetes.io/projected/8efcc07f-492c-4792-8044-6b8e515aa0b4-kube-api-access-ws8vr\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:40:21.584692 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:21.584652    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8efcc07f-492c-4792-8044-6b8e515aa0b4-bundle\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:40:22.297016 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:22.296988    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp" event={"ID":"8efcc07f-492c-4792-8044-6b8e515aa0b4","Type":"ContainerDied","Data":"de01287ff9806d62c91e5a63227832a1908be6d1fca832596925bbf91deb37f9"}
Sep 16 14:40:22.297176 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:22.297028    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de01287ff9806d62c91e5a63227832a1908be6d1fca832596925bbf91deb37f9"
Sep 16 14:40:22.297176 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:22.297050    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754029zmp"
Sep 16 14:40:26.006198 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:26.006164    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 14:40:26.010019 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:26.009997    2569 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 14:40:26.011352 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:26.011332    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 14:40:27.270620 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.270587    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5"]
Sep 16 14:40:27.271810 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.270874    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8efcc07f-492c-4792-8044-6b8e515aa0b4" containerName="util"
Sep 16 14:40:27.271810 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.270890    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8efcc07f-492c-4792-8044-6b8e515aa0b4" containerName="util"
Sep 16 14:40:27.271810 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.270903    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8efcc07f-492c-4792-8044-6b8e515aa0b4" containerName="extract"
Sep 16 14:40:27.271810 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.270908    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8efcc07f-492c-4792-8044-6b8e515aa0b4" containerName="extract"
Sep 16 14:40:27.271810 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.270920    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8efcc07f-492c-4792-8044-6b8e515aa0b4" containerName="pull"
Sep 16 14:40:27.271810 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.270925    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8efcc07f-492c-4792-8044-6b8e515aa0b4" containerName="pull"
Sep 16 14:40:27.271810 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.270976    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8efcc07f-492c-4792-8044-6b8e515aa0b4" containerName="extract"
Sep 16 14:40:27.272624 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.272609    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5"
Sep 16 14:40:27.277383 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.277349    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pflwz\""
Sep 16 14:40:27.281520 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.278036    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:40:27.281520 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.278079    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 16 14:40:27.290889 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.290860    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5"]
Sep 16 14:40:27.323801 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.323767    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px4bg\" (UniqueName: \"kubernetes.io/projected/d653a1aa-9269-4063-9041-796c958199d8-kube-api-access-px4bg\") pod \"cert-manager-operator-controller-manager-55c444bf86-zdlk5\" (UID: \"d653a1aa-9269-4063-9041-796c958199d8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5"
Sep 16 14:40:27.323953 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.323808    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d653a1aa-9269-4063-9041-796c958199d8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zdlk5\" (UID: \"d653a1aa-9269-4063-9041-796c958199d8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5"
Sep 16 14:40:27.425010 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.424971    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d653a1aa-9269-4063-9041-796c958199d8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zdlk5\" (UID: \"d653a1aa-9269-4063-9041-796c958199d8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5"
Sep 16 14:40:27.425170 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.425041    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px4bg\" (UniqueName: \"kubernetes.io/projected/d653a1aa-9269-4063-9041-796c958199d8-kube-api-access-px4bg\") pod \"cert-manager-operator-controller-manager-55c444bf86-zdlk5\" (UID: \"d653a1aa-9269-4063-9041-796c958199d8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5"
Sep 16 14:40:27.425396 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.425372    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d653a1aa-9269-4063-9041-796c958199d8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zdlk5\" (UID: \"d653a1aa-9269-4063-9041-796c958199d8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5"
Sep 16 14:40:27.441757 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.441729    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px4bg\" (UniqueName: \"kubernetes.io/projected/d653a1aa-9269-4063-9041-796c958199d8-kube-api-access-px4bg\") pod \"cert-manager-operator-controller-manager-55c444bf86-zdlk5\" (UID: \"d653a1aa-9269-4063-9041-796c958199d8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5"
Sep 16 14:40:27.583133 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.583033    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5"
Sep 16 14:40:27.870233 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.870205    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5"]
Sep 16 14:40:27.873134 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:40:27.873101    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd653a1aa_9269_4063_9041_796c958199d8.slice/crio-1d341277e74aff4489ed5eda3c248b7d4c96d67400bf272540ed6427f55d59cd WatchSource:0}: Error finding container 1d341277e74aff4489ed5eda3c248b7d4c96d67400bf272540ed6427f55d59cd: Status 404 returned error can't find the container with id 1d341277e74aff4489ed5eda3c248b7d4c96d67400bf272540ed6427f55d59cd
Sep 16 14:40:27.875711 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:27.875695    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:40:28.320830 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:28.320800    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5" event={"ID":"d653a1aa-9269-4063-9041-796c958199d8","Type":"ContainerStarted","Data":"1d341277e74aff4489ed5eda3c248b7d4c96d67400bf272540ed6427f55d59cd"}
Sep 16 14:40:30.330513 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:30.330467    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5" event={"ID":"d653a1aa-9269-4063-9041-796c958199d8","Type":"ContainerStarted","Data":"9bc991f784b2d3d0a60497148b6ead5f0cf0edafb2293a1c2bbf566d1d3d5649"}
Sep 16 14:40:31.409105 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.409050    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zdlk5" podStartSLOduration=2.905837903 podStartE2EDuration="4.409031506s" totalImagesPullingTime="1.503193603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:40:30.433897736 +0000 UTC m=+304.785179444" watchObservedRunningTime="2026-09-16 14:40:31.409031506 +0000 UTC m=+305.760313216"
Sep 16 14:40:31.409473 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.409364    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"]
Sep 16 14:40:31.411709 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.411692    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:31.414467 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.414444    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jsmkt\""
Sep 16 14:40:31.414721 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.414705    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 14:40:31.415148 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.415133    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 14:40:31.451882 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.451850    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"]
Sep 16 14:40:31.457896 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.457865    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q59gx\" (UniqueName: \"kubernetes.io/projected/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-kube-api-access-q59gx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf\" (UID: \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:31.458043 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.457909    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf\" (UID: \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:31.458043 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.457958    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf\" (UID: \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:31.558839 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.558794    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q59gx\" (UniqueName: \"kubernetes.io/projected/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-kube-api-access-q59gx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf\" (UID: \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:31.559006 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.558861    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf\" (UID: \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:31.559006 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.558909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf\" (UID: \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:31.559352 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.559331    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf\" (UID: \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:31.559390 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.559336    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf\" (UID: \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:31.579805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.579780    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q59gx\" (UniqueName: \"kubernetes.io/projected/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-kube-api-access-q59gx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf\" (UID: \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:31.720966 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.720880    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:31.998628 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:31.998595    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"]
Sep 16 14:40:32.001426 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:40:32.001396    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e5ab59_ca20_4619_9bd3_8ad51f9f2ed6.slice/crio-d34938c928b53300993e925096ba8fb35ba2065393c6f871f11f63c27b561040 WatchSource:0}: Error finding container d34938c928b53300993e925096ba8fb35ba2065393c6f871f11f63c27b561040: Status 404 returned error can't find the container with id d34938c928b53300993e925096ba8fb35ba2065393c6f871f11f63c27b561040
Sep 16 14:40:32.343566 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:32.343469    2569 generic.go:356] "Generic (PLEG): container finished" podID="37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" containerID="fb854c5fa3c0d147e43c6efc09d218802a799e364a9192e29ab969ad5614b844" exitCode=0
Sep 16 14:40:32.343710 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:32.343560    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf" event={"ID":"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6","Type":"ContainerDied","Data":"fb854c5fa3c0d147e43c6efc09d218802a799e364a9192e29ab969ad5614b844"}
Sep 16 14:40:32.343710 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:32.343613    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf" event={"ID":"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6","Type":"ContainerStarted","Data":"d34938c928b53300993e925096ba8fb35ba2065393c6f871f11f63c27b561040"}
Sep 16 14:40:34.354553 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:34.354461    2569 generic.go:356] "Generic (PLEG): container finished" podID="37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" containerID="73a84ebf700a7e9bd23cd4f9548ac99a3345bfaed61b7dda87e6c0a0bed64f1a" exitCode=0
Sep 16 14:40:34.354553 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:34.354522    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf" event={"ID":"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6","Type":"ContainerDied","Data":"73a84ebf700a7e9bd23cd4f9548ac99a3345bfaed61b7dda87e6c0a0bed64f1a"}
Sep 16 14:40:35.361597 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:35.361558    2569 generic.go:356] "Generic (PLEG): container finished" podID="37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" containerID="bb94649f606d399e38fe32dbe412fd7da1e94478e9394daa52092d3f3a41dc83" exitCode=0
Sep 16 14:40:35.361982 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:35.361635    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf" event={"ID":"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6","Type":"ContainerDied","Data":"bb94649f606d399e38fe32dbe412fd7da1e94478e9394daa52092d3f3a41dc83"}
Sep 16 14:40:36.496556 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:36.496534    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:36.595546 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:36.595484    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-util\") pod \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\" (UID: \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\") "
Sep 16 14:40:36.595711 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:36.595556    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q59gx\" (UniqueName: \"kubernetes.io/projected/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-kube-api-access-q59gx\") pod \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\" (UID: \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\") "
Sep 16 14:40:36.595711 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:36.595617    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-bundle\") pod \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\" (UID: \"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6\") "
Sep 16 14:40:36.596004 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:36.595966    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-bundle" (OuterVolumeSpecName: "bundle") pod "37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" (UID: "37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:36.597553 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:36.597523    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-kube-api-access-q59gx" (OuterVolumeSpecName: "kube-api-access-q59gx") pod "37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" (UID: "37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6"). InnerVolumeSpecName "kube-api-access-q59gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:40:36.603984 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:36.603943    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-util" (OuterVolumeSpecName: "util") pod "37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" (UID: "37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:36.697145 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:36.697057    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-bundle\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:40:36.697145 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:36.697091    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-util\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:40:36.697145 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:36.697104    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q59gx\" (UniqueName: \"kubernetes.io/projected/37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6-kube-api-access-q59gx\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:40:37.371618 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:37.371589    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf"
Sep 16 14:40:37.371907 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:37.371584    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54slf" event={"ID":"37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6","Type":"ContainerDied","Data":"d34938c928b53300993e925096ba8fb35ba2065393c6f871f11f63c27b561040"}
Sep 16 14:40:37.371907 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:37.371714    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d34938c928b53300993e925096ba8fb35ba2065393c6f871f11f63c27b561040"
Sep 16 14:40:38.751746 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.751711    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xn9w8"]
Sep 16 14:40:38.752125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.752024    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" containerName="util"
Sep 16 14:40:38.752125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.752035    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" containerName="util"
Sep 16 14:40:38.752125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.752048    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" containerName="pull"
Sep 16 14:40:38.752125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.752054    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" containerName="pull"
Sep 16 14:40:38.752125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.752061    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" containerName="extract"
Sep 16 14:40:38.752125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.752066    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" containerName="extract"
Sep 16 14:40:38.752125 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.752107    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e5ab59-ca20-4619-9bd3-8ad51f9f2ed6" containerName="extract"
Sep 16 14:40:38.755114 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.755090    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8"
Sep 16 14:40:38.757674 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.757645    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5b5bc\""
Sep 16 14:40:38.757801 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.757689    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 16 14:40:38.758260 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.758245    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 16 14:40:38.763427 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.763405    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xn9w8"]
Sep 16 14:40:38.814504 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.814462    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2982f44e-157e-4ba7-940d-5509be1b3940-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xn9w8\" (UID: \"2982f44e-157e-4ba7-940d-5509be1b3940\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8"
Sep 16 14:40:38.814680 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.814595    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwtsl\" (UniqueName: \"kubernetes.io/projected/2982f44e-157e-4ba7-940d-5509be1b3940-kube-api-access-wwtsl\") pod \"cert-manager-webhook-6486ffd997-xn9w8\" (UID: \"2982f44e-157e-4ba7-940d-5509be1b3940\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8"
Sep 16 14:40:38.915120 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.915083    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwtsl\" (UniqueName: \"kubernetes.io/projected/2982f44e-157e-4ba7-940d-5509be1b3940-kube-api-access-wwtsl\") pod \"cert-manager-webhook-6486ffd997-xn9w8\" (UID: \"2982f44e-157e-4ba7-940d-5509be1b3940\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8"
Sep 16 14:40:38.915277 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.915144    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2982f44e-157e-4ba7-940d-5509be1b3940-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xn9w8\" (UID: \"2982f44e-157e-4ba7-940d-5509be1b3940\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8"
Sep 16 14:40:38.923073 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.923040    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2982f44e-157e-4ba7-940d-5509be1b3940-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xn9w8\" (UID: \"2982f44e-157e-4ba7-940d-5509be1b3940\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8"
Sep 16 14:40:38.923189 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:38.923111    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwtsl\" (UniqueName: \"kubernetes.io/projected/2982f44e-157e-4ba7-940d-5509be1b3940-kube-api-access-wwtsl\") pod \"cert-manager-webhook-6486ffd997-xn9w8\" (UID: \"2982f44e-157e-4ba7-940d-5509be1b3940\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8"
Sep 16 14:40:39.074710 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:39.074617    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8"
Sep 16 14:40:39.347060 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:39.346982    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xn9w8"]
Sep 16 14:40:39.349821 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:40:39.349794    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2982f44e_157e_4ba7_940d_5509be1b3940.slice/crio-8565f426b7b082a84f6a5aab5895f65401e96b96811eeeff064b3772c3039672 WatchSource:0}: Error finding container 8565f426b7b082a84f6a5aab5895f65401e96b96811eeeff064b3772c3039672: Status 404 returned error can't find the container with id 8565f426b7b082a84f6a5aab5895f65401e96b96811eeeff064b3772c3039672
Sep 16 14:40:39.382106 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:39.382070    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8" event={"ID":"2982f44e-157e-4ba7-940d-5509be1b3940","Type":"ContainerStarted","Data":"8565f426b7b082a84f6a5aab5895f65401e96b96811eeeff064b3772c3039672"}
Sep 16 14:40:41.591032 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:41.590995    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zgmmh"]
Sep 16 14:40:41.596783 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:41.596750    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zgmmh"
Sep 16 14:40:41.598955 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:41.598927    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-schnz\""
Sep 16 14:40:41.606457 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:41.606432    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zgmmh"]
Sep 16 14:40:41.635444 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:41.635404    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7e59062-2bca-4b41-bd9b-7b6c5f858a2a-bound-sa-token\") pod \"cert-manager-55b4d954d5-zgmmh\" (UID: \"e7e59062-2bca-4b41-bd9b-7b6c5f858a2a\") " pod="cert-manager/cert-manager-55b4d954d5-zgmmh"
Sep 16 14:40:41.635646 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:41.635472    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j22gn\" (UniqueName: \"kubernetes.io/projected/e7e59062-2bca-4b41-bd9b-7b6c5f858a2a-kube-api-access-j22gn\") pod \"cert-manager-55b4d954d5-zgmmh\" (UID: \"e7e59062-2bca-4b41-bd9b-7b6c5f858a2a\") " pod="cert-manager/cert-manager-55b4d954d5-zgmmh"
Sep 16 14:40:41.736357 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:41.736332    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7e59062-2bca-4b41-bd9b-7b6c5f858a2a-bound-sa-token\") pod \"cert-manager-55b4d954d5-zgmmh\" (UID: \"e7e59062-2bca-4b41-bd9b-7b6c5f858a2a\") " pod="cert-manager/cert-manager-55b4d954d5-zgmmh"
Sep 16 14:40:41.736458 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:41.736380    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j22gn\" (UniqueName: \"kubernetes.io/projected/e7e59062-2bca-4b41-bd9b-7b6c5f858a2a-kube-api-access-j22gn\") pod \"cert-manager-55b4d954d5-zgmmh\" (UID: \"e7e59062-2bca-4b41-bd9b-7b6c5f858a2a\") " pod="cert-manager/cert-manager-55b4d954d5-zgmmh"
Sep 16 14:40:41.744580 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:41.744549    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7e59062-2bca-4b41-bd9b-7b6c5f858a2a-bound-sa-token\") pod \"cert-manager-55b4d954d5-zgmmh\" (UID: \"e7e59062-2bca-4b41-bd9b-7b6c5f858a2a\") " pod="cert-manager/cert-manager-55b4d954d5-zgmmh"
Sep 16 14:40:41.744713 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:41.744671    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j22gn\" (UniqueName: \"kubernetes.io/projected/e7e59062-2bca-4b41-bd9b-7b6c5f858a2a-kube-api-access-j22gn\") pod \"cert-manager-55b4d954d5-zgmmh\" (UID: \"e7e59062-2bca-4b41-bd9b-7b6c5f858a2a\") " pod="cert-manager/cert-manager-55b4d954d5-zgmmh"
Sep 16 14:40:41.910165 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:41.910073    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zgmmh"
Sep 16 14:40:42.196671 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:42.196465    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zgmmh"]
Sep 16 14:40:42.199096 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:40:42.199071    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7e59062_2bca_4b41_bd9b_7b6c5f858a2a.slice/crio-d94ca9b4c20294f4946589b04c2548bddeeeddc4960ac52e5b83ab4c69c372aa WatchSource:0}: Error finding container d94ca9b4c20294f4946589b04c2548bddeeeddc4960ac52e5b83ab4c69c372aa: Status 404 returned error can't find the container with id d94ca9b4c20294f4946589b04c2548bddeeeddc4960ac52e5b83ab4c69c372aa
Sep 16 14:40:42.397025 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:42.396986    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zgmmh" event={"ID":"e7e59062-2bca-4b41-bd9b-7b6c5f858a2a","Type":"ContainerStarted","Data":"113db1ed3db01c793593b5aa8f8fa70a7a3b8c925e101e36f2cc11fb2a0fbec0"}
Sep 16 14:40:42.397228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:42.397037    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zgmmh" event={"ID":"e7e59062-2bca-4b41-bd9b-7b6c5f858a2a","Type":"ContainerStarted","Data":"d94ca9b4c20294f4946589b04c2548bddeeeddc4960ac52e5b83ab4c69c372aa"}
Sep 16 14:40:42.398465 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:42.398437    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8" event={"ID":"2982f44e-157e-4ba7-940d-5509be1b3940","Type":"ContainerStarted","Data":"ff246a75c8d14b832ccd9e9ead99a07809694ebac603fba744550c2fc879e183"}
Sep 16 14:40:42.398595 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:42.398548    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8"
Sep 16 14:40:42.411287 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:42.411236    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-zgmmh" podStartSLOduration=1.411222299 podStartE2EDuration="1.411222299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:40:42.410456343 +0000 UTC m=+316.761738053" watchObservedRunningTime="2026-09-16 14:40:42.411222299 +0000 UTC m=+316.762504008"
Sep 16 14:40:42.426576 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:42.426522    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8" podStartSLOduration=2.056726499 podStartE2EDuration="4.426473474s" totalImagesPullingTime="2.369746975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:40:42.424743089 +0000 UTC m=+316.776024799" watchObservedRunningTime="2026-09-16 14:40:42.426473474 +0000 UTC m=+316.777755185"
Sep 16 14:40:46.940546 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:46.940509    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"]
Sep 16 14:40:46.948705 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:46.948674    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:46.951043 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:46.951012    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 14:40:46.951304 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:46.951246    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 14:40:46.951870 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:46.951848    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jsmkt\""
Sep 16 14:40:46.952015 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:46.951953    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"]
Sep 16 14:40:46.975963 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:46.975932    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd17815f-ce22-4900-8028-6ad9da761aa1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj\" (UID: \"cd17815f-ce22-4900-8028-6ad9da761aa1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:46.976083 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:46.975974    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7qkx\" (UniqueName: \"kubernetes.io/projected/cd17815f-ce22-4900-8028-6ad9da761aa1-kube-api-access-m7qkx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj\" (UID: \"cd17815f-ce22-4900-8028-6ad9da761aa1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:46.976083 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:46.975994    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd17815f-ce22-4900-8028-6ad9da761aa1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj\" (UID: \"cd17815f-ce22-4900-8028-6ad9da761aa1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:47.076443 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:47.076408    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7qkx\" (UniqueName: \"kubernetes.io/projected/cd17815f-ce22-4900-8028-6ad9da761aa1-kube-api-access-m7qkx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj\" (UID: \"cd17815f-ce22-4900-8028-6ad9da761aa1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:47.076443 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:47.076442    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd17815f-ce22-4900-8028-6ad9da761aa1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj\" (UID: \"cd17815f-ce22-4900-8028-6ad9da761aa1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:47.076682 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:47.076525    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd17815f-ce22-4900-8028-6ad9da761aa1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj\" (UID: \"cd17815f-ce22-4900-8028-6ad9da761aa1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:47.076924 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:47.076902    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd17815f-ce22-4900-8028-6ad9da761aa1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj\" (UID: \"cd17815f-ce22-4900-8028-6ad9da761aa1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:47.076973 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:47.076925    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd17815f-ce22-4900-8028-6ad9da761aa1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj\" (UID: \"cd17815f-ce22-4900-8028-6ad9da761aa1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:47.084145 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:47.084129    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7qkx\" (UniqueName: \"kubernetes.io/projected/cd17815f-ce22-4900-8028-6ad9da761aa1-kube-api-access-m7qkx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj\" (UID: \"cd17815f-ce22-4900-8028-6ad9da761aa1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:47.259458 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:47.259431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:47.531323 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:47.531298    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"]
Sep 16 14:40:47.533468 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:40:47.533439    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd17815f_ce22_4900_8028_6ad9da761aa1.slice/crio-2c253a5ce029f2e3346335a45526201cafc14938363374f870fb8f454cafdb98 WatchSource:0}: Error finding container 2c253a5ce029f2e3346335a45526201cafc14938363374f870fb8f454cafdb98: Status 404 returned error can't find the container with id 2c253a5ce029f2e3346335a45526201cafc14938363374f870fb8f454cafdb98
Sep 16 14:40:48.405133 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:48.405053    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xn9w8"
Sep 16 14:40:48.424137 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:48.424109    2569 generic.go:356] "Generic (PLEG): container finished" podID="cd17815f-ce22-4900-8028-6ad9da761aa1" containerID="163e83cbab67fb370ac266e5932594e8e71ae8837eda27200c07778fab389384" exitCode=0
Sep 16 14:40:48.424301 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:48.424143    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj" event={"ID":"cd17815f-ce22-4900-8028-6ad9da761aa1","Type":"ContainerDied","Data":"163e83cbab67fb370ac266e5932594e8e71ae8837eda27200c07778fab389384"}
Sep 16 14:40:48.424301 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:48.424174    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj" event={"ID":"cd17815f-ce22-4900-8028-6ad9da761aa1","Type":"ContainerStarted","Data":"2c253a5ce029f2e3346335a45526201cafc14938363374f870fb8f454cafdb98"}
Sep 16 14:40:49.430419 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:49.430328    2569 generic.go:356] "Generic (PLEG): container finished" podID="cd17815f-ce22-4900-8028-6ad9da761aa1" containerID="ff22465c50afc9cad1474a08c3cf48d5b704a18018e4dc46a5b5361a423cea2d" exitCode=0
Sep 16 14:40:49.430789 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:49.430420    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj" event={"ID":"cd17815f-ce22-4900-8028-6ad9da761aa1","Type":"ContainerDied","Data":"ff22465c50afc9cad1474a08c3cf48d5b704a18018e4dc46a5b5361a423cea2d"}
Sep 16 14:40:50.436708 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:50.436675    2569 generic.go:356] "Generic (PLEG): container finished" podID="cd17815f-ce22-4900-8028-6ad9da761aa1" containerID="a2067781f2a7bc8cb2726cd83ce106f7dc1847d541d4c20421d4efae0806d35f" exitCode=0
Sep 16 14:40:50.437084 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:50.436728    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj" event={"ID":"cd17815f-ce22-4900-8028-6ad9da761aa1","Type":"ContainerDied","Data":"a2067781f2a7bc8cb2726cd83ce106f7dc1847d541d4c20421d4efae0806d35f"}
Sep 16 14:40:51.563907 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:51.563883    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:51.611982 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:51.611957    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd17815f-ce22-4900-8028-6ad9da761aa1-util\") pod \"cd17815f-ce22-4900-8028-6ad9da761aa1\" (UID: \"cd17815f-ce22-4900-8028-6ad9da761aa1\") "
Sep 16 14:40:51.612098 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:51.611994    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7qkx\" (UniqueName: \"kubernetes.io/projected/cd17815f-ce22-4900-8028-6ad9da761aa1-kube-api-access-m7qkx\") pod \"cd17815f-ce22-4900-8028-6ad9da761aa1\" (UID: \"cd17815f-ce22-4900-8028-6ad9da761aa1\") "
Sep 16 14:40:51.612098 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:51.612032    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd17815f-ce22-4900-8028-6ad9da761aa1-bundle\") pod \"cd17815f-ce22-4900-8028-6ad9da761aa1\" (UID: \"cd17815f-ce22-4900-8028-6ad9da761aa1\") "
Sep 16 14:40:51.612901 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:51.612867    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd17815f-ce22-4900-8028-6ad9da761aa1-bundle" (OuterVolumeSpecName: "bundle") pod "cd17815f-ce22-4900-8028-6ad9da761aa1" (UID: "cd17815f-ce22-4900-8028-6ad9da761aa1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:51.613861 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:51.613841    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd17815f-ce22-4900-8028-6ad9da761aa1-kube-api-access-m7qkx" (OuterVolumeSpecName: "kube-api-access-m7qkx") pod "cd17815f-ce22-4900-8028-6ad9da761aa1" (UID: "cd17815f-ce22-4900-8028-6ad9da761aa1"). InnerVolumeSpecName "kube-api-access-m7qkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:40:51.617449 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:51.617430    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd17815f-ce22-4900-8028-6ad9da761aa1-util" (OuterVolumeSpecName: "util") pod "cd17815f-ce22-4900-8028-6ad9da761aa1" (UID: "cd17815f-ce22-4900-8028-6ad9da761aa1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:40:51.713089 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:51.713010    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd17815f-ce22-4900-8028-6ad9da761aa1-util\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:40:51.713089 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:51.713060    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7qkx\" (UniqueName: \"kubernetes.io/projected/cd17815f-ce22-4900-8028-6ad9da761aa1-kube-api-access-m7qkx\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:40:51.713089 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:51.713071    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd17815f-ce22-4900-8028-6ad9da761aa1-bundle\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:40:52.447677 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:52.447598    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj"
Sep 16 14:40:52.447677 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:52.447624    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll7jj" event={"ID":"cd17815f-ce22-4900-8028-6ad9da761aa1","Type":"ContainerDied","Data":"2c253a5ce029f2e3346335a45526201cafc14938363374f870fb8f454cafdb98"}
Sep 16 14:40:52.447838 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:40:52.447680    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c253a5ce029f2e3346335a45526201cafc14938363374f870fb8f454cafdb98"
Sep 16 14:41:01.185376 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.185335    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"]
Sep 16 14:41:01.185838 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.185768    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd17815f-ce22-4900-8028-6ad9da761aa1" containerName="util"
Sep 16 14:41:01.185838 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.185793    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd17815f-ce22-4900-8028-6ad9da761aa1" containerName="util"
Sep 16 14:41:01.185838 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.185803    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd17815f-ce22-4900-8028-6ad9da761aa1" containerName="extract"
Sep 16 14:41:01.185838 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.185809    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd17815f-ce22-4900-8028-6ad9da761aa1" containerName="extract"
Sep 16 14:41:01.185838 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.185817    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd17815f-ce22-4900-8028-6ad9da761aa1" containerName="pull"
Sep 16 14:41:01.185838 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.185823    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd17815f-ce22-4900-8028-6ad9da761aa1" containerName="pull"
Sep 16 14:41:01.186017 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.185879    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd17815f-ce22-4900-8028-6ad9da761aa1" containerName="extract"
Sep 16 14:41:01.188557 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.188540    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:01.190973 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.190937    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jsmkt\""
Sep 16 14:41:01.191297 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.191268    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 14:41:01.191914 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.191868    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 14:41:01.193852 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.193830    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"]
Sep 16 14:41:01.286890 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.286856    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5\" (UID: \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:01.287047 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.286937    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5\" (UID: \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:01.287047 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.286967    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55v7c\" (UniqueName: \"kubernetes.io/projected/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-kube-api-access-55v7c\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5\" (UID: \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:01.387741 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.387698    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5\" (UID: \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:01.387741 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.387740    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55v7c\" (UniqueName: \"kubernetes.io/projected/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-kube-api-access-55v7c\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5\" (UID: \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:01.387929 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.387864    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5\" (UID: \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:01.388076 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.388057    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5\" (UID: \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:01.388121 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.388082    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5\" (UID: \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:01.401723 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.401699    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55v7c\" (UniqueName: \"kubernetes.io/projected/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-kube-api-access-55v7c\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5\" (UID: \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:01.498999 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.498972    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:01.782044 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:01.782020    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"]
Sep 16 14:41:01.783950 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:41:01.783922    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f79b5dc_6098_45c8_95cf_25b7a80aebcc.slice/crio-3b03ff5ee1d7abc0c30a081ed32b30a5cfa9b35eca6b30931d08efb580c444d6 WatchSource:0}: Error finding container 3b03ff5ee1d7abc0c30a081ed32b30a5cfa9b35eca6b30931d08efb580c444d6: Status 404 returned error can't find the container with id 3b03ff5ee1d7abc0c30a081ed32b30a5cfa9b35eca6b30931d08efb580c444d6
Sep 16 14:41:02.163893 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.163816    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"]
Sep 16 14:41:02.166031 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.166009    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.169248 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.169222    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 16 14:41:02.169383 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.169274    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 16 14:41:02.169383 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.169278    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 14:41:02.169596 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.169579    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 16 14:41:02.169646 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.169584    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ql22x\""
Sep 16 14:41:02.169822 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.169808    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:41:02.177877 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.177852    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"]
Sep 16 14:41:02.293853 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.293822    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c60742e3-4908-43d6-93b6-a1c7c226215b-manager-config\") pod \"lws-controller-manager-8787d76cb-nl82k\" (UID: \"c60742e3-4908-43d6-93b6-a1c7c226215b\") " pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.294255 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.293899    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8dj5\" (UniqueName: \"kubernetes.io/projected/c60742e3-4908-43d6-93b6-a1c7c226215b-kube-api-access-l8dj5\") pod \"lws-controller-manager-8787d76cb-nl82k\" (UID: \"c60742e3-4908-43d6-93b6-a1c7c226215b\") " pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.294255 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.293939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c60742e3-4908-43d6-93b6-a1c7c226215b-metrics-cert\") pod \"lws-controller-manager-8787d76cb-nl82k\" (UID: \"c60742e3-4908-43d6-93b6-a1c7c226215b\") " pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.294255 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.294030    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c60742e3-4908-43d6-93b6-a1c7c226215b-cert\") pod \"lws-controller-manager-8787d76cb-nl82k\" (UID: \"c60742e3-4908-43d6-93b6-a1c7c226215b\") " pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.395353 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.395313    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c60742e3-4908-43d6-93b6-a1c7c226215b-cert\") pod \"lws-controller-manager-8787d76cb-nl82k\" (UID: \"c60742e3-4908-43d6-93b6-a1c7c226215b\") " pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.395529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.395392    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c60742e3-4908-43d6-93b6-a1c7c226215b-manager-config\") pod \"lws-controller-manager-8787d76cb-nl82k\" (UID: \"c60742e3-4908-43d6-93b6-a1c7c226215b\") " pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.395529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.395429    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8dj5\" (UniqueName: \"kubernetes.io/projected/c60742e3-4908-43d6-93b6-a1c7c226215b-kube-api-access-l8dj5\") pod \"lws-controller-manager-8787d76cb-nl82k\" (UID: \"c60742e3-4908-43d6-93b6-a1c7c226215b\") " pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.395529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.395463    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c60742e3-4908-43d6-93b6-a1c7c226215b-metrics-cert\") pod \"lws-controller-manager-8787d76cb-nl82k\" (UID: \"c60742e3-4908-43d6-93b6-a1c7c226215b\") " pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.396226 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.396196    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c60742e3-4908-43d6-93b6-a1c7c226215b-manager-config\") pod \"lws-controller-manager-8787d76cb-nl82k\" (UID: \"c60742e3-4908-43d6-93b6-a1c7c226215b\") " pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.397955 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.397933    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c60742e3-4908-43d6-93b6-a1c7c226215b-metrics-cert\") pod \"lws-controller-manager-8787d76cb-nl82k\" (UID: \"c60742e3-4908-43d6-93b6-a1c7c226215b\") " pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.398046 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.397990    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c60742e3-4908-43d6-93b6-a1c7c226215b-cert\") pod \"lws-controller-manager-8787d76cb-nl82k\" (UID: \"c60742e3-4908-43d6-93b6-a1c7c226215b\") " pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.408588 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.408560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8dj5\" (UniqueName: \"kubernetes.io/projected/c60742e3-4908-43d6-93b6-a1c7c226215b-kube-api-access-l8dj5\") pod \"lws-controller-manager-8787d76cb-nl82k\" (UID: \"c60742e3-4908-43d6-93b6-a1c7c226215b\") " pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.474974 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.474882    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:02.498003 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.497968    2569 generic.go:356] "Generic (PLEG): container finished" podID="7f79b5dc-6098-45c8-95cf-25b7a80aebcc" containerID="5abd5037956130d1125f0ec3a430ca61a466968bed7b910ba0afd901d93d4856" exitCode=0
Sep 16 14:41:02.498137 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.498015    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5" event={"ID":"7f79b5dc-6098-45c8-95cf-25b7a80aebcc","Type":"ContainerDied","Data":"5abd5037956130d1125f0ec3a430ca61a466968bed7b910ba0afd901d93d4856"}
Sep 16 14:41:02.498137 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.498106    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5" event={"ID":"7f79b5dc-6098-45c8-95cf-25b7a80aebcc","Type":"ContainerStarted","Data":"3b03ff5ee1d7abc0c30a081ed32b30a5cfa9b35eca6b30931d08efb580c444d6"}
Sep 16 14:41:02.769730 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.769696    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"]
Sep 16 14:41:02.773022 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:41:02.772996    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60742e3_4908_43d6_93b6_a1c7c226215b.slice/crio-aa3fb47906f245efa5f30e50e4b0f113bd7d7c8a5d52b49b89a64e1addde82b0 WatchSource:0}: Error finding container aa3fb47906f245efa5f30e50e4b0f113bd7d7c8a5d52b49b89a64e1addde82b0: Status 404 returned error can't find the container with id aa3fb47906f245efa5f30e50e4b0f113bd7d7c8a5d52b49b89a64e1addde82b0
Sep 16 14:41:02.882583 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.882532    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"]
Sep 16 14:41:02.885888 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.885859    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:02.902029 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.901997    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 14:41:02.902029 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.902019    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 14:41:02.902259 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.902051    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 14:41:02.902259 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.902153    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 14:41:02.902626 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.902611    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2nhn5\""
Sep 16 14:41:02.934008 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:02.933976    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"]
Sep 16 14:41:03.001146 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.001109    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/571b5765-d419-4fd2-a609-8017f2bca42d-manifests\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.001146 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.001149    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/571b5765-d419-4fd2-a609-8017f2bca42d-webhook-cert\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.001352 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.001210    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp7gs\" (UniqueName: \"kubernetes.io/projected/571b5765-d419-4fd2-a609-8017f2bca42d-kube-api-access-hp7gs\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.001352 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.001265    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/571b5765-d419-4fd2-a609-8017f2bca42d-tmp\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.001352 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.001283    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/571b5765-d419-4fd2-a609-8017f2bca42d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.102546 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.102422    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/571b5765-d419-4fd2-a609-8017f2bca42d-manifests\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.102546 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.102478    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/571b5765-d419-4fd2-a609-8017f2bca42d-webhook-cert\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.102795 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.102567    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp7gs\" (UniqueName: \"kubernetes.io/projected/571b5765-d419-4fd2-a609-8017f2bca42d-kube-api-access-hp7gs\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.102795 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.102656    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/571b5765-d419-4fd2-a609-8017f2bca42d-tmp\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.102795 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.102683    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/571b5765-d419-4fd2-a609-8017f2bca42d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.102946 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.102888    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/571b5765-d419-4fd2-a609-8017f2bca42d-manifests\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.105007 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.104976    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/571b5765-d419-4fd2-a609-8017f2bca42d-tmp\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.105227 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.105209    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/571b5765-d419-4fd2-a609-8017f2bca42d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.105311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.105296    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/571b5765-d419-4fd2-a609-8017f2bca42d-webhook-cert\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.124157 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.124124    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp7gs\" (UniqueName: \"kubernetes.io/projected/571b5765-d419-4fd2-a609-8017f2bca42d-kube-api-access-hp7gs\") pod \"opendatahub-operator-controller-manager-846667779d-7crp2\" (UID: \"571b5765-d419-4fd2-a609-8017f2bca42d\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.196726 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.196692    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:03.497930 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.497901    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"]
Sep 16 14:41:03.500731 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:41:03.500697    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571b5765_d419_4fd2_a609_8017f2bca42d.slice/crio-06c31088dad2a13dd2a1c38b34ef1a862df2bffd625190c46a876135e2e72dbd WatchSource:0}: Error finding container 06c31088dad2a13dd2a1c38b34ef1a862df2bffd625190c46a876135e2e72dbd: Status 404 returned error can't find the container with id 06c31088dad2a13dd2a1c38b34ef1a862df2bffd625190c46a876135e2e72dbd
Sep 16 14:41:03.506669 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.506604    2569 generic.go:356] "Generic (PLEG): container finished" podID="7f79b5dc-6098-45c8-95cf-25b7a80aebcc" containerID="bebbe1345a5763a24e8ceb70b7abe1d2b0297ad21ddcf7947d16b936239505fc" exitCode=0
Sep 16 14:41:03.506669 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.506647    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5" event={"ID":"7f79b5dc-6098-45c8-95cf-25b7a80aebcc","Type":"ContainerDied","Data":"bebbe1345a5763a24e8ceb70b7abe1d2b0297ad21ddcf7947d16b936239505fc"}
Sep 16 14:41:03.508364 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:03.508285    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k" event={"ID":"c60742e3-4908-43d6-93b6-a1c7c226215b","Type":"ContainerStarted","Data":"aa3fb47906f245efa5f30e50e4b0f113bd7d7c8a5d52b49b89a64e1addde82b0"}
Sep 16 14:41:04.517986 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:04.517777    2569 generic.go:356] "Generic (PLEG): container finished" podID="7f79b5dc-6098-45c8-95cf-25b7a80aebcc" containerID="4ef169dc2e5bd01d09d1e2e0af5f815a9698fce06fd3e1ea81153b3ed6954af9" exitCode=0
Sep 16 14:41:04.517986 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:04.517926    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5" event={"ID":"7f79b5dc-6098-45c8-95cf-25b7a80aebcc","Type":"ContainerDied","Data":"4ef169dc2e5bd01d09d1e2e0af5f815a9698fce06fd3e1ea81153b3ed6954af9"}
Sep 16 14:41:04.522001 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:04.521325    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k" event={"ID":"c60742e3-4908-43d6-93b6-a1c7c226215b","Type":"ContainerStarted","Data":"61495a869913bc51249509bfea65a3ea53aa649a1776902403a75972433a0f8e"}
Sep 16 14:41:04.522001 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:04.521946    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:04.525257 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:04.525172    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2" event={"ID":"571b5765-d419-4fd2-a609-8017f2bca42d","Type":"ContainerStarted","Data":"06c31088dad2a13dd2a1c38b34ef1a862df2bffd625190c46a876135e2e72dbd"}
Sep 16 14:41:04.599988 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:04.599912    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k" podStartSLOduration=1.090877427 podStartE2EDuration="2.599890082s" totalImagesPullingTime="1.509012655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:41:04.598902279 +0000 UTC m=+338.950183988" watchObservedRunningTime="2026-09-16 14:41:04.599890082 +0000 UTC m=+338.951171791"
Sep 16 14:41:06.726143 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:06.726107    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:06.837166 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:06.837128    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55v7c\" (UniqueName: \"kubernetes.io/projected/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-kube-api-access-55v7c\") pod \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\" (UID: \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\") "
Sep 16 14:41:06.837317 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:06.837174    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-bundle\") pod \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\" (UID: \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\") "
Sep 16 14:41:06.837317 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:06.837196    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-util\") pod \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\" (UID: \"7f79b5dc-6098-45c8-95cf-25b7a80aebcc\") "
Sep 16 14:41:06.837956 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:06.837921    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-bundle" (OuterVolumeSpecName: "bundle") pod "7f79b5dc-6098-45c8-95cf-25b7a80aebcc" (UID: "7f79b5dc-6098-45c8-95cf-25b7a80aebcc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:41:06.839228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:06.839198    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-kube-api-access-55v7c" (OuterVolumeSpecName: "kube-api-access-55v7c") pod "7f79b5dc-6098-45c8-95cf-25b7a80aebcc" (UID: "7f79b5dc-6098-45c8-95cf-25b7a80aebcc"). InnerVolumeSpecName "kube-api-access-55v7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:41:06.843551 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:06.843523    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-util" (OuterVolumeSpecName: "util") pod "7f79b5dc-6098-45c8-95cf-25b7a80aebcc" (UID: "7f79b5dc-6098-45c8-95cf-25b7a80aebcc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:41:06.938760 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:06.938722    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55v7c\" (UniqueName: \"kubernetes.io/projected/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-kube-api-access-55v7c\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:41:06.938760 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:06.938760    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-bundle\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:41:06.938954 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:06.938774    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f79b5dc-6098-45c8-95cf-25b7a80aebcc-util\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:41:07.543821 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:07.543777    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5" event={"ID":"7f79b5dc-6098-45c8-95cf-25b7a80aebcc","Type":"ContainerDied","Data":"3b03ff5ee1d7abc0c30a081ed32b30a5cfa9b35eca6b30931d08efb580c444d6"}
Sep 16 14:41:07.544041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:07.543852    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b03ff5ee1d7abc0c30a081ed32b30a5cfa9b35eca6b30931d08efb580c444d6"
Sep 16 14:41:07.544041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:07.543955    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sgpb5"
Sep 16 14:41:07.547574 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:07.547540    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2" event={"ID":"571b5765-d419-4fd2-a609-8017f2bca42d","Type":"ContainerStarted","Data":"379d067a3e0498a72a37674e876bab3dde0b226d242acc766bbb19e4ae6050c6"}
Sep 16 14:41:08.554022 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:08.553987    2569 generic.go:356] "Generic (PLEG): container finished" podID="571b5765-d419-4fd2-a609-8017f2bca42d" containerID="379d067a3e0498a72a37674e876bab3dde0b226d242acc766bbb19e4ae6050c6" exitCode=0
Sep 16 14:41:08.554400 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:08.554075    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2" event={"ID":"571b5765-d419-4fd2-a609-8017f2bca42d","Type":"ContainerDied","Data":"379d067a3e0498a72a37674e876bab3dde0b226d242acc766bbb19e4ae6050c6"}
Sep 16 14:41:10.565240 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:10.565204    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2" event={"ID":"571b5765-d419-4fd2-a609-8017f2bca42d","Type":"ContainerStarted","Data":"a1750ef80b78967fcc8624a2efe8f07d1f4d557f84557b00c9dd5583fb038d08"}
Sep 16 14:41:10.565628 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:10.565351    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:10.589956 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:10.589908    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2" podStartSLOduration=3.212062378 podStartE2EDuration="8.58989337s" totalImagesPullingTime="4.374656648s" totalInitContainerRuntime="1.003174344s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:41:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:41:10.589049565 +0000 UTC m=+344.940331274" watchObservedRunningTime="2026-09-16 14:41:10.58989337 +0000 UTC m=+344.941175081"
Sep 16 14:41:16.538655 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:16.538620    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8787d76cb-nl82k"
Sep 16 14:41:21.572204 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:21.572125    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-7crp2"
Sep 16 14:41:31.886781 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.886744    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-558b9bb586-jqxcg"]
Sep 16 14:41:31.887152 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.887072    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f79b5dc-6098-45c8-95cf-25b7a80aebcc" containerName="util"
Sep 16 14:41:31.887152 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.887088    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f79b5dc-6098-45c8-95cf-25b7a80aebcc" containerName="util"
Sep 16 14:41:31.887152 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.887104    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f79b5dc-6098-45c8-95cf-25b7a80aebcc" containerName="pull"
Sep 16 14:41:31.887152 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.887112    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f79b5dc-6098-45c8-95cf-25b7a80aebcc" containerName="pull"
Sep 16 14:41:31.887152 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.887124    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f79b5dc-6098-45c8-95cf-25b7a80aebcc" containerName="extract"
Sep 16 14:41:31.887152 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.887130    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f79b5dc-6098-45c8-95cf-25b7a80aebcc" containerName="extract"
Sep 16 14:41:31.887338 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.887176    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f79b5dc-6098-45c8-95cf-25b7a80aebcc" containerName="extract"
Sep 16 14:41:31.891681 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.891663    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:31.902611 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.902585    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558b9bb586-jqxcg"]
Sep 16 14:41:31.977887 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.977853    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"]
Sep 16 14:41:31.981128 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.981109    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:31.985071 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.985049    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 14:41:31.985282 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.985267    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 14:41:31.985613 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.985592    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pwbzz\""
Sep 16 14:41:31.985613 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:31.985609    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 14:41:32.003009 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.002980    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"]
Sep 16 14:41:32.034214 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.034177    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-oauth-serving-cert\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.034350 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.034224    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-trusted-ca-bundle\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.034350 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.034253    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-console-oauth-config\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.034350 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.034336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dwl2\" (UniqueName: \"kubernetes.io/projected/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-kube-api-access-7dwl2\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.034451 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.034386    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-console-serving-cert\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.034451 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.034405    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-console-config\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.034451 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.034422    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-service-ca\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.135357 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.135325    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-service-ca\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.135645 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.135619    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.135814 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.135793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-oauth-serving-cert\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.135932 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.135829    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.135932 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.135872    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-trusted-ca-bundle\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.135932 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.135900    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.135932 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.135929    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-console-oauth-config\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.136141 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.135958    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.136141 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.135998    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.136141 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.136037    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.136141 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.136060    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.136141 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.136090    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zghr8\" (UniqueName: \"kubernetes.io/projected/d942c5a5-1a0e-402a-9c6b-84cdb9584082-kube-api-access-zghr8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.136141 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.136129    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-service-ca\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.136141 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.136137    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.136486 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.136163    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dwl2\" (UniqueName: \"kubernetes.io/projected/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-kube-api-access-7dwl2\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.136486 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.136373    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-console-serving-cert\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.136486 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.136450    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-console-config\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.136944 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.136894    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-oauth-serving-cert\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.137043 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.137023    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-console-config\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.137171 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.137149    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-trusted-ca-bundle\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.138707 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.138678    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-console-oauth-config\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.138707 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.138694    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-console-serving-cert\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.145070 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.145052    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dwl2\" (UniqueName: \"kubernetes.io/projected/5c03a80a-0ee4-4818-9ce2-df6aac89f5df-kube-api-access-7dwl2\") pod \"console-558b9bb586-jqxcg\" (UID: \"5c03a80a-0ee4-4818-9ce2-df6aac89f5df\") " pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.201289 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.201255    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:32.237662 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.237613    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.237662 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.237663    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.237987 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.237715    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.237987 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.237755    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.237987 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.237786    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.237987 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.237818    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.237987 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.237843    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.237987 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.237868    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zghr8\" (UniqueName: \"kubernetes.io/projected/d942c5a5-1a0e-402a-9c6b-84cdb9584082-kube-api-access-zghr8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.237987 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.237909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.238372 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.238073    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.238372 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.238298    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.238511 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.238368    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.238511 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.238398    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.238682 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.238657    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.240610 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.240545    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.240935 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.240916    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.251432 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.250970    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zghr8\" (UniqueName: \"kubernetes.io/projected/d942c5a5-1a0e-402a-9c6b-84cdb9584082-kube-api-access-zghr8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.251538 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.251471    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d942c5a5-1a0e-402a-9c6b-84cdb9584082-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759\" (UID: \"d942c5a5-1a0e-402a-9c6b-84cdb9584082\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.290999 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.290967    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:32.478381 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.478355    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558b9bb586-jqxcg"]
Sep 16 14:41:32.480089 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:41:32.480062    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c03a80a_0ee4_4818_9ce2_df6aac89f5df.slice/crio-dfc55680a74f256b1ebde8a78ded079cf91dccca3a79cedb7582a82bccf2ba3f WatchSource:0}: Error finding container dfc55680a74f256b1ebde8a78ded079cf91dccca3a79cedb7582a82bccf2ba3f: Status 404 returned error can't find the container with id dfc55680a74f256b1ebde8a78ded079cf91dccca3a79cedb7582a82bccf2ba3f
Sep 16 14:41:32.573973 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.573940    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"]
Sep 16 14:41:32.574772 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:41:32.574747    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd942c5a5_1a0e_402a_9c6b_84cdb9584082.slice/crio-7f81b0b2e6b2ea3795922ecba062e91c64265a5f93bb2b41a18324672ad1fa5c WatchSource:0}: Error finding container 7f81b0b2e6b2ea3795922ecba062e91c64265a5f93bb2b41a18324672ad1fa5c: Status 404 returned error can't find the container with id 7f81b0b2e6b2ea3795922ecba062e91c64265a5f93bb2b41a18324672ad1fa5c
Sep 16 14:41:32.667064 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.667026    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558b9bb586-jqxcg" event={"ID":"5c03a80a-0ee4-4818-9ce2-df6aac89f5df","Type":"ContainerStarted","Data":"a42407e169c9f9c45b1a266f8563a0e8efd3481eec4ee661a4e8b1277039eaae"}
Sep 16 14:41:32.667280 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.667119    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558b9bb586-jqxcg" event={"ID":"5c03a80a-0ee4-4818-9ce2-df6aac89f5df","Type":"ContainerStarted","Data":"dfc55680a74f256b1ebde8a78ded079cf91dccca3a79cedb7582a82bccf2ba3f"}
Sep 16 14:41:32.668222 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.668196    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759" event={"ID":"d942c5a5-1a0e-402a-9c6b-84cdb9584082","Type":"ContainerStarted","Data":"7f81b0b2e6b2ea3795922ecba062e91c64265a5f93bb2b41a18324672ad1fa5c"}
Sep 16 14:41:32.688860 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:32.688814    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-558b9bb586-jqxcg" podStartSLOduration=1.6887992029999999 podStartE2EDuration="1.688799203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:41:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:41:32.686820433 +0000 UTC m=+367.038102144" watchObservedRunningTime="2026-09-16 14:41:32.688799203 +0000 UTC m=+367.040080916"
Sep 16 14:41:34.648199 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:34.648159    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2n9lt"]
Sep 16 14:41:34.655581 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:34.655551    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt"
Sep 16 14:41:34.660998 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:34.660964    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 16 14:41:34.661289 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:34.661268    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-97w7r\""
Sep 16 14:41:34.670935 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:34.670903    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2n9lt"]
Sep 16 14:41:34.762695 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:34.762653    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxkxt\" (UniqueName: \"kubernetes.io/projected/cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0-kube-api-access-lxkxt\") pod \"odh-model-controller-7998c67dc4-2n9lt\" (UID: \"cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt"
Sep 16 14:41:34.762695 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:34.762702    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0-cert\") pod \"odh-model-controller-7998c67dc4-2n9lt\" (UID: \"cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt"
Sep 16 14:41:34.863797 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:34.863757    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxkxt\" (UniqueName: \"kubernetes.io/projected/cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0-kube-api-access-lxkxt\") pod \"odh-model-controller-7998c67dc4-2n9lt\" (UID: \"cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt"
Sep 16 14:41:34.863981 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:34.863817    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0-cert\") pod \"odh-model-controller-7998c67dc4-2n9lt\" (UID: \"cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt"
Sep 16 14:41:34.866537 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:34.866507    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0-cert\") pod \"odh-model-controller-7998c67dc4-2n9lt\" (UID: \"cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt"
Sep 16 14:41:34.874874 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:34.874844    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxkxt\" (UniqueName: \"kubernetes.io/projected/cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0-kube-api-access-lxkxt\") pod \"odh-model-controller-7998c67dc4-2n9lt\" (UID: \"cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt"
Sep 16 14:41:34.969135 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:34.969047    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt"
Sep 16 14:41:35.249267 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.249234    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tp47q"]
Sep 16 14:41:35.257967 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.257935    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tp47q"
Sep 16 14:41:35.260228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.260202    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 16 14:41:35.260372 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.260317    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-72jc8\""
Sep 16 14:41:35.264903 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.264877    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tp47q"]
Sep 16 14:41:35.267808 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.267779    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b84ec0b-762a-4351-954c-d7875337701d-tls-certs\") pod \"model-serving-api-54d89bd5fc-tp47q\" (UID: \"0b84ec0b-762a-4351-954c-d7875337701d\") " pod="opendatahub/model-serving-api-54d89bd5fc-tp47q"
Sep 16 14:41:35.267916 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.267844    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d74gj\" (UniqueName: \"kubernetes.io/projected/0b84ec0b-762a-4351-954c-d7875337701d-kube-api-access-d74gj\") pod \"model-serving-api-54d89bd5fc-tp47q\" (UID: \"0b84ec0b-762a-4351-954c-d7875337701d\") " pod="opendatahub/model-serving-api-54d89bd5fc-tp47q"
Sep 16 14:41:35.368899 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.368870    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b84ec0b-762a-4351-954c-d7875337701d-tls-certs\") pod \"model-serving-api-54d89bd5fc-tp47q\" (UID: \"0b84ec0b-762a-4351-954c-d7875337701d\") " pod="opendatahub/model-serving-api-54d89bd5fc-tp47q"
Sep 16 14:41:35.369006 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.368915    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d74gj\" (UniqueName: \"kubernetes.io/projected/0b84ec0b-762a-4351-954c-d7875337701d-kube-api-access-d74gj\") pod \"model-serving-api-54d89bd5fc-tp47q\" (UID: \"0b84ec0b-762a-4351-954c-d7875337701d\") " pod="opendatahub/model-serving-api-54d89bd5fc-tp47q"
Sep 16 14:41:35.369065 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:41:35.369037    2569 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 16 14:41:35.369112 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:41:35.369103    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b84ec0b-762a-4351-954c-d7875337701d-tls-certs podName:0b84ec0b-762a-4351-954c-d7875337701d nodeName:}" failed. No retries permitted until 2026-09-16 14:41:35.869086315 +0000 UTC m=+370.220368015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0b84ec0b-762a-4351-954c-d7875337701d-tls-certs") pod "model-serving-api-54d89bd5fc-tp47q" (UID: "0b84ec0b-762a-4351-954c-d7875337701d") : secret "model-serving-api-tls" not found
Sep 16 14:41:35.370737 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.370689    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:41:35.370852 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.370763    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:41:35.370852 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.370798    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:41:35.378115 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.378093    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d74gj\" (UniqueName: \"kubernetes.io/projected/0b84ec0b-762a-4351-954c-d7875337701d-kube-api-access-d74gj\") pod \"model-serving-api-54d89bd5fc-tp47q\" (UID: \"0b84ec0b-762a-4351-954c-d7875337701d\") " pod="opendatahub/model-serving-api-54d89bd5fc-tp47q"
Sep 16 14:41:35.573282 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.573252    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2n9lt"]
Sep 16 14:41:35.574914 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:41:35.574891    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8f1ba6_7cb9_4bdd_a495_63faa645b2e0.slice/crio-9a7b57de544ac2c5ee6785fc19d1a1d23528a500f30e855473a347c2645b72af WatchSource:0}: Error finding container 9a7b57de544ac2c5ee6785fc19d1a1d23528a500f30e855473a347c2645b72af: Status 404 returned error can't find the container with id 9a7b57de544ac2c5ee6785fc19d1a1d23528a500f30e855473a347c2645b72af
Sep 16 14:41:35.686406 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.686363    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt" event={"ID":"cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0","Type":"ContainerStarted","Data":"9a7b57de544ac2c5ee6785fc19d1a1d23528a500f30e855473a347c2645b72af"}
Sep 16 14:41:35.687909 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.687880    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759" event={"ID":"d942c5a5-1a0e-402a-9c6b-84cdb9584082","Type":"ContainerStarted","Data":"32ae559b09da16d49d4ce81582b94401feba6b4bb13cf6958392ed3c53981d5a"}
Sep 16 14:41:35.713274 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.713220    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759" podStartSLOduration=1.919576935 podStartE2EDuration="4.713198861s" totalImagesPullingTime="2.793621926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:41:35.7119119 +0000 UTC m=+370.063193609" watchObservedRunningTime="2026-09-16 14:41:35.713198861 +0000 UTC m=+370.064480570"
Sep 16 14:41:35.873821 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.873714    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b84ec0b-762a-4351-954c-d7875337701d-tls-certs\") pod \"model-serving-api-54d89bd5fc-tp47q\" (UID: \"0b84ec0b-762a-4351-954c-d7875337701d\") " pod="opendatahub/model-serving-api-54d89bd5fc-tp47q"
Sep 16 14:41:35.876357 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:35.876323    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b84ec0b-762a-4351-954c-d7875337701d-tls-certs\") pod \"model-serving-api-54d89bd5fc-tp47q\" (UID: \"0b84ec0b-762a-4351-954c-d7875337701d\") " pod="opendatahub/model-serving-api-54d89bd5fc-tp47q"
Sep 16 14:41:36.171641 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:36.171544    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tp47q"
Sep 16 14:41:36.291255 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:36.291214    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:36.295820 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:36.295792    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:36.446136 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:36.446111    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tp47q"]
Sep 16 14:41:36.448656 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:41:36.448619    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b84ec0b_762a_4351_954c_d7875337701d.slice/crio-4766ac3a680137215cc1f5ad4134d33fc29a573c01f374db0ec589ac0af9d3a3 WatchSource:0}: Error finding container 4766ac3a680137215cc1f5ad4134d33fc29a573c01f374db0ec589ac0af9d3a3: Status 404 returned error can't find the container with id 4766ac3a680137215cc1f5ad4134d33fc29a573c01f374db0ec589ac0af9d3a3
Sep 16 14:41:36.695074 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:36.695024    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tp47q" event={"ID":"0b84ec0b-762a-4351-954c-d7875337701d","Type":"ContainerStarted","Data":"4766ac3a680137215cc1f5ad4134d33fc29a573c01f374db0ec589ac0af9d3a3"}
Sep 16 14:41:36.695568 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:36.695254    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:36.696356 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:36.696338    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759"
Sep 16 14:41:40.719070 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:40.719027    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tp47q" event={"ID":"0b84ec0b-762a-4351-954c-d7875337701d","Type":"ContainerStarted","Data":"974cc1d7fd5a57227dfa746fb9299bb0021569145f500110e88633df1b99377e"}
Sep 16 14:41:40.719541 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:40.719093    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tp47q"
Sep 16 14:41:40.720656 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:40.720630    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt" event={"ID":"cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0","Type":"ContainerStarted","Data":"8f22dbd0b263ea260d4cace5780e3708cc14f88d415e2506d9f3cc3dc7a776dc"}
Sep 16 14:41:40.720759 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:40.720710    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt"
Sep 16 14:41:40.743386 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:40.743335    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tp47q" podStartSLOduration=2.335405765 podStartE2EDuration="5.743318857s" totalImagesPullingTime="3.407913092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:41:40.741087435 +0000 UTC m=+375.092369143" watchObservedRunningTime="2026-09-16 14:41:40.743318857 +0000 UTC m=+375.094600580"
Sep 16 14:41:40.764832 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:40.764755    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt" podStartSLOduration=2.491671619 podStartE2EDuration="6.764734132s" totalImagesPullingTime="4.273062513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:41:40.762143323 +0000 UTC m=+375.113425034" watchObservedRunningTime="2026-09-16 14:41:40.764734132 +0000 UTC m=+375.116015842"
Sep 16 14:41:42.071766 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.071730    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"]
Sep 16 14:41:42.074133 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.074113    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.079257 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.079219    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 14:41:42.092883 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.092856    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 14:41:42.093863 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.093839    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ffr5t\""
Sep 16 14:41:42.094014 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.093908    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 14:41:42.111185 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.111152    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"]
Sep 16 14:41:42.125920 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.125887    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b01f60cc-9a21-408a-a667-f3e06f65fd70-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.126056 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.125924    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7wfp\" (UniqueName: \"kubernetes.io/projected/b01f60cc-9a21-408a-a667-f3e06f65fd70-kube-api-access-p7wfp\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.126056 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.125968    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b01f60cc-9a21-408a-a667-f3e06f65fd70-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.126056 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.126010    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b01f60cc-9a21-408a-a667-f3e06f65fd70-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.126056 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.126040    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b01f60cc-9a21-408a-a667-f3e06f65fd70-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.126205 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.126098    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b01f60cc-9a21-408a-a667-f3e06f65fd70-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.126205 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.126127    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b01f60cc-9a21-408a-a667-f3e06f65fd70-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.201894 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.201784    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:42.202068 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.201921    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:42.206779 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.206753    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:42.226620 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.226584    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b01f60cc-9a21-408a-a667-f3e06f65fd70-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.226762 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.226639    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b01f60cc-9a21-408a-a667-f3e06f65fd70-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.226762 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.226675    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b01f60cc-9a21-408a-a667-f3e06f65fd70-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.226762 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.226745    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b01f60cc-9a21-408a-a667-f3e06f65fd70-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.226943 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.226774    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7wfp\" (UniqueName: \"kubernetes.io/projected/b01f60cc-9a21-408a-a667-f3e06f65fd70-kube-api-access-p7wfp\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.226943 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.226825    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b01f60cc-9a21-408a-a667-f3e06f65fd70-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.227129 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.227102    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b01f60cc-9a21-408a-a667-f3e06f65fd70-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.227442 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.227404    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b01f60cc-9a21-408a-a667-f3e06f65fd70-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.229243 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.229209    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b01f60cc-9a21-408a-a667-f3e06f65fd70-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.229400 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.229382    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b01f60cc-9a21-408a-a667-f3e06f65fd70-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.229613 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.229591    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b01f60cc-9a21-408a-a667-f3e06f65fd70-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.229684 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.229628    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b01f60cc-9a21-408a-a667-f3e06f65fd70-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.250092 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.250059    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b01f60cc-9a21-408a-a667-f3e06f65fd70-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.252309 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.252282    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7wfp\" (UniqueName: \"kubernetes.io/projected/b01f60cc-9a21-408a-a667-f3e06f65fd70-kube-api-access-p7wfp\") pod \"istiod-openshift-gateway-5677ccb49b-v962d\" (UID: \"b01f60cc-9a21-408a-a667-f3e06f65fd70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.383415 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.383330    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:42.670662 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.670632    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"]
Sep 16 14:41:42.672036 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:41:42.672003    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01f60cc_9a21_408a_a667_f3e06f65fd70.slice/crio-4b88cd4d32f8ea3d637e0bd7c02acfaa3f7cbde0cbe9a8d8dea548bda6d3796f WatchSource:0}: Error finding container 4b88cd4d32f8ea3d637e0bd7c02acfaa3f7cbde0cbe9a8d8dea548bda6d3796f: Status 404 returned error can't find the container with id 4b88cd4d32f8ea3d637e0bd7c02acfaa3f7cbde0cbe9a8d8dea548bda6d3796f
Sep 16 14:41:42.732370 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.732336    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d" event={"ID":"b01f60cc-9a21-408a-a667-f3e06f65fd70","Type":"ContainerStarted","Data":"4b88cd4d32f8ea3d637e0bd7c02acfaa3f7cbde0cbe9a8d8dea548bda6d3796f"}
Sep 16 14:41:42.736257 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.736231    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-558b9bb586-jqxcg"
Sep 16 14:41:42.915453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:42.915418    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-859f7bb74f-h75xv"]
Sep 16 14:41:44.799157 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:44.799125    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:41:44.799414 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:44.799192    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:41:45.752879 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:45.752846    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d" event={"ID":"b01f60cc-9a21-408a-a667-f3e06f65fd70","Type":"ContainerStarted","Data":"b419fefce10872eb41bbddee51ef414bb975714cb10133898ee392a77f2d4c73"}
Sep 16 14:41:45.753124 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:45.753103    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:45.754908 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:45.754880    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-v962d container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 14:41:45.755039 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:45.754938    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d" podUID="b01f60cc-9a21-408a-a667-f3e06f65fd70" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:41:45.831390 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:45.831329    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d" podStartSLOduration=1.706977629 podStartE2EDuration="3.831311503s" totalImagesPullingTime="2.124333874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:41:45.829133255 +0000 UTC m=+380.180414977" watchObservedRunningTime="2026-09-16 14:41:45.831311503 +0000 UTC m=+380.182593213"
Sep 16 14:41:46.758523 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:46.758465    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-v962d container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 14:41:46.758664 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:46.758537    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d" podUID="b01f60cc-9a21-408a-a667-f3e06f65fd70" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:41:49.759549 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:49.759484    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d"
Sep 16 14:41:51.728050 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:51.728016    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2n9lt"
Sep 16 14:41:51.730287 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:41:51.730265    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tp47q"
Sep 16 14:42:07.935248 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:07.935180    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-859f7bb74f-h75xv" podUID="768d4809-c730-449c-abbc-599c261e59e8" containerName="console" containerID="cri-o://6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a" gracePeriod=15
Sep 16 14:42:08.183394 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.183369    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:42:08.253796 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.253757    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/768d4809-c730-449c-abbc-599c261e59e8-console-serving-cert\") pod \"768d4809-c730-449c-abbc-599c261e59e8\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") "
Sep 16 14:42:08.253975 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.253851    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t7nf\" (UniqueName: \"kubernetes.io/projected/768d4809-c730-449c-abbc-599c261e59e8-kube-api-access-9t7nf\") pod \"768d4809-c730-449c-abbc-599c261e59e8\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") "
Sep 16 14:42:08.254050 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.254025    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-service-ca\") pod \"768d4809-c730-449c-abbc-599c261e59e8\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") "
Sep 16 14:42:08.254114 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.254101    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-console-config\") pod \"768d4809-c730-449c-abbc-599c261e59e8\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") "
Sep 16 14:42:08.254177 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.254161    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-oauth-serving-cert\") pod \"768d4809-c730-449c-abbc-599c261e59e8\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") "
Sep 16 14:42:08.254236 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.254206    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/768d4809-c730-449c-abbc-599c261e59e8-console-oauth-config\") pod \"768d4809-c730-449c-abbc-599c261e59e8\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") "
Sep 16 14:42:08.254287 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.254253    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-trusted-ca-bundle\") pod \"768d4809-c730-449c-abbc-599c261e59e8\" (UID: \"768d4809-c730-449c-abbc-599c261e59e8\") "
Sep 16 14:42:08.254453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.254411    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-service-ca" (OuterVolumeSpecName: "service-ca") pod "768d4809-c730-449c-abbc-599c261e59e8" (UID: "768d4809-c730-449c-abbc-599c261e59e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:42:08.254617 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.254417    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-console-config" (OuterVolumeSpecName: "console-config") pod "768d4809-c730-449c-abbc-599c261e59e8" (UID: "768d4809-c730-449c-abbc-599c261e59e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:42:08.254697 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.254679    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-console-config\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.254697 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.254693    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-service-ca\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.254807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.254719    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "768d4809-c730-449c-abbc-599c261e59e8" (UID: "768d4809-c730-449c-abbc-599c261e59e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:42:08.254807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.254780    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "768d4809-c730-449c-abbc-599c261e59e8" (UID: "768d4809-c730-449c-abbc-599c261e59e8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:42:08.256039 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.256018    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/768d4809-c730-449c-abbc-599c261e59e8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "768d4809-c730-449c-abbc-599c261e59e8" (UID: "768d4809-c730-449c-abbc-599c261e59e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:42:08.256039 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.256018    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/768d4809-c730-449c-abbc-599c261e59e8-kube-api-access-9t7nf" (OuterVolumeSpecName: "kube-api-access-9t7nf") pod "768d4809-c730-449c-abbc-599c261e59e8" (UID: "768d4809-c730-449c-abbc-599c261e59e8"). InnerVolumeSpecName "kube-api-access-9t7nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:42:08.256217 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.256200    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/768d4809-c730-449c-abbc-599c261e59e8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "768d4809-c730-449c-abbc-599c261e59e8" (UID: "768d4809-c730-449c-abbc-599c261e59e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:42:08.355451 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.355409    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t7nf\" (UniqueName: \"kubernetes.io/projected/768d4809-c730-449c-abbc-599c261e59e8-kube-api-access-9t7nf\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.355451 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.355445    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-oauth-serving-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.355680 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.355454    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/768d4809-c730-449c-abbc-599c261e59e8-console-oauth-config\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.355680 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.355477    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/768d4809-c730-449c-abbc-599c261e59e8-trusted-ca-bundle\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.355680 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.355511    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/768d4809-c730-449c-abbc-599c261e59e8-console-serving-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:42:08.867217 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.867182    2569 generic.go:356] "Generic (PLEG): container finished" podID="768d4809-c730-449c-abbc-599c261e59e8" containerID="6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a" exitCode=0
Sep 16 14:42:08.867400 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.867236    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-859f7bb74f-h75xv"
Sep 16 14:42:08.867400 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.867272    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859f7bb74f-h75xv" event={"ID":"768d4809-c730-449c-abbc-599c261e59e8","Type":"ContainerDied","Data":"6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a"}
Sep 16 14:42:08.867400 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.867327    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-859f7bb74f-h75xv" event={"ID":"768d4809-c730-449c-abbc-599c261e59e8","Type":"ContainerDied","Data":"bdc111ae01eb0b591e167655390a5d89c54812b04295743fed7f183a5c5f6e77"}
Sep 16 14:42:08.867400 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.867355    2569 scope.go:117] "RemoveContainer" containerID="6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a"
Sep 16 14:42:08.876229 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.876209    2569 scope.go:117] "RemoveContainer" containerID="6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a"
Sep 16 14:42:08.876564 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:42:08.876544    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a\": container with ID starting with 6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a not found: ID does not exist" containerID="6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a"
Sep 16 14:42:08.876617 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.876573    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a"} err="failed to get container status \"6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a\": rpc error: code = NotFound desc = could not find container \"6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a\": container with ID starting with 6b7aa5d92bcd87316f6da53ff052c1e425be5b1182cce28f6e2c7d6dd09a4f1a not found: ID does not exist"
Sep 16 14:42:08.888516 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.888471    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-859f7bb74f-h75xv"]
Sep 16 14:42:08.891882 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:08.891849    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-859f7bb74f-h75xv"]
Sep 16 14:42:10.087419 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:10.087376    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="768d4809-c730-449c-abbc-599c261e59e8" path="/var/lib/kubelet/pods/768d4809-c730-449c-abbc-599c261e59e8/volumes"
Sep 16 14:42:59.787606 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.787572    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"]
Sep 16 14:42:59.788067 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.787902    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="768d4809-c730-449c-abbc-599c261e59e8" containerName="console"
Sep 16 14:42:59.788067 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.787913    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="768d4809-c730-449c-abbc-599c261e59e8" containerName="console"
Sep 16 14:42:59.788067 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.787969    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="768d4809-c730-449c-abbc-599c261e59e8" containerName="console"
Sep 16 14:42:59.790389 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.790372    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:42:59.792738 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.792714    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 14:42:59.792849 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.792735    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jsmkt\""
Sep 16 14:42:59.793694 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.793674    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 14:42:59.799678 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.799656    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"]
Sep 16 14:42:59.886195 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.886158    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"]
Sep 16 14:42:59.888997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.888966    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:42:59.898374 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.898351    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"]
Sep 16 14:42:59.908422 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.908396    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c810c238-9f97-4b3c-83ef-45fa06cce53a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2\" (UID: \"c810c238-9f97-4b3c-83ef-45fa06cce53a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:42:59.908590 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.908440    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c810c238-9f97-4b3c-83ef-45fa06cce53a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2\" (UID: \"c810c238-9f97-4b3c-83ef-45fa06cce53a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:42:59.908590 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.908474    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzfbw\" (UniqueName: \"kubernetes.io/projected/c810c238-9f97-4b3c-83ef-45fa06cce53a-kube-api-access-nzfbw\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2\" (UID: \"c810c238-9f97-4b3c-83ef-45fa06cce53a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:42:59.984168 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.984137    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"]
Sep 16 14:42:59.986814 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.986795    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:42:59.997005 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:42:59.996978    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"]
Sep 16 14:43:00.009111 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.009087    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c810c238-9f97-4b3c-83ef-45fa06cce53a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2\" (UID: \"c810c238-9f97-4b3c-83ef-45fa06cce53a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:43:00.009249 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.009120    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c810c238-9f97-4b3c-83ef-45fa06cce53a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2\" (UID: \"c810c238-9f97-4b3c-83ef-45fa06cce53a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:43:00.009249 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.009143    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzfbw\" (UniqueName: \"kubernetes.io/projected/c810c238-9f97-4b3c-83ef-45fa06cce53a-kube-api-access-nzfbw\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2\" (UID: \"c810c238-9f97-4b3c-83ef-45fa06cce53a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:43:00.009249 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.009171    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb29c6b3-1025-458d-84ba-ff650263d805-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl\" (UID: \"eb29c6b3-1025-458d-84ba-ff650263d805\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:43:00.009249 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.009204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb29c6b3-1025-458d-84ba-ff650263d805-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl\" (UID: \"eb29c6b3-1025-458d-84ba-ff650263d805\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:43:00.009443 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.009368    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99dxx\" (UniqueName: \"kubernetes.io/projected/eb29c6b3-1025-458d-84ba-ff650263d805-kube-api-access-99dxx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl\" (UID: \"eb29c6b3-1025-458d-84ba-ff650263d805\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:43:00.009537 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.009514    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c810c238-9f97-4b3c-83ef-45fa06cce53a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2\" (UID: \"c810c238-9f97-4b3c-83ef-45fa06cce53a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:43:00.009665 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.009638    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c810c238-9f97-4b3c-83ef-45fa06cce53a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2\" (UID: \"c810c238-9f97-4b3c-83ef-45fa06cce53a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:43:00.017270 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.017244    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzfbw\" (UniqueName: \"kubernetes.io/projected/c810c238-9f97-4b3c-83ef-45fa06cce53a-kube-api-access-nzfbw\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2\" (UID: \"c810c238-9f97-4b3c-83ef-45fa06cce53a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:43:00.080501 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.080404    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"]
Sep 16 14:43:00.087539 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.087478    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:00.093972 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.093939    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"]
Sep 16 14:43:00.099481 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.099458    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:43:00.110574 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.110507    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb29c6b3-1025-458d-84ba-ff650263d805-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl\" (UID: \"eb29c6b3-1025-458d-84ba-ff650263d805\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:43:00.110574 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.110563    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb29c6b3-1025-458d-84ba-ff650263d805-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl\" (UID: \"eb29c6b3-1025-458d-84ba-ff650263d805\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:43:00.110703 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.110598    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9nlh\" (UniqueName: \"kubernetes.io/projected/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-kube-api-access-k9nlh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2\" (UID: \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:43:00.110703 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.110665    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2\" (UID: \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:43:00.110802 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.110700    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99dxx\" (UniqueName: \"kubernetes.io/projected/eb29c6b3-1025-458d-84ba-ff650263d805-kube-api-access-99dxx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl\" (UID: \"eb29c6b3-1025-458d-84ba-ff650263d805\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:43:00.110802 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.110727    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2\" (UID: \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:43:00.110888 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.110863    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb29c6b3-1025-458d-84ba-ff650263d805-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl\" (UID: \"eb29c6b3-1025-458d-84ba-ff650263d805\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:43:00.110923 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.110901    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb29c6b3-1025-458d-84ba-ff650263d805-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl\" (UID: \"eb29c6b3-1025-458d-84ba-ff650263d805\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:43:00.122534 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.122507    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99dxx\" (UniqueName: \"kubernetes.io/projected/eb29c6b3-1025-458d-84ba-ff650263d805-kube-api-access-99dxx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl\" (UID: \"eb29c6b3-1025-458d-84ba-ff650263d805\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:43:00.199044 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.199008    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:43:00.211839 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.211815    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2\" (UID: \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:43:00.211947 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.211848    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2\" (UID: \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:43:00.211947 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.211891    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g2cv\" (UniqueName: \"kubernetes.io/projected/236dee70-fe2b-4d5c-a5db-7d25c39f972e-kube-api-access-2g2cv\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556\" (UID: \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:00.212054 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.212018    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/236dee70-fe2b-4d5c-a5db-7d25c39f972e-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556\" (UID: \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:00.212110 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.212091    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/236dee70-fe2b-4d5c-a5db-7d25c39f972e-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556\" (UID: \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:00.212168 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.212145    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9nlh\" (UniqueName: \"kubernetes.io/projected/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-kube-api-access-k9nlh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2\" (UID: \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:43:00.212229 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.212164    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2\" (UID: \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:43:00.212229 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.212219    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2\" (UID: \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:43:00.221484 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.221456    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9nlh\" (UniqueName: \"kubernetes.io/projected/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-kube-api-access-k9nlh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2\" (UID: \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:43:00.296090 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.296054    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:43:00.313346 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.313302    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g2cv\" (UniqueName: \"kubernetes.io/projected/236dee70-fe2b-4d5c-a5db-7d25c39f972e-kube-api-access-2g2cv\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556\" (UID: \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:00.313470 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.313368    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/236dee70-fe2b-4d5c-a5db-7d25c39f972e-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556\" (UID: \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:00.313470 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.313416    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/236dee70-fe2b-4d5c-a5db-7d25c39f972e-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556\" (UID: \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:00.313815 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.313784    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/236dee70-fe2b-4d5c-a5db-7d25c39f972e-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556\" (UID: \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:00.313914 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.313790    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/236dee70-fe2b-4d5c-a5db-7d25c39f972e-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556\" (UID: \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:00.322845 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.322817    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g2cv\" (UniqueName: \"kubernetes.io/projected/236dee70-fe2b-4d5c-a5db-7d25c39f972e-kube-api-access-2g2cv\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556\" (UID: \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:00.376045 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.376015    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"]
Sep 16 14:43:00.377662 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:43:00.377635    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc810c238_9f97_4b3c_83ef_45fa06cce53a.slice/crio-f2517ec5b8fe6aeeb8087ecfa63ca5bc091d2151cffd4afbe1c7c3e5fd05f9e8 WatchSource:0}: Error finding container f2517ec5b8fe6aeeb8087ecfa63ca5bc091d2151cffd4afbe1c7c3e5fd05f9e8: Status 404 returned error can't find the container with id f2517ec5b8fe6aeeb8087ecfa63ca5bc091d2151cffd4afbe1c7c3e5fd05f9e8
Sep 16 14:43:00.398728 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.398705    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:00.477974 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.477937    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"]
Sep 16 14:43:00.479009 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:43:00.478981    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb29c6b3_1025_458d_84ba_ff650263d805.slice/crio-ef356955b3791d92f14ace5a0ce052f8a802a14b9ba3ff4b9d7711d2be566647 WatchSource:0}: Error finding container ef356955b3791d92f14ace5a0ce052f8a802a14b9ba3ff4b9d7711d2be566647: Status 404 returned error can't find the container with id ef356955b3791d92f14ace5a0ce052f8a802a14b9ba3ff4b9d7711d2be566647
Sep 16 14:43:00.570807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.570782    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"]
Sep 16 14:43:00.572666 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:43:00.572640    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7361e605_1c9d_417b_a7f5_9a9809d9e8a4.slice/crio-a91cf41327da2f68031b76fb9510c3476fd7796e60f9533ac7f073a13f4ec1e7 WatchSource:0}: Error finding container a91cf41327da2f68031b76fb9510c3476fd7796e60f9533ac7f073a13f4ec1e7: Status 404 returned error can't find the container with id a91cf41327da2f68031b76fb9510c3476fd7796e60f9533ac7f073a13f4ec1e7
Sep 16 14:43:00.671665 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:00.671637    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"]
Sep 16 14:43:00.683657 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:43:00.683629    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236dee70_fe2b_4d5c_a5db_7d25c39f972e.slice/crio-6d00344cbdad088eda50deb03bfcfc88c2cd45484a3536493f25c5ded95bcd86 WatchSource:0}: Error finding container 6d00344cbdad088eda50deb03bfcfc88c2cd45484a3536493f25c5ded95bcd86: Status 404 returned error can't find the container with id 6d00344cbdad088eda50deb03bfcfc88c2cd45484a3536493f25c5ded95bcd86
Sep 16 14:43:01.114748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:01.114714    2569 generic.go:356] "Generic (PLEG): container finished" podID="7361e605-1c9d-417b-a7f5-9a9809d9e8a4" containerID="9f4fb755d0effd9d6ca65b77b2770566ec7f1c3205837a787a6e96cf4338dd1d" exitCode=0
Sep 16 14:43:01.115179 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:01.114809    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2" event={"ID":"7361e605-1c9d-417b-a7f5-9a9809d9e8a4","Type":"ContainerDied","Data":"9f4fb755d0effd9d6ca65b77b2770566ec7f1c3205837a787a6e96cf4338dd1d"}
Sep 16 14:43:01.115179 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:01.114875    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2" event={"ID":"7361e605-1c9d-417b-a7f5-9a9809d9e8a4","Type":"ContainerStarted","Data":"a91cf41327da2f68031b76fb9510c3476fd7796e60f9533ac7f073a13f4ec1e7"}
Sep 16 14:43:01.116601 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:01.116577    2569 generic.go:356] "Generic (PLEG): container finished" podID="236dee70-fe2b-4d5c-a5db-7d25c39f972e" containerID="99b3941be20dcd902ae5216f2f229210e8c8a1cbf8da235ddcb975c9c1e753a9" exitCode=0
Sep 16 14:43:01.116704 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:01.116669    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556" event={"ID":"236dee70-fe2b-4d5c-a5db-7d25c39f972e","Type":"ContainerDied","Data":"99b3941be20dcd902ae5216f2f229210e8c8a1cbf8da235ddcb975c9c1e753a9"}
Sep 16 14:43:01.116772 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:01.116738    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556" event={"ID":"236dee70-fe2b-4d5c-a5db-7d25c39f972e","Type":"ContainerStarted","Data":"6d00344cbdad088eda50deb03bfcfc88c2cd45484a3536493f25c5ded95bcd86"}
Sep 16 14:43:01.118570 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:01.118548    2569 generic.go:356] "Generic (PLEG): container finished" podID="eb29c6b3-1025-458d-84ba-ff650263d805" containerID="77fd5e817087bb4e46c091c552efa6a4f52e39612417b0fb63d6e4be783c9467" exitCode=0
Sep 16 14:43:01.118666 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:01.118604    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl" event={"ID":"eb29c6b3-1025-458d-84ba-ff650263d805","Type":"ContainerDied","Data":"77fd5e817087bb4e46c091c552efa6a4f52e39612417b0fb63d6e4be783c9467"}
Sep 16 14:43:01.118666 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:01.118651    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl" event={"ID":"eb29c6b3-1025-458d-84ba-ff650263d805","Type":"ContainerStarted","Data":"ef356955b3791d92f14ace5a0ce052f8a802a14b9ba3ff4b9d7711d2be566647"}
Sep 16 14:43:01.120357 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:01.120338    2569 generic.go:356] "Generic (PLEG): container finished" podID="c810c238-9f97-4b3c-83ef-45fa06cce53a" containerID="ce01f8faeb0f94e036de8dead648d34ceb75583b94a1b369ae7b056d13ad1a03" exitCode=0
Sep 16 14:43:01.120445 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:01.120373    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2" event={"ID":"c810c238-9f97-4b3c-83ef-45fa06cce53a","Type":"ContainerDied","Data":"ce01f8faeb0f94e036de8dead648d34ceb75583b94a1b369ae7b056d13ad1a03"}
Sep 16 14:43:01.120445 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:01.120405    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2" event={"ID":"c810c238-9f97-4b3c-83ef-45fa06cce53a","Type":"ContainerStarted","Data":"f2517ec5b8fe6aeeb8087ecfa63ca5bc091d2151cffd4afbe1c7c3e5fd05f9e8"}
Sep 16 14:43:02.127180 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:02.127149    2569 generic.go:356] "Generic (PLEG): container finished" podID="c810c238-9f97-4b3c-83ef-45fa06cce53a" containerID="2b519f49f61667ce7bb7ffed2a2b6687e68c34a8b3553d74d19dde2957a03fc2" exitCode=0
Sep 16 14:43:02.127629 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:02.127238    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2" event={"ID":"c810c238-9f97-4b3c-83ef-45fa06cce53a","Type":"ContainerDied","Data":"2b519f49f61667ce7bb7ffed2a2b6687e68c34a8b3553d74d19dde2957a03fc2"}
Sep 16 14:43:02.129137 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:02.129116    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl" event={"ID":"eb29c6b3-1025-458d-84ba-ff650263d805","Type":"ContainerStarted","Data":"6ac5faacdfb6038647fe4bbf24d7499f2b8f06b9d429630d51e4cf3037e3e690"}
Sep 16 14:43:03.135613 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:03.135582    2569 generic.go:356] "Generic (PLEG): container finished" podID="eb29c6b3-1025-458d-84ba-ff650263d805" containerID="6ac5faacdfb6038647fe4bbf24d7499f2b8f06b9d429630d51e4cf3037e3e690" exitCode=0
Sep 16 14:43:03.136075 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:03.135675    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl" event={"ID":"eb29c6b3-1025-458d-84ba-ff650263d805","Type":"ContainerDied","Data":"6ac5faacdfb6038647fe4bbf24d7499f2b8f06b9d429630d51e4cf3037e3e690"}
Sep 16 14:43:03.137981 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:03.137953    2569 generic.go:356] "Generic (PLEG): container finished" podID="c810c238-9f97-4b3c-83ef-45fa06cce53a" containerID="e0242ecc6c0539966d435ada621388ff43fbfc241038e263a469e8edb691ec71" exitCode=0
Sep 16 14:43:03.138095 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:03.138022    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2" event={"ID":"c810c238-9f97-4b3c-83ef-45fa06cce53a","Type":"ContainerDied","Data":"e0242ecc6c0539966d435ada621388ff43fbfc241038e263a469e8edb691ec71"}
Sep 16 14:43:03.139960 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:03.139940    2569 generic.go:356] "Generic (PLEG): container finished" podID="7361e605-1c9d-417b-a7f5-9a9809d9e8a4" containerID="89a4736b257fd4a1e5f5968dde3649610c81f6b17c08a596b0f3b317bcf7724d" exitCode=0
Sep 16 14:43:03.140041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:03.140021    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2" event={"ID":"7361e605-1c9d-417b-a7f5-9a9809d9e8a4","Type":"ContainerDied","Data":"89a4736b257fd4a1e5f5968dde3649610c81f6b17c08a596b0f3b317bcf7724d"}
Sep 16 14:43:04.147919 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.147880    2569 generic.go:356] "Generic (PLEG): container finished" podID="eb29c6b3-1025-458d-84ba-ff650263d805" containerID="fbe9ef41063628cac4d315bc27016ff078cd5f6768f0c027ee05d5b08c6259ec" exitCode=0
Sep 16 14:43:04.148342 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.147964    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl" event={"ID":"eb29c6b3-1025-458d-84ba-ff650263d805","Type":"ContainerDied","Data":"fbe9ef41063628cac4d315bc27016ff078cd5f6768f0c027ee05d5b08c6259ec"}
Sep 16 14:43:04.150087 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.150066    2569 generic.go:356] "Generic (PLEG): container finished" podID="7361e605-1c9d-417b-a7f5-9a9809d9e8a4" containerID="fbec7560f2bfbe41e81defa8015b5b03512a8c624bddf19917c55964247b06aa" exitCode=0
Sep 16 14:43:04.150238 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.150209    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2" event={"ID":"7361e605-1c9d-417b-a7f5-9a9809d9e8a4","Type":"ContainerDied","Data":"fbec7560f2bfbe41e81defa8015b5b03512a8c624bddf19917c55964247b06aa"}
Sep 16 14:43:04.280029 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.279998    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:43:04.352151 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.352113    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c810c238-9f97-4b3c-83ef-45fa06cce53a-util\") pod \"c810c238-9f97-4b3c-83ef-45fa06cce53a\" (UID: \"c810c238-9f97-4b3c-83ef-45fa06cce53a\") "
Sep 16 14:43:04.352378 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.352184    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzfbw\" (UniqueName: \"kubernetes.io/projected/c810c238-9f97-4b3c-83ef-45fa06cce53a-kube-api-access-nzfbw\") pod \"c810c238-9f97-4b3c-83ef-45fa06cce53a\" (UID: \"c810c238-9f97-4b3c-83ef-45fa06cce53a\") "
Sep 16 14:43:04.352378 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.352218    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c810c238-9f97-4b3c-83ef-45fa06cce53a-bundle\") pod \"c810c238-9f97-4b3c-83ef-45fa06cce53a\" (UID: \"c810c238-9f97-4b3c-83ef-45fa06cce53a\") "
Sep 16 14:43:04.352788 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.352763    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c810c238-9f97-4b3c-83ef-45fa06cce53a-bundle" (OuterVolumeSpecName: "bundle") pod "c810c238-9f97-4b3c-83ef-45fa06cce53a" (UID: "c810c238-9f97-4b3c-83ef-45fa06cce53a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:43:04.354353 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.354316    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c810c238-9f97-4b3c-83ef-45fa06cce53a-kube-api-access-nzfbw" (OuterVolumeSpecName: "kube-api-access-nzfbw") pod "c810c238-9f97-4b3c-83ef-45fa06cce53a" (UID: "c810c238-9f97-4b3c-83ef-45fa06cce53a"). InnerVolumeSpecName "kube-api-access-nzfbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:43:04.358349 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.358310    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c810c238-9f97-4b3c-83ef-45fa06cce53a-util" (OuterVolumeSpecName: "util") pod "c810c238-9f97-4b3c-83ef-45fa06cce53a" (UID: "c810c238-9f97-4b3c-83ef-45fa06cce53a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:43:04.453775 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.453691    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c810c238-9f97-4b3c-83ef-45fa06cce53a-bundle\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:43:04.453775 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.453724    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c810c238-9f97-4b3c-83ef-45fa06cce53a-util\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:43:04.453775 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:04.453734    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzfbw\" (UniqueName: \"kubernetes.io/projected/c810c238-9f97-4b3c-83ef-45fa06cce53a-kube-api-access-nzfbw\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:43:05.157503 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.157461    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2"
Sep 16 14:43:05.157992 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.157520    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj49s2" event={"ID":"c810c238-9f97-4b3c-83ef-45fa06cce53a","Type":"ContainerDied","Data":"f2517ec5b8fe6aeeb8087ecfa63ca5bc091d2151cffd4afbe1c7c3e5fd05f9e8"}
Sep 16 14:43:05.157992 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.157576    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2517ec5b8fe6aeeb8087ecfa63ca5bc091d2151cffd4afbe1c7c3e5fd05f9e8"
Sep 16 14:43:05.295860 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.295831    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:43:05.334644 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.334615    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:43:05.463788 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.463696    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99dxx\" (UniqueName: \"kubernetes.io/projected/eb29c6b3-1025-458d-84ba-ff650263d805-kube-api-access-99dxx\") pod \"eb29c6b3-1025-458d-84ba-ff650263d805\" (UID: \"eb29c6b3-1025-458d-84ba-ff650263d805\") "
Sep 16 14:43:05.463788 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.463761    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb29c6b3-1025-458d-84ba-ff650263d805-bundle\") pod \"eb29c6b3-1025-458d-84ba-ff650263d805\" (UID: \"eb29c6b3-1025-458d-84ba-ff650263d805\") "
Sep 16 14:43:05.463788 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.463780    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9nlh\" (UniqueName: \"kubernetes.io/projected/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-kube-api-access-k9nlh\") pod \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\" (UID: \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\") "
Sep 16 14:43:05.464006 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.463832    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb29c6b3-1025-458d-84ba-ff650263d805-util\") pod \"eb29c6b3-1025-458d-84ba-ff650263d805\" (UID: \"eb29c6b3-1025-458d-84ba-ff650263d805\") "
Sep 16 14:43:05.464006 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.463882    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-bundle\") pod \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\" (UID: \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\") "
Sep 16 14:43:05.464006 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.463898    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-util\") pod \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\" (UID: \"7361e605-1c9d-417b-a7f5-9a9809d9e8a4\") "
Sep 16 14:43:05.464286 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.464256    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb29c6b3-1025-458d-84ba-ff650263d805-bundle" (OuterVolumeSpecName: "bundle") pod "eb29c6b3-1025-458d-84ba-ff650263d805" (UID: "eb29c6b3-1025-458d-84ba-ff650263d805"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:43:05.464470 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.464426    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-bundle" (OuterVolumeSpecName: "bundle") pod "7361e605-1c9d-417b-a7f5-9a9809d9e8a4" (UID: "7361e605-1c9d-417b-a7f5-9a9809d9e8a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:43:05.466032 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.466003    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb29c6b3-1025-458d-84ba-ff650263d805-kube-api-access-99dxx" (OuterVolumeSpecName: "kube-api-access-99dxx") pod "eb29c6b3-1025-458d-84ba-ff650263d805" (UID: "eb29c6b3-1025-458d-84ba-ff650263d805"). InnerVolumeSpecName "kube-api-access-99dxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:43:05.466372 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.466348    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-kube-api-access-k9nlh" (OuterVolumeSpecName: "kube-api-access-k9nlh") pod "7361e605-1c9d-417b-a7f5-9a9809d9e8a4" (UID: "7361e605-1c9d-417b-a7f5-9a9809d9e8a4"). InnerVolumeSpecName "kube-api-access-k9nlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:43:05.469953 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.469906    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb29c6b3-1025-458d-84ba-ff650263d805-util" (OuterVolumeSpecName: "util") pod "eb29c6b3-1025-458d-84ba-ff650263d805" (UID: "eb29c6b3-1025-458d-84ba-ff650263d805"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:43:05.470264 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.470243    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-util" (OuterVolumeSpecName: "util") pod "7361e605-1c9d-417b-a7f5-9a9809d9e8a4" (UID: "7361e605-1c9d-417b-a7f5-9a9809d9e8a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:43:05.565600 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.565556    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb29c6b3-1025-458d-84ba-ff650263d805-util\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:43:05.565600 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.565591    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-bundle\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:43:05.565600 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.565601    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-util\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:43:05.565600 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.565610    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99dxx\" (UniqueName: \"kubernetes.io/projected/eb29c6b3-1025-458d-84ba-ff650263d805-kube-api-access-99dxx\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:43:05.565855 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.565621    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb29c6b3-1025-458d-84ba-ff650263d805-bundle\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:43:05.565855 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:05.565630    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9nlh\" (UniqueName: \"kubernetes.io/projected/7361e605-1c9d-417b-a7f5-9a9809d9e8a4-kube-api-access-k9nlh\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:43:06.164083 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:06.164048    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl"
Sep 16 14:43:06.164083 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:06.164048    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65xmpl" event={"ID":"eb29c6b3-1025-458d-84ba-ff650263d805","Type":"ContainerDied","Data":"ef356955b3791d92f14ace5a0ce052f8a802a14b9ba3ff4b9d7711d2be566647"}
Sep 16 14:43:06.164612 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:06.164113    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef356955b3791d92f14ace5a0ce052f8a802a14b9ba3ff4b9d7711d2be566647"
Sep 16 14:43:06.166244 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:06.166221    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2"
Sep 16 14:43:06.166583 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:06.166229    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lspm2" event={"ID":"7361e605-1c9d-417b-a7f5-9a9809d9e8a4","Type":"ContainerDied","Data":"a91cf41327da2f68031b76fb9510c3476fd7796e60f9533ac7f073a13f4ec1e7"}
Sep 16 14:43:06.166670 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:06.166605    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a91cf41327da2f68031b76fb9510c3476fd7796e60f9533ac7f073a13f4ec1e7"
Sep 16 14:43:12.198798 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:12.198761    2569 generic.go:356] "Generic (PLEG): container finished" podID="236dee70-fe2b-4d5c-a5db-7d25c39f972e" containerID="4fcdf8b63c5a08a03d32d3fdd3762853b4dd9cbe6d8d7464b17965c3fb6b687f" exitCode=0
Sep 16 14:43:12.199141 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:12.198823    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556" event={"ID":"236dee70-fe2b-4d5c-a5db-7d25c39f972e","Type":"ContainerDied","Data":"4fcdf8b63c5a08a03d32d3fdd3762853b4dd9cbe6d8d7464b17965c3fb6b687f"}
Sep 16 14:43:13.206322 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:13.206280    2569 generic.go:356] "Generic (PLEG): container finished" podID="236dee70-fe2b-4d5c-a5db-7d25c39f972e" containerID="603c1e7fac7335665b18e0b7ce10697ba73a767d0cb466d69f4ae4950ed711fe" exitCode=0
Sep 16 14:43:13.206778 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:13.206363    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556" event={"ID":"236dee70-fe2b-4d5c-a5db-7d25c39f972e","Type":"ContainerDied","Data":"603c1e7fac7335665b18e0b7ce10697ba73a767d0cb466d69f4ae4950ed711fe"}
Sep 16 14:43:14.331861 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:14.331832    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:14.448905 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:14.448871    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2g2cv\" (UniqueName: \"kubernetes.io/projected/236dee70-fe2b-4d5c-a5db-7d25c39f972e-kube-api-access-2g2cv\") pod \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\" (UID: \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\") "
Sep 16 14:43:14.449076 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:14.448974    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/236dee70-fe2b-4d5c-a5db-7d25c39f972e-util\") pod \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\" (UID: \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\") "
Sep 16 14:43:14.449076 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:14.449000    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/236dee70-fe2b-4d5c-a5db-7d25c39f972e-bundle\") pod \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\" (UID: \"236dee70-fe2b-4d5c-a5db-7d25c39f972e\") "
Sep 16 14:43:14.449706 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:14.449676    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/236dee70-fe2b-4d5c-a5db-7d25c39f972e-bundle" (OuterVolumeSpecName: "bundle") pod "236dee70-fe2b-4d5c-a5db-7d25c39f972e" (UID: "236dee70-fe2b-4d5c-a5db-7d25c39f972e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:43:14.451000 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:14.450976    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/236dee70-fe2b-4d5c-a5db-7d25c39f972e-kube-api-access-2g2cv" (OuterVolumeSpecName: "kube-api-access-2g2cv") pod "236dee70-fe2b-4d5c-a5db-7d25c39f972e" (UID: "236dee70-fe2b-4d5c-a5db-7d25c39f972e"). InnerVolumeSpecName "kube-api-access-2g2cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:43:14.453347 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:14.453323    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/236dee70-fe2b-4d5c-a5db-7d25c39f972e-util" (OuterVolumeSpecName: "util") pod "236dee70-fe2b-4d5c-a5db-7d25c39f972e" (UID: "236dee70-fe2b-4d5c-a5db-7d25c39f972e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:43:14.550478 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:14.550441    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/236dee70-fe2b-4d5c-a5db-7d25c39f972e-util\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:43:14.550478 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:14.550472    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/236dee70-fe2b-4d5c-a5db-7d25c39f972e-bundle\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:43:14.550478 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:14.550484    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2g2cv\" (UniqueName: \"kubernetes.io/projected/236dee70-fe2b-4d5c-a5db-7d25c39f972e-kube-api-access-2g2cv\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:43:15.218286 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:15.218251    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556"
Sep 16 14:43:15.218452 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:15.218289    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aww556" event={"ID":"236dee70-fe2b-4d5c-a5db-7d25c39f972e","Type":"ContainerDied","Data":"6d00344cbdad088eda50deb03bfcfc88c2cd45484a3536493f25c5ded95bcd86"}
Sep 16 14:43:15.218452 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:43:15.218336    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d00344cbdad088eda50deb03bfcfc88c2cd45484a3536493f25c5ded95bcd86"
Sep 16 14:44:17.478962 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.478924    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"]
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479307    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb29c6b3-1025-458d-84ba-ff650263d805" containerName="pull"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479324    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb29c6b3-1025-458d-84ba-ff650263d805" containerName="pull"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479351    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7361e605-1c9d-417b-a7f5-9a9809d9e8a4" containerName="pull"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479360    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7361e605-1c9d-417b-a7f5-9a9809d9e8a4" containerName="pull"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479373    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c810c238-9f97-4b3c-83ef-45fa06cce53a" containerName="util"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479383    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c810c238-9f97-4b3c-83ef-45fa06cce53a" containerName="util"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479402    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb29c6b3-1025-458d-84ba-ff650263d805" containerName="util"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479410    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb29c6b3-1025-458d-84ba-ff650263d805" containerName="util"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479425    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="236dee70-fe2b-4d5c-a5db-7d25c39f972e" containerName="pull"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479432    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="236dee70-fe2b-4d5c-a5db-7d25c39f972e" containerName="pull"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479439    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="236dee70-fe2b-4d5c-a5db-7d25c39f972e" containerName="util"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479444    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="236dee70-fe2b-4d5c-a5db-7d25c39f972e" containerName="util"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479452    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c810c238-9f97-4b3c-83ef-45fa06cce53a" containerName="pull"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479457    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c810c238-9f97-4b3c-83ef-45fa06cce53a" containerName="pull"
Sep 16 14:44:17.479453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479465    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7361e605-1c9d-417b-a7f5-9a9809d9e8a4" containerName="util"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479472    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7361e605-1c9d-417b-a7f5-9a9809d9e8a4" containerName="util"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479481    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c810c238-9f97-4b3c-83ef-45fa06cce53a" containerName="extract"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479486    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c810c238-9f97-4b3c-83ef-45fa06cce53a" containerName="extract"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479511    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="236dee70-fe2b-4d5c-a5db-7d25c39f972e" containerName="extract"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479518    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="236dee70-fe2b-4d5c-a5db-7d25c39f972e" containerName="extract"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479527    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb29c6b3-1025-458d-84ba-ff650263d805" containerName="extract"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479532    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb29c6b3-1025-458d-84ba-ff650263d805" containerName="extract"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479540    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7361e605-1c9d-417b-a7f5-9a9809d9e8a4" containerName="extract"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479546    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7361e605-1c9d-417b-a7f5-9a9809d9e8a4" containerName="extract"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479638    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7361e605-1c9d-417b-a7f5-9a9809d9e8a4" containerName="extract"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479655    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c810c238-9f97-4b3c-83ef-45fa06cce53a" containerName="extract"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479663    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="236dee70-fe2b-4d5c-a5db-7d25c39f972e" containerName="extract"
Sep 16 14:44:17.480062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.479672    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb29c6b3-1025-458d-84ba-ff650263d805" containerName="extract"
Sep 16 14:44:17.482688 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.482666    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.484987 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.484960    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-c9p7m\""
Sep 16 14:44:17.496095 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.496069    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"]
Sep 16 14:44:17.570647 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.570606    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.570647 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.570651    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23e957f-3cd1-488e-8180-cc79722a6969-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.570867 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.570676    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.570867 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.570718    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23e957f-3cd1-488e-8180-cc79722a6969-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.570867 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.570745    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23e957f-3cd1-488e-8180-cc79722a6969-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.570867 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.570806    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.571022 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.570864    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.571022 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.570893    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28kz4\" (UniqueName: \"kubernetes.io/projected/c23e957f-3cd1-488e-8180-cc79722a6969-kube-api-access-28kz4\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.571022 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.570933    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.671383 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.671333    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28kz4\" (UniqueName: \"kubernetes.io/projected/c23e957f-3cd1-488e-8180-cc79722a6969-kube-api-access-28kz4\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.671591 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.671393    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.671591 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.671427    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.671591 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.671457    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23e957f-3cd1-488e-8180-cc79722a6969-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.671591 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.671520    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.671591 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.671562    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23e957f-3cd1-488e-8180-cc79722a6969-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.671862 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.671607    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23e957f-3cd1-488e-8180-cc79722a6969-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.671862 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.671659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.671862 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.671690    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.672021 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.671898    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.672097 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.672071    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.672145 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.672095    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.672145 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.672121    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.672460 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.672441    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23e957f-3cd1-488e-8180-cc79722a6969-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.673935 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.673914    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23e957f-3cd1-488e-8180-cc79722a6969-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.674139 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.674121    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23e957f-3cd1-488e-8180-cc79722a6969-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.679698 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.679671    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23e957f-3cd1-488e-8180-cc79722a6969-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.679821 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.679805    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28kz4\" (UniqueName: \"kubernetes.io/projected/c23e957f-3cd1-488e-8180-cc79722a6969-kube-api-access-28kz4\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s4dvn\" (UID: \"c23e957f-3cd1-488e-8180-cc79722a6969\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:17.793217 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:17.793180    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:18.078089 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:18.078061    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"]
Sep 16 14:44:18.079666 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:44:18.079640    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23e957f_3cd1_488e_8180_cc79722a6969.slice/crio-68f424d3f13f70b1a412381670ae9886d10742e096619d14a0681a11c77146f2 WatchSource:0}: Error finding container 68f424d3f13f70b1a412381670ae9886d10742e096619d14a0681a11c77146f2: Status 404 returned error can't find the container with id 68f424d3f13f70b1a412381670ae9886d10742e096619d14a0681a11c77146f2
Sep 16 14:44:18.082201 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:18.082164    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:44:18.082283 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:18.082248    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:44:18.082325 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:18.082290    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:44:18.539955 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:18.539908    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn" event={"ID":"c23e957f-3cd1-488e-8180-cc79722a6969","Type":"ContainerStarted","Data":"9086332a493c2e72597f9aa469d5eb54316e7038c17d3cbe4edbd33002b8446b"}
Sep 16 14:44:18.540332 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:18.539963    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn" event={"ID":"c23e957f-3cd1-488e-8180-cc79722a6969","Type":"ContainerStarted","Data":"68f424d3f13f70b1a412381670ae9886d10742e096619d14a0681a11c77146f2"}
Sep 16 14:44:18.561327 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:18.561276    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn" podStartSLOduration=1.5612570799999999 podStartE2EDuration="1.56125708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:44:18.558987276 +0000 UTC m=+532.910268978" watchObservedRunningTime="2026-09-16 14:44:18.56125708 +0000 UTC m=+532.912538858"
Sep 16 14:44:18.793439 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:18.793350    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:19.799306 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:19.799275    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:20.550388 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:20.550357    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:44:20.551347 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:44:20.551326    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:45:26.042427 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:26.042394    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 14:45:26.045797 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:26.045769    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 14:45:53.055715 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.055620    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"]
Sep 16 14:45:53.059090 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.059068    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.062264 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.062233    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2cp94\""
Sep 16 14:45:53.062264 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.062233    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 16 14:45:53.062529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.062282    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 14:45:53.062529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.062234    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 14:45:53.062529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.062266    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 14:45:53.072338 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.072309    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"]
Sep 16 14:45:53.190385 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.190314    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-maas-api-tls\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.190385 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.190395    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61808775-bacb-4c48-8ca0-31306ce2141c-openshift-service-ca\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.190714 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.190451    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9rgt\" (UniqueName: \"kubernetes.io/projected/61808775-bacb-4c48-8ca0-31306ce2141c-kube-api-access-j9rgt\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.190714 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.190587    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-metrics-certs\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.291677 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.291639    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9rgt\" (UniqueName: \"kubernetes.io/projected/61808775-bacb-4c48-8ca0-31306ce2141c-kube-api-access-j9rgt\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.291884 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.291750    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-metrics-certs\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.291884 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.291791    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-maas-api-tls\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.291884 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.291832    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61808775-bacb-4c48-8ca0-31306ce2141c-openshift-service-ca\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.292652 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:45:53.292626    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 16 14:45:53.292840 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:45:53.292826    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-maas-api-tls podName:61808775-bacb-4c48-8ca0-31306ce2141c nodeName:}" failed. No retries permitted until 2026-09-16 14:45:53.792805571 +0000 UTC m=+628.144087264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-maas-api-tls") pod "maas-api-5665c7f4f4-9df6q" (UID: "61808775-bacb-4c48-8ca0-31306ce2141c") : secret "maas-api-serving-cert" not found
Sep 16 14:45:53.292968 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.292658    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61808775-bacb-4c48-8ca0-31306ce2141c-openshift-service-ca\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.295276 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.295247    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-metrics-certs\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.304475 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.304415    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9rgt\" (UniqueName: \"kubernetes.io/projected/61808775-bacb-4c48-8ca0-31306ce2141c-kube-api-access-j9rgt\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.796046 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.796010    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-maas-api-tls\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.798391 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.798362    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-maas-api-tls\") pod \"maas-api-5665c7f4f4-9df6q\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:53.970381 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:53.970344    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:54.287310 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:54.287274    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"]
Sep 16 14:45:54.289354 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:45:54.289326    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61808775_bacb_4c48_8ca0_31306ce2141c.slice/crio-599e058555256424fa5cd5fd9fda61cfa3ed85bf0a2f828446db7e1132a1cd29 WatchSource:0}: Error finding container 599e058555256424fa5cd5fd9fda61cfa3ed85bf0a2f828446db7e1132a1cd29: Status 404 returned error can't find the container with id 599e058555256424fa5cd5fd9fda61cfa3ed85bf0a2f828446db7e1132a1cd29
Sep 16 14:45:54.290662 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:54.290643    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:45:55.076357 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:55.076308    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q" event={"ID":"61808775-bacb-4c48-8ca0-31306ce2141c","Type":"ContainerStarted","Data":"599e058555256424fa5cd5fd9fda61cfa3ed85bf0a2f828446db7e1132a1cd29"}
Sep 16 14:45:58.101249 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:58.101214    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q" event={"ID":"61808775-bacb-4c48-8ca0-31306ce2141c","Type":"ContainerStarted","Data":"6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9"}
Sep 16 14:45:58.101696 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:58.101308    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:45:58.120069 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:45:58.119988    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q" podStartSLOduration=2.204319547 podStartE2EDuration="5.119969194s" totalImagesPullingTime="2.915649647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:45:58.118630059 +0000 UTC m=+632.469911769" watchObservedRunningTime="2026-09-16 14:45:58.119969194 +0000 UTC m=+632.471250902"
Sep 16 14:46:03.133364 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:03.133329    2569 generic.go:356] "Generic (PLEG): container finished" podID="c23e957f-3cd1-488e-8180-cc79722a6969" containerID="9086332a493c2e72597f9aa469d5eb54316e7038c17d3cbe4edbd33002b8446b" exitCode=0
Sep 16 14:46:03.133821 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:03.133414    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn" event={"ID":"c23e957f-3cd1-488e-8180-cc79722a6969","Type":"ContainerDied","Data":"9086332a493c2e72597f9aa469d5eb54316e7038c17d3cbe4edbd33002b8446b"}
Sep 16 14:46:03.133879 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:03.133864    2569 scope.go:117] "RemoveContainer" containerID="9086332a493c2e72597f9aa469d5eb54316e7038c17d3cbe4edbd33002b8446b"
Sep 16 14:46:03.135034 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:03.135006    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:46:03.135109 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:03.135092    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:46:03.135158 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:03.135144    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:46:04.112099 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:04.112066    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 14:46:04.146679 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:04.146614    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn" event={"ID":"c23e957f-3cd1-488e-8180-cc79722a6969","Type":"ContainerStarted","Data":"d196e9920f51b03821e8701c48362e27f052fc2127be684695fcb322fd268983"}
Sep 16 14:46:04.794166 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:04.794127    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:46:04.795280 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:04.795252    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s4dvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 14:46:04.795406 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:04.795299    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn" podUID="c23e957f-3cd1-488e-8180-cc79722a6969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 14:46:05.551370 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:05.551316    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:46:05.794481 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:05.794442    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s4dvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 14:46:05.794661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:05.794526    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn" podUID="c23e957f-3cd1-488e-8180-cc79722a6969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 14:46:06.794310 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:06.794270    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s4dvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 14:46:06.794733 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:06.794348    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn" podUID="c23e957f-3cd1-488e-8180-cc79722a6969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 14:46:07.794208 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:07.794165    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s4dvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 14:46:07.794383 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:07.794236    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn" podUID="c23e957f-3cd1-488e-8180-cc79722a6969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 14:46:08.794024 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:08.793978    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s4dvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 14:46:08.794250 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:08.794050    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn" podUID="c23e957f-3cd1-488e-8180-cc79722a6969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 14:46:09.797858 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:09.797821    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:46:09.798981 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:09.798957    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn"
Sep 16 14:46:41.609883 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.609835    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"]
Sep 16 14:46:41.613539 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.613518    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.615950 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.615925    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-znlj6\""
Sep 16 14:46:41.616816 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.616789    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 16 14:46:41.616924 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.616867    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 14:46:41.616924 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.616870    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 14:46:41.625053 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.625024    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"]
Sep 16 14:46:41.759740 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.759700    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.759740 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.759745    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hrhj\" (UniqueName: \"kubernetes.io/projected/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-kube-api-access-2hrhj\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.759973 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.759771    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.759973 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.759878    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.759973 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.759914    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.760074 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.759977    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.861014 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.860920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.861014 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.861006    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.861229 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.861033    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hrhj\" (UniqueName: \"kubernetes.io/projected/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-kube-api-access-2hrhj\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.861229 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.861070    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.861229 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.861113    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.861229 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.861141    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.861517 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.861484    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.861592 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.861533    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.861592 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.861580    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.863519 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.863454    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.863652 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.863638    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.870197 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.870161    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hrhj\" (UniqueName: \"kubernetes.io/projected/a82bf5b8-1853-42c2-9f61-bad01c1ab88f-kube-api-access-2hrhj\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5\" (UID: \"a82bf5b8-1853-42c2-9f61-bad01c1ab88f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:41.925972 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:41.925927    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:42.207373 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:42.207346    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"]
Sep 16 14:46:42.209537 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:46:42.209508    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82bf5b8_1853_42c2_9f61_bad01c1ab88f.slice/crio-d8a2c1878549cc4878938bdfb4723c19656f47db1d74730e9cd6b61911d8eead WatchSource:0}: Error finding container d8a2c1878549cc4878938bdfb4723c19656f47db1d74730e9cd6b61911d8eead: Status 404 returned error can't find the container with id d8a2c1878549cc4878938bdfb4723c19656f47db1d74730e9cd6b61911d8eead
Sep 16 14:46:42.351070 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:42.351032    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5" event={"ID":"a82bf5b8-1853-42c2-9f61-bad01c1ab88f","Type":"ContainerStarted","Data":"d8a2c1878549cc4878938bdfb4723c19656f47db1d74730e9cd6b61911d8eead"}
Sep 16 14:46:43.360703 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:43.360665    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5" event={"ID":"a82bf5b8-1853-42c2-9f61-bad01c1ab88f","Type":"ContainerStarted","Data":"4d91a606136be1428fb723d179975dd6cf2e97f0835fc5a44f3fa9182fca4c24"}
Sep 16 14:46:43.378181 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:43.377258    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5" podStartSLOduration=1.303519906 podStartE2EDuration="2.377235288s" totalImagesPullingTime="1.073715382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:46:43.376641449 +0000 UTC m=+677.727923162" watchObservedRunningTime="2026-09-16 14:46:43.377235288 +0000 UTC m=+677.728516999"
Sep 16 14:46:51.927033 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:51.926990    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:51.927548 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:51.927057    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:51.939612 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:51.939583    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:46:52.419415 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:46:52.419387    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5"
Sep 16 14:47:08.014277 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.014239    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"]
Sep 16 14:47:08.017666 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.017647    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.019981 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.019958    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 16 14:47:08.029019 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.028996    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"]
Sep 16 14:47:08.089377 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.089343    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1668dd31-37ca-451a-b45f-74322aa0fa17-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.089550 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.089386    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1668dd31-37ca-451a-b45f-74322aa0fa17-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.089550 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.089445    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1668dd31-37ca-451a-b45f-74322aa0fa17-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.089550 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.089533    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1668dd31-37ca-451a-b45f-74322aa0fa17-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.089667 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.089556    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp989\" (UniqueName: \"kubernetes.io/projected/1668dd31-37ca-451a-b45f-74322aa0fa17-kube-api-access-mp989\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.089667 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.089580    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1668dd31-37ca-451a-b45f-74322aa0fa17-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.190705 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.190666    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1668dd31-37ca-451a-b45f-74322aa0fa17-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.190913 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.190739    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1668dd31-37ca-451a-b45f-74322aa0fa17-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.190913 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.190760    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp989\" (UniqueName: \"kubernetes.io/projected/1668dd31-37ca-451a-b45f-74322aa0fa17-kube-api-access-mp989\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.190913 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.190783    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1668dd31-37ca-451a-b45f-74322aa0fa17-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.190913 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.190825    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1668dd31-37ca-451a-b45f-74322aa0fa17-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.190913 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.190841    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1668dd31-37ca-451a-b45f-74322aa0fa17-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.191184 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.191152    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1668dd31-37ca-451a-b45f-74322aa0fa17-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.191230 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.191200    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1668dd31-37ca-451a-b45f-74322aa0fa17-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.191313 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.191282    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1668dd31-37ca-451a-b45f-74322aa0fa17-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.193141 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.193121    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1668dd31-37ca-451a-b45f-74322aa0fa17-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.193436 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.193415    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1668dd31-37ca-451a-b45f-74322aa0fa17-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.199557 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.199526    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp989\" (UniqueName: \"kubernetes.io/projected/1668dd31-37ca-451a-b45f-74322aa0fa17-kube-api-access-mp989\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9\" (UID: \"1668dd31-37ca-451a-b45f-74322aa0fa17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.328005 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.327911    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:08.598258 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:08.598227    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"]
Sep 16 14:47:08.599694 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:47:08.599666    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1668dd31_37ca_451a_b45f_74322aa0fa17.slice/crio-b852d5aea1de079c50ef9f5bdcf2d222eaf1f5596f581d65ec18f600fa21c857 WatchSource:0}: Error finding container b852d5aea1de079c50ef9f5bdcf2d222eaf1f5596f581d65ec18f600fa21c857: Status 404 returned error can't find the container with id b852d5aea1de079c50ef9f5bdcf2d222eaf1f5596f581d65ec18f600fa21c857
Sep 16 14:47:09.503641 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:09.503603    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9" event={"ID":"1668dd31-37ca-451a-b45f-74322aa0fa17","Type":"ContainerStarted","Data":"ae1664513bd2d0817d2aeb801d271831497bf5cb19bab1f85ead73e68d9ed1d0"}
Sep 16 14:47:09.504025 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:09.503671    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9" event={"ID":"1668dd31-37ca-451a-b45f-74322aa0fa17","Type":"ContainerStarted","Data":"b852d5aea1de079c50ef9f5bdcf2d222eaf1f5596f581d65ec18f600fa21c857"}
Sep 16 14:47:09.524061 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:09.524004    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9" podStartSLOduration=2.31406419 podStartE2EDuration="2.523985786s" totalImagesPullingTime="209.921596ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:47:09.521428266 +0000 UTC m=+703.872709974" watchObservedRunningTime="2026-09-16 14:47:09.523985786 +0000 UTC m=+703.875267494"
Sep 16 14:47:18.329059 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:18.329026    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:18.329581 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:18.329089    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:18.341459 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:18.341398    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:47:18.562759 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:47:18.562732    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9"
Sep 16 14:49:27.393783 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.393750    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"]
Sep 16 14:49:27.396991 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.396971    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.402908 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.402885    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-78e52a-openshift-default-dockercfg-t2jp7\""
Sep 16 14:49:27.427275 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.427250    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"]
Sep 16 14:49:27.427528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.427508    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-data\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.427593 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.427543    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-podinfo\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.427593 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.427566    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/026b604d-55ca-45db-9db8-4985cb9e51d2-istiod-ca-cert\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.427680 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.427606    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-token\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.427680 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.427652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-workload-socket\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.427766 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.427739    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-credential-socket\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.427818 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.427793    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-envoy\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.427898 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.427870    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-workload-certs\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.427963 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.427916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s744j\" (UniqueName: \"kubernetes.io/projected/026b604d-55ca-45db-9db8-4985cb9e51d2-kube-api-access-s744j\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.515937 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.515905    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"]
Sep 16 14:49:27.519566 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.519542    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.522416 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.522394    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-780e10-openshift-default-dockercfg-r5f5l\""
Sep 16 14:49:27.528420 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528394    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-workload-certs\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.528562 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528426    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s744j\" (UniqueName: \"kubernetes.io/projected/026b604d-55ca-45db-9db8-4985cb9e51d2-kube-api-access-s744j\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.528562 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528446    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-workload-socket\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.528562 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528466    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9b749f7-69c5-4e09-b284-0837723989a4-istio-token\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.528562 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528510    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-data\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.528783 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528579    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llvhj\" (UniqueName: \"kubernetes.io/projected/b9b749f7-69c5-4e09-b284-0837723989a4-kube-api-access-llvhj\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.528783 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-token\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.528783 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528666    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-workload-socket\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.528783 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9b749f7-69c5-4e09-b284-0837723989a4-istio-podinfo\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.528783 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528751    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-envoy\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.528783 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528781    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-workload-certs\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.529041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528804    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-istio-data\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.529041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528862    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-workload-certs\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.529041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528876    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-data\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.529041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528929    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/026b604d-55ca-45db-9db8-4985cb9e51d2-istiod-ca-cert\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.529041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528942    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-workload-socket\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.529041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528964    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-podinfo\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.529041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.528999    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-credential-socket\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.529041 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.529021    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-istio-envoy\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.529419 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.529061    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9b749f7-69c5-4e09-b284-0837723989a4-istiod-ca-cert\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.529419 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.529102    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-credential-socket\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.529419 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.529318    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-credential-socket\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.529581 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.529561    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/026b604d-55ca-45db-9db8-4985cb9e51d2-istiod-ca-cert\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.530886 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.530865    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-envoy\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.531176 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.531159    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-podinfo\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.544600 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.544578    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"]
Sep 16 14:49:27.563395 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.563368    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s744j\" (UniqueName: \"kubernetes.io/projected/026b604d-55ca-45db-9db8-4985cb9e51d2-kube-api-access-s744j\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.563892 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.563875    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-token\") pod \"e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") " pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.629979 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.629939    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9b749f7-69c5-4e09-b284-0837723989a4-istio-podinfo\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.630435 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.630407    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-workload-certs\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.630600 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.630442    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-istio-data\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.630600 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.630531    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-istio-envoy\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.630600 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.630572    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9b749f7-69c5-4e09-b284-0837723989a4-istiod-ca-cert\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.630776 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.630609    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-credential-socket\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.630776 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.630651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-workload-socket\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.630776 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.630686    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9b749f7-69c5-4e09-b284-0837723989a4-istio-token\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.630776 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.630731    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llvhj\" (UniqueName: \"kubernetes.io/projected/b9b749f7-69c5-4e09-b284-0837723989a4-kube-api-access-llvhj\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.630982 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.630863    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-workload-certs\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.630982 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.630889    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-istio-data\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.631147 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.631127    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-credential-socket\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.631320 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.631289    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-workload-socket\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.631992 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.631966    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9b749f7-69c5-4e09-b284-0837723989a4-istiod-ca-cert\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.632807 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.632788    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9b749f7-69c5-4e09-b284-0837723989a4-istio-podinfo\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.633329 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.633308    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-istio-envoy\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.641250 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.641227    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9b749f7-69c5-4e09-b284-0837723989a4-istio-token\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.655406 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.655338    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llvhj\" (UniqueName: \"kubernetes.io/projected/b9b749f7-69c5-4e09-b284-0837723989a4-kube-api-access-llvhj\") pod \"e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") " pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.655556 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.655538    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"]
Sep 16 14:49:27.665748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.665728    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.668084 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.668052    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-e33b3f-openshift-default-dockercfg-6f7cf\""
Sep 16 14:49:27.677926 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.677903    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"]
Sep 16 14:49:27.706984 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.706954    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:27.731315 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.731284    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km4nw\" (UniqueName: \"kubernetes.io/projected/234d76d0-12a4-4050-b591-f43afea59d0a-kube-api-access-km4nw\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.731466 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.731326    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-workload-certs\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.731466 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.731356    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/234d76d0-12a4-4050-b591-f43afea59d0a-istio-token\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.731614 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.731514    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-istio-data\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.731614 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.731562    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/234d76d0-12a4-4050-b591-f43afea59d0a-istiod-ca-cert\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.731739 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.731640    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-credential-socket\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.731739 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.731705    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-workload-socket\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.731739 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.731734    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/234d76d0-12a4-4050-b591-f43afea59d0a-istio-podinfo\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.731890 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.731765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-istio-envoy\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.830415 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.830384    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:27.832708 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.832686    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-istio-envoy\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.832805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.832737    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4nw\" (UniqueName: \"kubernetes.io/projected/234d76d0-12a4-4050-b591-f43afea59d0a-kube-api-access-km4nw\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.832805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.832769    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-workload-certs\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.832805 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.832794    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/234d76d0-12a4-4050-b591-f43afea59d0a-istio-token\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.833008 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.832839    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-istio-data\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.833008 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.832879    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/234d76d0-12a4-4050-b591-f43afea59d0a-istiod-ca-cert\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.833008 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.832929    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-credential-socket\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.833008 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.832972    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-workload-socket\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.833008 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.833004    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/234d76d0-12a4-4050-b591-f43afea59d0a-istio-podinfo\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.833722 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.833664    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/234d76d0-12a4-4050-b591-f43afea59d0a-istiod-ca-cert\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.833795 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.833716    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-workload-socket\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.833795 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.833715    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-workload-certs\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.833795 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.833782    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-istio-data\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.833903 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.833795    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-credential-socket\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.835573 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.835555    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-istio-envoy\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.835788 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.835771    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/234d76d0-12a4-4050-b591-f43afea59d0a-istio-podinfo\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.842862 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.842836    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km4nw\" (UniqueName: \"kubernetes.io/projected/234d76d0-12a4-4050-b591-f43afea59d0a-kube-api-access-km4nw\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.842955 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.842918    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/234d76d0-12a4-4050-b591-f43afea59d0a-istio-token\") pod \"e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") " pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.979561 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.979476    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:27.995914 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:27.995889    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"]
Sep 16 14:49:27.998241 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:49:27.998213    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod026b604d_55ca_45db_9db8_4985cb9e51d2.slice/crio-5dca436465a39ef107ee9c3bb05536654de32ff9e335e5b604c5c58cbfba62d8 WatchSource:0}: Error finding container 5dca436465a39ef107ee9c3bb05536654de32ff9e335e5b604c5c58cbfba62d8: Status 404 returned error can't find the container with id 5dca436465a39ef107ee9c3bb05536654de32ff9e335e5b604c5c58cbfba62d8
Sep 16 14:49:28.000563 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.000533    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:28.000652 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.000592    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:28.000652 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.000619    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:28.109146 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.109123    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"]
Sep 16 14:49:28.111516 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:49:28.111464    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b749f7_69c5_4e09_b284_0837723989a4.slice/crio-0e546747f422586cccafaf11a729856135e881540a8eff80cbe59caf0de5ad25 WatchSource:0}: Error finding container 0e546747f422586cccafaf11a729856135e881540a8eff80cbe59caf0de5ad25: Status 404 returned error can't find the container with id 0e546747f422586cccafaf11a729856135e881540a8eff80cbe59caf0de5ad25
Sep 16 14:49:28.113738 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.113709    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:28.113811 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.113777    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:28.113811 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.113804    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:28.236748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.236578    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" event={"ID":"026b604d-55ca-45db-9db8-4985cb9e51d2","Type":"ContainerStarted","Data":"1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee"}
Sep 16 14:49:28.236748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.236649    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" event={"ID":"026b604d-55ca-45db-9db8-4985cb9e51d2","Type":"ContainerStarted","Data":"5dca436465a39ef107ee9c3bb05536654de32ff9e335e5b604c5c58cbfba62d8"}
Sep 16 14:49:28.238840 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.238793    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" event={"ID":"b9b749f7-69c5-4e09-b284-0837723989a4","Type":"ContainerStarted","Data":"65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d"}
Sep 16 14:49:28.238958 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.238851    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" event={"ID":"b9b749f7-69c5-4e09-b284-0837723989a4","Type":"ContainerStarted","Data":"0e546747f422586cccafaf11a729856135e881540a8eff80cbe59caf0de5ad25"}
Sep 16 14:49:28.259362 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.259297    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" podStartSLOduration=1.259282786 podStartE2EDuration="1.259282786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:28.256231797 +0000 UTC m=+842.607513507" watchObservedRunningTime="2026-09-16 14:49:28.259282786 +0000 UTC m=+842.610564494"
Sep 16 14:49:28.263886 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.263785    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"]
Sep 16 14:49:28.266344 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:49:28.266320    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234d76d0_12a4_4050_b591_f43afea59d0a.slice/crio-35f30a340b82b74957514beeb9da617bb01c136f6bd265b518e7954632d4cebc WatchSource:0}: Error finding container 35f30a340b82b74957514beeb9da617bb01c136f6bd265b518e7954632d4cebc: Status 404 returned error can't find the container with id 35f30a340b82b74957514beeb9da617bb01c136f6bd265b518e7954632d4cebc
Sep 16 14:49:28.268927 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.268899    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:28.269008 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.268958    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:28.269008 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.268985    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:28.282062 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.279223    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" podStartSLOduration=1.279203404 podStartE2EDuration="1.279203404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:28.277328085 +0000 UTC m=+842.628609796" watchObservedRunningTime="2026-09-16 14:49:28.279203404 +0000 UTC m=+842.630485114"
Sep 16 14:49:28.707249 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.707216    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:28.830600 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:28.830564    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:29.246221 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:29.246182    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" event={"ID":"234d76d0-12a4-4050-b591-f43afea59d0a","Type":"ContainerStarted","Data":"08a3a4ab3e00dd81a1eb20e16471475e6613cad4a11a885ac51a2296536d3771"}
Sep 16 14:49:29.246409 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:29.246247    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" event={"ID":"234d76d0-12a4-4050-b591-f43afea59d0a","Type":"ContainerStarted","Data":"35f30a340b82b74957514beeb9da617bb01c136f6bd265b518e7954632d4cebc"}
Sep 16 14:49:29.272402 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:29.272354    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" podStartSLOduration=2.272339695 podStartE2EDuration="2.272339695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:29.268968291 +0000 UTC m=+843.620250000" watchObservedRunningTime="2026-09-16 14:49:29.272339695 +0000 UTC m=+843.623621406"
Sep 16 14:49:29.712842 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:29.712762    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:29.836223 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:29.836191    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:29.980136 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:29.980054    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:29.984966 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:29.984941    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:30.252661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:30.252621    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:30.253061 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:30.253028    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:30.253189 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:30.253085    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:30.253756 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:30.253736    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:30.253863 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:30.253787    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:30.253863 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:30.253821    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:35.007224 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.007192    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"]
Sep 16 14:49:35.011726 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.011703    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.013825 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.013805    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-e33b3f-serving-cert\""
Sep 16 14:49:35.024880 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.024851    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"]
Sep 16 14:49:35.105867 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.105835    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3de88bc-20a4-4125-9fe9-0dbf761f4039-maas-api-tls\") pod \"maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.106016 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.105884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92qp6\" (UniqueName: \"kubernetes.io/projected/a3de88bc-20a4-4125-9fe9-0dbf761f4039-kube-api-access-92qp6\") pod \"maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.106016 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.105907    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3de88bc-20a4-4125-9fe9-0dbf761f4039-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.106086 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.106020    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3de88bc-20a4-4125-9fe9-0dbf761f4039-metrics-certs\") pod \"maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.208032 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.207988    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3de88bc-20a4-4125-9fe9-0dbf761f4039-metrics-certs\") pod \"maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.208971 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.208928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3de88bc-20a4-4125-9fe9-0dbf761f4039-maas-api-tls\") pod \"maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.209115 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.209012    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92qp6\" (UniqueName: \"kubernetes.io/projected/a3de88bc-20a4-4125-9fe9-0dbf761f4039-kube-api-access-92qp6\") pod \"maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.209115 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.209050    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3de88bc-20a4-4125-9fe9-0dbf761f4039-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.209793 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.209769    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3de88bc-20a4-4125-9fe9-0dbf761f4039-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.217997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.215885    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3de88bc-20a4-4125-9fe9-0dbf761f4039-metrics-certs\") pod \"maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.218387 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.218363    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92qp6\" (UniqueName: \"kubernetes.io/projected/a3de88bc-20a4-4125-9fe9-0dbf761f4039-kube-api-access-92qp6\") pod \"maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.218474 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.218396    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3de88bc-20a4-4125-9fe9-0dbf761f4039-maas-api-tls\") pod \"maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.335982 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.335911    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:35.612134 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.612107    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"]
Sep 16 14:49:35.612814 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:49:35.612785    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3de88bc_20a4_4125_9fe9_0dbf761f4039.slice/crio-5de42af15d067d7bce88ee1e6350f14f8ec1f487def0813f532859230f7e5830 WatchSource:0}: Error finding container 5de42af15d067d7bce88ee1e6350f14f8ec1f487def0813f532859230f7e5830: Status 404 returned error can't find the container with id 5de42af15d067d7bce88ee1e6350f14f8ec1f487def0813f532859230f7e5830
Sep 16 14:49:35.979211 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.979139    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"]
Sep 16 14:49:35.984102 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.984079    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:35.990185 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:35.990163    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-bde531-openshift-default-dockercfg-v6nwg\""
Sep 16 14:49:36.004607 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.004581    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"]
Sep 16 14:49:36.017837 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.017813    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56534aad-d9fc-4c79-89eb-db666724948a-istio-token\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.018210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.017862    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-istio-data\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.018210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.017879    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56534aad-d9fc-4c79-89eb-db666724948a-istio-podinfo\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.018210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.017900    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-workload-socket\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.018210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.017935    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l42jm\" (UniqueName: \"kubernetes.io/projected/56534aad-d9fc-4c79-89eb-db666724948a-kube-api-access-l42jm\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.018210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.017951    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-credential-socket\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.018210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.017979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56534aad-d9fc-4c79-89eb-db666724948a-istiod-ca-cert\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.018210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.018011    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-workload-certs\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.018210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.018054    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-istio-envoy\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.119136 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.119104    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-istio-data\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.119327 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.119134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56534aad-d9fc-4c79-89eb-db666724948a-istio-podinfo\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.119327 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.119195    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-workload-socket\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.119327 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.119249    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l42jm\" (UniqueName: \"kubernetes.io/projected/56534aad-d9fc-4c79-89eb-db666724948a-kube-api-access-l42jm\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.119327 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.119277    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-credential-socket\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.119327 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.119313    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56534aad-d9fc-4c79-89eb-db666724948a-istiod-ca-cert\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.119630 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.119348    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-workload-certs\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.119630 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.119476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-istio-envoy\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.119630 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.119619    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56534aad-d9fc-4c79-89eb-db666724948a-istio-token\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.119760 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.119626    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-istio-data\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.119760 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.119639    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-workload-socket\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.119919 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.119896    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-workload-certs\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.120754 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.120729    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-credential-socket\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.120869 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.120789    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56534aad-d9fc-4c79-89eb-db666724948a-istiod-ca-cert\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.122173 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.122148    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56534aad-d9fc-4c79-89eb-db666724948a-istio-podinfo\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.122942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.122907    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-istio-envoy\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.127916 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.127895    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56534aad-d9fc-4c79-89eb-db666724948a-istio-token\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.128404 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.128386    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l42jm\" (UniqueName: \"kubernetes.io/projected/56534aad-d9fc-4c79-89eb-db666724948a-kube-api-access-l42jm\") pod \"e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") " pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.287894 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.287863    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb" event={"ID":"a3de88bc-20a4-4125-9fe9-0dbf761f4039","Type":"ContainerStarted","Data":"5de42af15d067d7bce88ee1e6350f14f8ec1f487def0813f532859230f7e5830"}
Sep 16 14:49:36.295250 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.295224    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:36.597036 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.597006    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"]
Sep 16 14:49:36.597209 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:49:36.597186    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56534aad_d9fc_4c79_89eb_db666724948a.slice/crio-2b9cd333f206ccbde8ebaafd99906a45a1484a53e7db84be363722747e979bd1 WatchSource:0}: Error finding container 2b9cd333f206ccbde8ebaafd99906a45a1484a53e7db84be363722747e979bd1: Status 404 returned error can't find the container with id 2b9cd333f206ccbde8ebaafd99906a45a1484a53e7db84be363722747e979bd1
Sep 16 14:49:36.599667 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.599628    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:36.599748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.599726    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:36.599786 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.599772    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:36.991056 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.991027    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"]
Sep 16 14:49:36.994531 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.994509    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:36.996934 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:36.996918    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0252b3a9-openshift-default-dockercfg-mvt6w\""
Sep 16 14:49:37.007589 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.007561    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"]
Sep 16 14:49:37.027433 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.027400    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-credential-socket\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.027777 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.027457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f093b865-d739-44be-a2ab-88610d13fdfc-istio-podinfo\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.027777 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.027509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-istio-data\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.027777 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.027565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hk8g\" (UniqueName: \"kubernetes.io/projected/f093b865-d739-44be-a2ab-88610d13fdfc-kube-api-access-2hk8g\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.027777 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.027635    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-workload-socket\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.027777 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.027730    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-istio-envoy\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.027777 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.027770    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f093b865-d739-44be-a2ab-88610d13fdfc-istio-token\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.028118 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.027795    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f093b865-d739-44be-a2ab-88610d13fdfc-istiod-ca-cert\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.028118 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.027922    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-workload-certs\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.129192 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.129158    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f093b865-d739-44be-a2ab-88610d13fdfc-istio-podinfo\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.129192 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.129200    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-istio-data\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.129460 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.129237    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hk8g\" (UniqueName: \"kubernetes.io/projected/f093b865-d739-44be-a2ab-88610d13fdfc-kube-api-access-2hk8g\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.129460 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.129260    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-workload-socket\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.129460 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.129298    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-istio-envoy\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.129460 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.129337    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f093b865-d739-44be-a2ab-88610d13fdfc-istio-token\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.129460 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.129363    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f093b865-d739-44be-a2ab-88610d13fdfc-istiod-ca-cert\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.129460 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.129427    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-workload-certs\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.129835 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.129468    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-credential-socket\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.129930 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.129899    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-workload-certs\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.130046 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.129932    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-credential-socket\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.130201 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.130183    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-istio-data\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.130283 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.130223    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-workload-socket\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.130854 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.130831    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f093b865-d739-44be-a2ab-88610d13fdfc-istiod-ca-cert\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.132377 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.132352    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-istio-envoy\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.132742 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.132723    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f093b865-d739-44be-a2ab-88610d13fdfc-istio-podinfo\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.136442 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.136419    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f093b865-d739-44be-a2ab-88610d13fdfc-istio-token\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.137117 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.137094    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hk8g\" (UniqueName: \"kubernetes.io/projected/f093b865-d739-44be-a2ab-88610d13fdfc-kube-api-access-2hk8g\") pod \"e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") " pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.296753 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.296668    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" event={"ID":"56534aad-d9fc-4c79-89eb-db666724948a","Type":"ContainerStarted","Data":"58d80e9d3ff78ef10863671dcb444cfcdc4a3f0fe8fbcb47bf9f42ba7a3df26f"}
Sep 16 14:49:37.296753 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.296730    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" event={"ID":"56534aad-d9fc-4c79-89eb-db666724948a","Type":"ContainerStarted","Data":"2b9cd333f206ccbde8ebaafd99906a45a1484a53e7db84be363722747e979bd1"}
Sep 16 14:49:37.304784 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.304763    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:37.321886 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.321837    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" podStartSLOduration=2.321820984 podStartE2EDuration="2.321820984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:37.315687617 +0000 UTC m=+851.666969327" watchObservedRunningTime="2026-09-16 14:49:37.321820984 +0000 UTC m=+851.673102687"
Sep 16 14:49:37.603369 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.591777    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"]
Sep 16 14:49:37.609326 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.608508    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:37.609326 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.608601    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:37.609326 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:37.608648    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:38.297969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:38.297931    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:38.314644 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:38.314579    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb" event={"ID":"a3de88bc-20a4-4125-9fe9-0dbf761f4039","Type":"ContainerStarted","Data":"3ccee06e40dfcdfd3f4772a9dab02f498091c8fabfdc579d9cea8c6360c51e19"}
Sep 16 14:49:38.315577 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:38.315535    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:38.316458 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:38.316443    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:38.316970 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:38.316936    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" event={"ID":"f093b865-d739-44be-a2ab-88610d13fdfc","Type":"ContainerStarted","Data":"ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc"}
Sep 16 14:49:38.317063 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:38.317003    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" event={"ID":"f093b865-d739-44be-a2ab-88610d13fdfc","Type":"ContainerStarted","Data":"fc335d03b1248599ee0e1273cb7e697fa6b7fc3887538f3051c6c06a41c47995"}
Sep 16 14:49:38.317587 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:38.317565    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:38.319148 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:38.319133    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:49:38.336661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:38.336612    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb" podStartSLOduration=2.24826711 podStartE2EDuration="4.336570778s" totalImagesPullingTime="2.088303668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:38.332814574 +0000 UTC m=+852.684096284" watchObservedRunningTime="2026-09-16 14:49:38.336570778 +0000 UTC m=+852.687852488"
Sep 16 14:49:38.378681 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:38.378619    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" podStartSLOduration=2.378596998 podStartE2EDuration="2.378596998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:38.377552979 +0000 UTC m=+852.728834691" watchObservedRunningTime="2026-09-16 14:49:38.378596998 +0000 UTC m=+852.729878719"
Sep 16 14:49:39.305665 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:39.305626    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:39.319254 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:39.318980    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:39.323582 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:39.323522    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:39.324518 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:39.324479    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:49:44.329420 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:44.329390    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 14:49:46.296335 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:46.296022    2569 patch_prober.go:28] interesting pod/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 14:49:46.296335 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:46.296102    2569 patch_prober.go:28] interesting pod/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 14:49:46.296335 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:46.296139    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 14:49:46.296335 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:46.296097    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 14:49:47.401723 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:47.401691    2569 generic.go:356] "Generic (PLEG): container finished" podID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerID="1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee" exitCode=0
Sep 16 14:49:47.402118 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:47.401763    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" event={"ID":"026b604d-55ca-45db-9db8-4985cb9e51d2","Type":"ContainerDied","Data":"1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee"}
Sep 16 14:49:47.402224 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:47.402209    2569 scope.go:117] "RemoveContainer" containerID="1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee"
Sep 16 14:49:47.403446 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:47.403418    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:47.403551 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:47.403486    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:47.403602 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:47.403575    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:48.410159 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:48.410123    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" event={"ID":"026b604d-55ca-45db-9db8-4985cb9e51d2","Type":"ContainerStarted","Data":"e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13"}
Sep 16 14:49:48.411690 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:48.411665    2569 generic.go:356] "Generic (PLEG): container finished" podID="b9b749f7-69c5-4e09-b284-0837723989a4" containerID="65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d" exitCode=0
Sep 16 14:49:48.411824 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:48.411740    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" event={"ID":"b9b749f7-69c5-4e09-b284-0837723989a4","Type":"ContainerDied","Data":"65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d"}
Sep 16 14:49:48.412145 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:48.412128    2569 scope.go:117] "RemoveContainer" containerID="65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d"
Sep 16 14:49:48.413229 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:48.413199    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:48.413323 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:48.413280    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:48.413380 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:48.413345    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:48.707872 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:48.707796    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:48.708172 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:48.708080    2569 patch_prober.go:28] interesting pod/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 16 14:49:48.708301 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:48.708284    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 16 14:49:49.418878 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:49.418835    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" event={"ID":"b9b749f7-69c5-4e09-b284-0837723989a4","Type":"ContainerStarted","Data":"48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d"}
Sep 16 14:49:49.707695 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:49.707586    2569 patch_prober.go:28] interesting pod/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 16 14:49:49.707695 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:49.707662    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 16 14:49:49.831591 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:49.831549    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:49.831801 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:49.831699    2569 patch_prober.go:28] interesting pod/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 14:49:49.831801 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:49.831764    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 14:49:50.707383 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:50.707352    2569 patch_prober.go:28] interesting pod/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 16 14:49:50.707876 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:50.707851    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 16 14:49:50.848515 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:50.839894    2569 patch_prober.go:28] interesting pod/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 14:49:50.848515 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:50.839957    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 14:49:51.707929 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:51.707422    2569 patch_prober.go:28] interesting pod/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 16 14:49:51.707929 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:51.707523    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 16 14:49:51.831723 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:51.831678    2569 patch_prober.go:28] interesting pod/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 14:49:51.831924 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:51.831749    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 14:49:52.708026 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:52.707975    2569 patch_prober.go:28] interesting pod/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 16 14:49:52.708582 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:52.708053    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 16 14:49:52.831138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:52.831088    2569 patch_prober.go:28] interesting pod/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 14:49:52.831341 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:52.831162    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 14:49:53.707720 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:53.707672    2569 patch_prober.go:28] interesting pod/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 16 14:49:53.707933 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:53.707744    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 16 14:49:53.834444 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:53.833940    2569 patch_prober.go:28] interesting pod/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 14:49:53.834444 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:53.834013    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 14:49:54.714888 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:54.714855    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:54.715461 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:54.715433    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:54.716161 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:54.716140    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:49:54.831733 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:54.831245    2569 patch_prober.go:28] interesting pod/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 14:49:54.831733 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:54.831310    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 14:49:55.829430 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:55.829377    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"]
Sep 16 14:49:55.896597 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:55.896552    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:55.896890 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:55.896647    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:55.897373 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:55.896861    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"]
Sep 16 14:49:55.897646 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:55.897625    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:55.898935 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:55.898914    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 14:49:55.900353 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:55.900334    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e689e5-openshift-default-dockercfg-s68ds\""
Sep 16 14:49:56.008135 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.008094    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-workload-socket\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.008442 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.008422    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d54b5284-549b-46b4-a55b-deff968e9787-istiod-ca-cert\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.008673 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.008651    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhtqb\" (UniqueName: \"kubernetes.io/projected/d54b5284-549b-46b4-a55b-deff968e9787-kube-api-access-xhtqb\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.009097 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.009080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-workload-certs\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.009288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.009271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-istio-envoy\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.009687 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.009650    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d54b5284-549b-46b4-a55b-deff968e9787-istio-podinfo\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.009899 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.009884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-istio-data\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.010623 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.010600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d54b5284-549b-46b4-a55b-deff968e9787-istio-token\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.010804 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.010788    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-credential-socket\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.112353 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.112266    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d54b5284-549b-46b4-a55b-deff968e9787-istio-token\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.112665 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.112639    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-credential-socket\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.112813 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.112799    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-workload-socket\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.112930 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.112916    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d54b5284-549b-46b4-a55b-deff968e9787-istiod-ca-cert\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.113076 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.113046    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-credential-socket\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.113142 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.113056    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhtqb\" (UniqueName: \"kubernetes.io/projected/d54b5284-549b-46b4-a55b-deff968e9787-kube-api-access-xhtqb\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.113206 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.113161    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-workload-certs\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.113265 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.113205    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-istio-envoy\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.113265 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.113240    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d54b5284-549b-46b4-a55b-deff968e9787-istio-podinfo\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.113382 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.113294    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-istio-data\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.113872 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.113656    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-istio-data\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.114575 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.114240    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-workload-certs\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.114575 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.114261    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-workload-socket\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.114575 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.114395    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d54b5284-549b-46b4-a55b-deff968e9787-istiod-ca-cert\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.116336 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.116302    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d54b5284-549b-46b4-a55b-deff968e9787-istio-podinfo\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.116960 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.116937    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-istio-envoy\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.122926 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.122890    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhtqb\" (UniqueName: \"kubernetes.io/projected/d54b5284-549b-46b4-a55b-deff968e9787-kube-api-access-xhtqb\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.123206 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.123187    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d54b5284-549b-46b4-a55b-deff968e9787-istio-token\") pod \"e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") " pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.210417 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.210377    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:56.544518 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.541765    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"]
Sep 16 14:49:56.563317 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.562586    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:56.563317 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.562679    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:56.563317 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:56.562724    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:57.494486 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:57.494454    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" event={"ID":"d54b5284-549b-46b4-a55b-deff968e9787","Type":"ContainerStarted","Data":"f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4"}
Sep 16 14:49:57.494991 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:57.494519    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" event={"ID":"d54b5284-549b-46b4-a55b-deff968e9787","Type":"ContainerStarted","Data":"aa6ea6e3319c83b7611833e924c52445e8bc3dc18d634c1166990bdafc81734c"}
Sep 16 14:49:57.496163 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:57.496140    2569 generic.go:356] "Generic (PLEG): container finished" podID="234d76d0-12a4-4050-b591-f43afea59d0a" containerID="08a3a4ab3e00dd81a1eb20e16471475e6613cad4a11a885ac51a2296536d3771" exitCode=0
Sep 16 14:49:57.496290 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:57.496216    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" event={"ID":"234d76d0-12a4-4050-b591-f43afea59d0a","Type":"ContainerDied","Data":"08a3a4ab3e00dd81a1eb20e16471475e6613cad4a11a885ac51a2296536d3771"}
Sep 16 14:49:57.496680 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:57.496653    2569 scope.go:117] "RemoveContainer" containerID="08a3a4ab3e00dd81a1eb20e16471475e6613cad4a11a885ac51a2296536d3771"
Sep 16 14:49:57.497656 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:57.497629    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:57.497728 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:57.497715    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:57.497771 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:57.497749    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:49:57.521203 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:57.521145    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" podStartSLOduration=2.521124613 podStartE2EDuration="2.521124613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:57.519208462 +0000 UTC m=+871.870490171" watchObservedRunningTime="2026-09-16 14:49:57.521124613 +0000 UTC m=+871.872406322"
Sep 16 14:49:58.211124 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:58.211028    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:58.216138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:58.216112    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:58.504443 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:58.504413    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" event={"ID":"234d76d0-12a4-4050-b591-f43afea59d0a","Type":"ContainerStarted","Data":"2d9c222246d06bd5a64b7746c169feb15fe06301ef1ec0ef60323acd2ca95e4e"}
Sep 16 14:49:58.504942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:58.504691    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:58.506222 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:58.506202    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:49:58.980623 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:58.980534    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:49:58.981819 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:58.981782    2569 patch_prober.go:28] interesting pod/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 16 14:49:58.981956 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:58.981850    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 16 14:49:59.980331 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:59.980296    2569 patch_prober.go:28] interesting pod/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 16 14:49:59.980740 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:49:59.980366    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 16 14:50:00.253416 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:00.253324    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:50:00.980126 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:00.980084    2569 patch_prober.go:28] interesting pod/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 16 14:50:00.980331 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:00.980169    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 16 14:50:01.980174 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:01.980093    2569 patch_prober.go:28] interesting pod/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 16 14:50:01.980174 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:01.980147    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 16 14:50:02.531615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:02.531570    2569 generic.go:356] "Generic (PLEG): container finished" podID="f093b865-d739-44be-a2ab-88610d13fdfc" containerID="ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc" exitCode=0
Sep 16 14:50:02.531816 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:02.531784    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" event={"ID":"f093b865-d739-44be-a2ab-88610d13fdfc","Type":"ContainerDied","Data":"ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc"}
Sep 16 14:50:02.532340 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:02.532312    2569 scope.go:117] "RemoveContainer" containerID="ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc"
Sep 16 14:50:02.534226 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:02.534181    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:50:02.534332 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:02.534309    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:50:02.534408 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:02.534367    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:50:02.980975 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:02.980887    2569 patch_prober.go:28] interesting pod/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 16 14:50:02.980975 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:02.980948    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 16 14:50:03.540166 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:03.540069    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" event={"ID":"f093b865-d739-44be-a2ab-88610d13fdfc","Type":"ContainerStarted","Data":"836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc"}
Sep 16 14:50:03.541748 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:03.541691    2569 generic.go:356] "Generic (PLEG): container finished" podID="56534aad-d9fc-4c79-89eb-db666724948a" containerID="58d80e9d3ff78ef10863671dcb444cfcdc4a3f0fe8fbcb47bf9f42ba7a3df26f" exitCode=0
Sep 16 14:50:03.541868 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:03.541761    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" event={"ID":"56534aad-d9fc-4c79-89eb-db666724948a","Type":"ContainerDied","Data":"58d80e9d3ff78ef10863671dcb444cfcdc4a3f0fe8fbcb47bf9f42ba7a3df26f"}
Sep 16 14:50:03.542188 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:03.542160    2569 scope.go:117] "RemoveContainer" containerID="58d80e9d3ff78ef10863671dcb444cfcdc4a3f0fe8fbcb47bf9f42ba7a3df26f"
Sep 16 14:50:03.543461 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:03.543414    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:50:03.543546 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:03.543524    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:50:03.543591 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:03.543558    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:50:03.984526 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:03.984422    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:50:03.985653 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:03.985630    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 14:50:04.305262 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:04.305219    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:50:04.305873 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:04.305832    2569 patch_prober.go:28] interesting pod/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 14:50:04.306006 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:04.305906    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 14:50:04.574011 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:04.568752    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" event={"ID":"56534aad-d9fc-4c79-89eb-db666724948a","Type":"ContainerStarted","Data":"2f67dfd05c3ebbe5a7a0655772effbfb07b440345abf7d4d01e1c82b28d380a7"}
Sep 16 14:50:05.296002 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:05.295966    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:50:05.297024 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:05.296987    2569 patch_prober.go:28] interesting pod/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 14:50:05.297110 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:05.297087    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 14:50:05.305773 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:05.305751    2569 patch_prober.go:28] interesting pod/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 14:50:05.305944 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:05.305925    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 14:50:06.295624 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:06.295590    2569 patch_prober.go:28] interesting pod/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 14:50:06.295815 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:06.295694    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 14:50:06.306086 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:06.306055    2569 patch_prober.go:28] interesting pod/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 14:50:06.306393 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:06.306102    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 14:50:07.296242 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:07.296203    2569 patch_prober.go:28] interesting pod/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 14:50:07.296519 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:07.296253    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 14:50:07.305808 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:07.305770    2569 patch_prober.go:28] interesting pod/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 14:50:07.305911 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:07.305823    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 14:50:08.308137 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:08.308082    2569 patch_prober.go:28] interesting pod/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 14:50:08.308631 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:08.308152    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 14:50:08.308905 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:08.308757    2569 patch_prober.go:28] interesting pod/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 14:50:08.308905 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:08.308793    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 14:50:08.318225 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:08.317591    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:50:08.320863 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:08.320841    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"]
Sep 16 14:50:08.321022 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:08.320990    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" containerName="istio-proxy" containerID="cri-o://836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc" gracePeriod=30
Sep 16 14:50:09.295868 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:09.295825    2569 patch_prober.go:28] interesting pod/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 14:50:09.296039 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:09.295902    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 14:50:09.323445 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:09.323413    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:50:10.300251 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:10.300219    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:50:10.301126 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:10.301108    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:50:14.606248 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.606218    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:50:14.658925 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.652299    2569 generic.go:356] "Generic (PLEG): container finished" podID="f093b865-d739-44be-a2ab-88610d13fdfc" containerID="836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc" exitCode=0
Sep 16 14:50:14.658925 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.652481    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" event={"ID":"f093b865-d739-44be-a2ab-88610d13fdfc","Type":"ContainerDied","Data":"836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc"}
Sep 16 14:50:14.658925 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.652554    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw" event={"ID":"f093b865-d739-44be-a2ab-88610d13fdfc","Type":"ContainerDied","Data":"fc335d03b1248599ee0e1273cb7e697fa6b7fc3887538f3051c6c06a41c47995"}
Sep 16 14:50:14.658925 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.652591    2569 scope.go:117] "RemoveContainer" containerID="836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc"
Sep 16 14:50:14.658925 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.652751    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"
Sep 16 14:50:14.663998 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.663970    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f093b865-d739-44be-a2ab-88610d13fdfc-istio-token\") pod \"f093b865-d739-44be-a2ab-88610d13fdfc\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") "
Sep 16 14:50:14.664129 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.664032    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-istio-data\") pod \"f093b865-d739-44be-a2ab-88610d13fdfc\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") "
Sep 16 14:50:14.664184 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.664149    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-workload-certs\") pod \"f093b865-d739-44be-a2ab-88610d13fdfc\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") "
Sep 16 14:50:14.664236 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.664193    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f093b865-d739-44be-a2ab-88610d13fdfc-istio-podinfo\") pod \"f093b865-d739-44be-a2ab-88610d13fdfc\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") "
Sep 16 14:50:14.664236 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.664225    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-istio-envoy\") pod \"f093b865-d739-44be-a2ab-88610d13fdfc\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") "
Sep 16 14:50:14.664339 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.664250    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-credential-socket\") pod \"f093b865-d739-44be-a2ab-88610d13fdfc\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") "
Sep 16 14:50:14.664395 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.664328    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-istio-data" (OuterVolumeSpecName: "istio-data") pod "f093b865-d739-44be-a2ab-88610d13fdfc" (UID: "f093b865-d739-44be-a2ab-88610d13fdfc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:50:14.664395 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.664376    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f093b865-d739-44be-a2ab-88610d13fdfc" (UID: "f093b865-d739-44be-a2ab-88610d13fdfc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:50:14.664669 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.664639    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f093b865-d739-44be-a2ab-88610d13fdfc" (UID: "f093b865-d739-44be-a2ab-88610d13fdfc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:50:14.664827 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.664698    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f093b865-d739-44be-a2ab-88610d13fdfc-istiod-ca-cert\") pod \"f093b865-d739-44be-a2ab-88610d13fdfc\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") "
Sep 16 14:50:14.664950 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.664930    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-workload-socket\") pod \"f093b865-d739-44be-a2ab-88610d13fdfc\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") "
Sep 16 14:50:14.665150 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.665133    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hk8g\" (UniqueName: \"kubernetes.io/projected/f093b865-d739-44be-a2ab-88610d13fdfc-kube-api-access-2hk8g\") pod \"f093b865-d739-44be-a2ab-88610d13fdfc\" (UID: \"f093b865-d739-44be-a2ab-88610d13fdfc\") "
Sep 16 14:50:14.665290 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.664971    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f093b865-d739-44be-a2ab-88610d13fdfc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f093b865-d739-44be-a2ab-88610d13fdfc" (UID: "f093b865-d739-44be-a2ab-88610d13fdfc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:50:14.665290 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.665198    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f093b865-d739-44be-a2ab-88610d13fdfc" (UID: "f093b865-d739-44be-a2ab-88610d13fdfc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:50:14.665533 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.665514    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-credential-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:14.665604 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.665539    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f093b865-d739-44be-a2ab-88610d13fdfc-istiod-ca-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:14.665604 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.665552    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-workload-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:14.665604 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.665564    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-istio-data\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:14.665604 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.665577    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-workload-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:14.666910 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.666881    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f093b865-d739-44be-a2ab-88610d13fdfc" (UID: "f093b865-d739-44be-a2ab-88610d13fdfc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:50:14.667069 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.667042    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f093b865-d739-44be-a2ab-88610d13fdfc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f093b865-d739-44be-a2ab-88610d13fdfc" (UID: "f093b865-d739-44be-a2ab-88610d13fdfc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:50:14.667121 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.667080    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f093b865-d739-44be-a2ab-88610d13fdfc-istio-token" (OuterVolumeSpecName: "istio-token") pod "f093b865-d739-44be-a2ab-88610d13fdfc" (UID: "f093b865-d739-44be-a2ab-88610d13fdfc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:50:14.667306 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.667285    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f093b865-d739-44be-a2ab-88610d13fdfc-kube-api-access-2hk8g" (OuterVolumeSpecName: "kube-api-access-2hk8g") pod "f093b865-d739-44be-a2ab-88610d13fdfc" (UID: "f093b865-d739-44be-a2ab-88610d13fdfc"). InnerVolumeSpecName "kube-api-access-2hk8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:50:14.667783 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.667762    2569 scope.go:117] "RemoveContainer" containerID="ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc"
Sep 16 14:50:14.675633 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.675618    2569 scope.go:117] "RemoveContainer" containerID="836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc"
Sep 16 14:50:14.675898 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:50:14.675878    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc\": container with ID starting with 836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc not found: ID does not exist" containerID="836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc"
Sep 16 14:50:14.675957 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.675903    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc"} err="failed to get container status \"836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc\": rpc error: code = NotFound desc = could not find container \"836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc\": container with ID starting with 836fe1fa346c2841bde9ab62c574dbb138d1b1d9ab71b94a3bd6776ae0324bfc not found: ID does not exist"
Sep 16 14:50:14.675957 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.675920    2569 scope.go:117] "RemoveContainer" containerID="ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc"
Sep 16 14:50:14.676174 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:50:14.676158    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc\": container with ID starting with ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc not found: ID does not exist" containerID="ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc"
Sep 16 14:50:14.676214 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.676180    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc"} err="failed to get container status \"ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc\": rpc error: code = NotFound desc = could not find container \"ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc\": container with ID starting with ff085de455ab15b0fe1d6ca5cc1a0b32f51811ca5dc6319a872a5e5506bf05bc not found: ID does not exist"
Sep 16 14:50:14.767039 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.767000    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hk8g\" (UniqueName: \"kubernetes.io/projected/f093b865-d739-44be-a2ab-88610d13fdfc-kube-api-access-2hk8g\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:14.767039 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.767031    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f093b865-d739-44be-a2ab-88610d13fdfc-istio-token\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:14.767039 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.767040    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f093b865-d739-44be-a2ab-88610d13fdfc-istio-podinfo\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:14.767039 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.767049    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f093b865-d739-44be-a2ab-88610d13fdfc-istio-envoy\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:14.979954 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.979920    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"]
Sep 16 14:50:14.985362 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:14.985337    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw"]
Sep 16 14:50:16.088021 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:16.087986    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" path="/var/lib/kubelet/pods/f093b865-d739-44be-a2ab-88610d13fdfc/volumes"
Sep 16 14:50:18.810357 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.810269    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"]
Sep 16 14:50:18.811046 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.811019    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" containerName="istio-proxy"
Sep 16 14:50:18.811249 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.811224    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" containerName="istio-proxy"
Sep 16 14:50:18.811366 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.811253    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" containerName="istio-proxy"
Sep 16 14:50:18.811366 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.811264    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" containerName="istio-proxy"
Sep 16 14:50:18.811513 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.811426    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" containerName="istio-proxy"
Sep 16 14:50:18.811513 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.811440    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f093b865-d739-44be-a2ab-88610d13fdfc" containerName="istio-proxy"
Sep 16 14:50:18.815818 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.815794    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:18.817983 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.817957    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-8dd97f83-serving-cert\""
Sep 16 14:50:18.826827 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.826250    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"]
Sep 16 14:50:18.908086 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.908045    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-maas-api-tls\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:18.908274 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.908111    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-openshift-service-ca\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:18.908274 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.908178    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-metrics-certs\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:18.908274 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:18.908196    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6qzb\" (UniqueName: \"kubernetes.io/projected/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-kube-api-access-c6qzb\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:19.009994 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:19.009943    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-maas-api-tls\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:19.010186 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:19.010047    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-openshift-service-ca\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:19.010186 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:19.010086    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-metrics-certs\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:19.010186 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:50:19.010101    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-serving-cert: secret "maas-api-e2e-migrate-8dd97f83-serving-cert" not found
Sep 16 14:50:19.010349 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:50:19.010193    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-maas-api-tls podName:ea525ad5-60b8-40c9-9caa-4dbd97fcb663 nodeName:}" failed. No retries permitted until 2026-09-16 14:50:19.510170034 +0000 UTC m=+893.861451737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-maas-api-tls") pod "maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf" (UID: "ea525ad5-60b8-40c9-9caa-4dbd97fcb663") : secret "maas-api-e2e-migrate-8dd97f83-serving-cert" not found
Sep 16 14:50:19.010349 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:19.010113    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6qzb\" (UniqueName: \"kubernetes.io/projected/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-kube-api-access-c6qzb\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:19.010873 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:19.010854    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-openshift-service-ca\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:19.012676 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:19.012638    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-metrics-certs\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:19.022794 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:19.022765    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6qzb\" (UniqueName: \"kubernetes.io/projected/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-kube-api-access-c6qzb\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:19.515010 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:19.514976    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-maas-api-tls\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:19.517274 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:19.517245    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-maas-api-tls\") pod \"maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:19.731110 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:19.731072    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:20.002942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:20.002916    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"]
Sep 16 14:50:20.004545 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:50:20.004523    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea525ad5_60b8_40c9_9caa_4dbd97fcb663.slice/crio-018ee69f51d003e779f147246fcb58e5f8990412c07d7643518a8d975f9cf32a WatchSource:0}: Error finding container 018ee69f51d003e779f147246fcb58e5f8990412c07d7643518a8d975f9cf32a: Status 404 returned error can't find the container with id 018ee69f51d003e779f147246fcb58e5f8990412c07d7643518a8d975f9cf32a
Sep 16 14:50:20.693300 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:20.693266    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf" event={"ID":"ea525ad5-60b8-40c9-9caa-4dbd97fcb663","Type":"ContainerStarted","Data":"cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd"}
Sep 16 14:50:20.693453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:20.693333    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf" event={"ID":"ea525ad5-60b8-40c9-9caa-4dbd97fcb663","Type":"ContainerStarted","Data":"018ee69f51d003e779f147246fcb58e5f8990412c07d7643518a8d975f9cf32a"}
Sep 16 14:50:20.693453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:20.693364    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:20.711958 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:20.711895    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf" podStartSLOduration=2.250339059 podStartE2EDuration="2.711874584s" totalImagesPullingTime="461.535525ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:50:20.710421564 +0000 UTC m=+895.061703273" watchObservedRunningTime="2026-09-16 14:50:20.711874584 +0000 UTC m=+895.063156291"
Sep 16 14:50:21.701603 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:21.701570    2569 generic.go:356] "Generic (PLEG): container finished" podID="d54b5284-549b-46b4-a55b-deff968e9787" containerID="f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4" exitCode=0
Sep 16 14:50:21.702086 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:21.701638    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" event={"ID":"d54b5284-549b-46b4-a55b-deff968e9787","Type":"ContainerDied","Data":"f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4"}
Sep 16 14:50:21.702202 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:21.702185    2569 scope.go:117] "RemoveContainer" containerID="f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4"
Sep 16 14:50:21.703311 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:21.703285    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:50:21.703402 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:21.703345    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:50:21.703402 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:21.703381    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:50:22.291742 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.291699    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"]
Sep 16 14:50:22.294208 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.294186    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.296474 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.296451    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-780e10\"/\"kube-root-ca.crt\""
Sep 16 14:50:22.296629 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.296478    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-780e10\"/\"openshift-service-ca.crt\""
Sep 16 14:50:22.298117 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.298093    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-780e10\"/\"default-dockercfg-drkdz\""
Sep 16 14:50:22.298241 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.298125    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-780e10\"/\"simulator-w0-780e10-kserve-self-signed-certs\""
Sep 16 14:50:22.308743 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.308704    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"]
Sep 16 14:50:22.344141 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.344091    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-model-cache\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.344338 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.344153    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-tmp-dir\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.344338 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.344202    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtdn8\" (UniqueName: \"kubernetes.io/projected/d647ef3e-3d75-4807-a29d-94dbb1f3a603-kube-api-access-qtdn8\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.344338 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.344305    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d647ef3e-3d75-4807-a29d-94dbb1f3a603-tls-certs\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.344536 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.344360    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-home\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.344536 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.344387    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-dshm\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.446076 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.446034    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-home\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.446442 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.446417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-dshm\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.446688 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.446667    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-model-cache\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.447154 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.447136    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-tmp-dir\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.447303 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.447286    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtdn8\" (UniqueName: \"kubernetes.io/projected/d647ef3e-3d75-4807-a29d-94dbb1f3a603-kube-api-access-qtdn8\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.447528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.447512    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d647ef3e-3d75-4807-a29d-94dbb1f3a603-tls-certs\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.451517 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.448279    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-tmp-dir\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.451517 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.447036    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-home\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.451517 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.447088    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-model-cache\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.451517 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.449213    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-dshm\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.454933 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.454913    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d647ef3e-3d75-4807-a29d-94dbb1f3a603-tls-certs\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.456623 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.456602    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtdn8\" (UniqueName: \"kubernetes.io/projected/d647ef3e-3d75-4807-a29d-94dbb1f3a603-kube-api-access-qtdn8\") pod \"simulator-w0-780e10-kserve-577777b6c4-7h46m\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") " pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.609985 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.609901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:22.710091 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.710061    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" event={"ID":"d54b5284-549b-46b4-a55b-deff968e9787","Type":"ContainerStarted","Data":"3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242"}
Sep 16 14:50:22.916035 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:22.916003    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"]
Sep 16 14:50:22.916875 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:50:22.916842    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd647ef3e_3d75_4807_a29d_94dbb1f3a603.slice/crio-129eed0681934e89d26c64ee99aec95ac6e8ba85224aea2f5c998eb7a217cfb8 WatchSource:0}: Error finding container 129eed0681934e89d26c64ee99aec95ac6e8ba85224aea2f5c998eb7a217cfb8: Status 404 returned error can't find the container with id 129eed0681934e89d26c64ee99aec95ac6e8ba85224aea2f5c998eb7a217cfb8
Sep 16 14:50:23.211790 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:23.211709    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:50:23.211973 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:23.211859    2569 patch_prober.go:28] interesting pod/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 16 14:50:23.211973 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:23.211908    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" podUID="d54b5284-549b-46b4-a55b-deff968e9787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 16 14:50:23.717428 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:23.717390    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m" event={"ID":"d647ef3e-3d75-4807-a29d-94dbb1f3a603","Type":"ContainerStarted","Data":"5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54"}
Sep 16 14:50:23.717869 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:23.717441    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m" event={"ID":"d647ef3e-3d75-4807-a29d-94dbb1f3a603","Type":"ContainerStarted","Data":"129eed0681934e89d26c64ee99aec95ac6e8ba85224aea2f5c998eb7a217cfb8"}
Sep 16 14:50:24.210843 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:24.210807    2569 patch_prober.go:28] interesting pod/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 16 14:50:24.211019 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:24.210873    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" podUID="d54b5284-549b-46b4-a55b-deff968e9787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 16 14:50:25.210974 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:25.210934    2569 patch_prober.go:28] interesting pod/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 16 14:50:25.211436 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:25.210994    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" podUID="d54b5284-549b-46b4-a55b-deff968e9787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 16 14:50:26.095759 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:26.095729    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 14:50:26.097013 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:26.096986    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 14:50:26.211539 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:26.211484    2569 patch_prober.go:28] interesting pod/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 16 14:50:26.211889 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:26.211556    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" podUID="d54b5284-549b-46b4-a55b-deff968e9787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 16 14:50:26.707764 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:26.707732    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:26.733328 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:26.733260    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m" podStartSLOduration=4.733239435 podStartE2EDuration="4.733239435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:50:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:50:23.737641835 +0000 UTC m=+898.088923544" watchObservedRunningTime="2026-09-16 14:50:26.733239435 +0000 UTC m=+901.084521145"
Sep 16 14:50:27.210925 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:27.210888    2569 patch_prober.go:28] interesting pod/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 16 14:50:27.211210 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:27.211177    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" podUID="d54b5284-549b-46b4-a55b-deff968e9787" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 16 14:50:28.215324 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:28.215293    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:50:28.215770 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:28.215698    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:50:28.216314 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:28.216296    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:50:32.610755 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:32.610716    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:32.610755 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:32.610767    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:32.623343 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:32.623316    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:32.788161 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:32.788130    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 14:50:56.031916 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.031880    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"]
Sep 16 14:50:56.032486 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.032139    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf" podUID="ea525ad5-60b8-40c9-9caa-4dbd97fcb663" containerName="maas-api" containerID="cri-o://cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd" gracePeriod=30
Sep 16 14:50:56.275403 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.275376    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:56.289399 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.289339    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6qzb\" (UniqueName: \"kubernetes.io/projected/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-kube-api-access-c6qzb\") pod \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") "
Sep 16 14:50:56.289527 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.289413    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-openshift-service-ca\") pod \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") "
Sep 16 14:50:56.289527 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.289448    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-metrics-certs\") pod \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") "
Sep 16 14:50:56.289527 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.289524    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-maas-api-tls\") pod \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\" (UID: \"ea525ad5-60b8-40c9-9caa-4dbd97fcb663\") "
Sep 16 14:50:56.289793 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.289765    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ea525ad5-60b8-40c9-9caa-4dbd97fcb663" (UID: "ea525ad5-60b8-40c9-9caa-4dbd97fcb663"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:50:56.291692 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.291670    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ea525ad5-60b8-40c9-9caa-4dbd97fcb663" (UID: "ea525ad5-60b8-40c9-9caa-4dbd97fcb663"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:50:56.291692 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.291685    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ea525ad5-60b8-40c9-9caa-4dbd97fcb663" (UID: "ea525ad5-60b8-40c9-9caa-4dbd97fcb663"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:50:56.291824 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.291672    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-kube-api-access-c6qzb" (OuterVolumeSpecName: "kube-api-access-c6qzb") pod "ea525ad5-60b8-40c9-9caa-4dbd97fcb663" (UID: "ea525ad5-60b8-40c9-9caa-4dbd97fcb663"). InnerVolumeSpecName "kube-api-access-c6qzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:50:56.390738 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.390695    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-maas-api-tls\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:56.390738 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.390733    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6qzb\" (UniqueName: \"kubernetes.io/projected/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-kube-api-access-c6qzb\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:56.390977 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.390749    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-openshift-service-ca\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:56.390977 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.390762    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea525ad5-60b8-40c9-9caa-4dbd97fcb663-metrics-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:50:56.913711 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.913668    2569 generic.go:356] "Generic (PLEG): container finished" podID="ea525ad5-60b8-40c9-9caa-4dbd97fcb663" containerID="cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd" exitCode=0
Sep 16 14:50:56.913711 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.913715    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"
Sep 16 14:50:56.913929 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.913750    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf" event={"ID":"ea525ad5-60b8-40c9-9caa-4dbd97fcb663","Type":"ContainerDied","Data":"cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd"}
Sep 16 14:50:56.913929 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.913801    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf" event={"ID":"ea525ad5-60b8-40c9-9caa-4dbd97fcb663","Type":"ContainerDied","Data":"018ee69f51d003e779f147246fcb58e5f8990412c07d7643518a8d975f9cf32a"}
Sep 16 14:50:56.913929 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.913823    2569 scope.go:117] "RemoveContainer" containerID="cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd"
Sep 16 14:50:56.923770 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.923751    2569 scope.go:117] "RemoveContainer" containerID="cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd"
Sep 16 14:50:56.924058 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:50:56.924036    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd\": container with ID starting with cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd not found: ID does not exist" containerID="cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd"
Sep 16 14:50:56.924126 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.924067    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd"} err="failed to get container status \"cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd\": rpc error: code = NotFound desc = could not find container \"cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd\": container with ID starting with cdb2d069e60995dc3004d92605824cfdb9f8287b33f1a74f1c7215ee84f785bd not found: ID does not exist"
Sep 16 14:50:56.951927 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.951898    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"]
Sep 16 14:50:56.975292 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:56.975264    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8dd97f83-8446f76589-g6ndf"]
Sep 16 14:50:58.089016 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:50:58.088982    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea525ad5-60b8-40c9-9caa-4dbd97fcb663" path="/var/lib/kubelet/pods/ea525ad5-60b8-40c9-9caa-4dbd97fcb663/volumes"
Sep 16 14:51:09.498287 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.498252    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"]
Sep 16 14:51:09.498691 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.498677    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea525ad5-60b8-40c9-9caa-4dbd97fcb663" containerName="maas-api"
Sep 16 14:51:09.498691 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.498692    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea525ad5-60b8-40c9-9caa-4dbd97fcb663" containerName="maas-api"
Sep 16 14:51:09.498774 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.498764    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea525ad5-60b8-40c9-9caa-4dbd97fcb663" containerName="maas-api"
Sep 16 14:51:09.501625 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.501605    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.504206 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.504183    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-bde531\"/\"kube-root-ca.crt\""
Sep 16 14:51:09.504921 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.504904    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-bde531\"/\"default-dockercfg-r7tml\""
Sep 16 14:51:09.504997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.504981    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-bde531\"/\"autores-model-bde531-kserve-self-signed-certs\""
Sep 16 14:51:09.505045 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.505018    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-bde531\"/\"openshift-service-ca.crt\""
Sep 16 14:51:09.511425 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.511402    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"]
Sep 16 14:51:09.629157 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.629122    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0e1710-b63e-4eb5-9986-7b5b751b0130-tls-certs\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.629327 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.629165    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-tmp-dir\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.629327 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.629189    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-model-cache\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.629327 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.629256    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-dshm\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.629327 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.629301    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-home\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.629475 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.629338    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntkfj\" (UniqueName: \"kubernetes.io/projected/1f0e1710-b63e-4eb5-9986-7b5b751b0130-kube-api-access-ntkfj\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.730306 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.730268    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-dshm\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.730529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.730354    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-home\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.730529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.730409    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntkfj\" (UniqueName: \"kubernetes.io/projected/1f0e1710-b63e-4eb5-9986-7b5b751b0130-kube-api-access-ntkfj\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.730529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.730461    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0e1710-b63e-4eb5-9986-7b5b751b0130-tls-certs\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.730724 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.730560    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-tmp-dir\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.730724 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.730596    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-model-cache\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.730839 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.730799    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-home\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.730933 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.730905    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-tmp-dir\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.731038 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.730938    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-model-cache\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.732802 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.732784    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-dshm\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.733169 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.733149    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0e1710-b63e-4eb5-9986-7b5b751b0130-tls-certs\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.739066 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.739046    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntkfj\" (UniqueName: \"kubernetes.io/projected/1f0e1710-b63e-4eb5-9986-7b5b751b0130-kube-api-access-ntkfj\") pod \"autores-model-bde531-kserve-6996457867-nxpwz\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") " pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:09.812044 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:09.811969    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:10.087487 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:51:10.087459    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f0e1710_b63e_4eb5_9986_7b5b751b0130.slice/crio-e30f4dbbb1d931bc52f21acd1a671fb782aa737d933d21a65fd9350f7be588ff WatchSource:0}: Error finding container e30f4dbbb1d931bc52f21acd1a671fb782aa737d933d21a65fd9350f7be588ff: Status 404 returned error can't find the container with id e30f4dbbb1d931bc52f21acd1a671fb782aa737d933d21a65fd9350f7be588ff
Sep 16 14:51:10.090232 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:10.090213    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"]
Sep 16 14:51:11.014354 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:11.014317    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz" event={"ID":"1f0e1710-b63e-4eb5-9986-7b5b751b0130","Type":"ContainerStarted","Data":"bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516"}
Sep 16 14:51:11.014354 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:11.014364    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz" event={"ID":"1f0e1710-b63e-4eb5-9986-7b5b751b0130","Type":"ContainerStarted","Data":"e30f4dbbb1d931bc52f21acd1a671fb782aa737d933d21a65fd9350f7be588ff"}
Sep 16 14:51:11.035941 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:11.035891    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz" podStartSLOduration=2.035875774 podStartE2EDuration="2.035875774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:51:11.034256012 +0000 UTC m=+945.385537715" watchObservedRunningTime="2026-09-16 14:51:11.035875774 +0000 UTC m=+945.387157484"
Sep 16 14:51:19.812816 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:19.812774    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:19.813363 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:19.813004    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:19.825628 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:19.825602    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:20.077297 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:20.077215    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:51:28.832875 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.832837    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"]
Sep 16 14:51:28.836068 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.836049    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:28.839260 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.839237    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-78e52a\"/\"default-dockercfg-lvmm6\""
Sep 16 14:51:28.839405 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.839294    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-78e52a\"/\"test-model-78e52a-kserve-self-signed-certs\""
Sep 16 14:51:28.839405 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.839393    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-78e52a\"/\"openshift-service-ca.crt\""
Sep 16 14:51:28.839612 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.839441    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-78e52a\"/\"kube-root-ca.crt\""
Sep 16 14:51:28.846054 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.846032    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"]
Sep 16 14:51:28.923855 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.923825    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-home\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:28.923969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.923870    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/615a6410-2922-4177-b812-0ace51a8a327-tls-certs\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:28.924019 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.923988    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzsmj\" (UniqueName: \"kubernetes.io/projected/615a6410-2922-4177-b812-0ace51a8a327-kube-api-access-wzsmj\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:28.924019 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.924009    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-dshm\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:28.924094 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.924033    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-tmp-dir\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:28.924134 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:28.924104    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-model-cache\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.024801 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.024762    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-model-cache\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.024801 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.024806    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-home\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.024958 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.024926    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/615a6410-2922-4177-b812-0ace51a8a327-tls-certs\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.025090 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.025070    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzsmj\" (UniqueName: \"kubernetes.io/projected/615a6410-2922-4177-b812-0ace51a8a327-kube-api-access-wzsmj\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.025171 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.025103    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-home\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.025171 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.025106    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-dshm\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.025171 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.025153    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-tmp-dir\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.025273 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.025179    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-model-cache\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.025453 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.025430    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-tmp-dir\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.027228 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.027209    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-dshm\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.027530 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.027513    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/615a6410-2922-4177-b812-0ace51a8a327-tls-certs\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.033606 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.033579    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzsmj\" (UniqueName: \"kubernetes.io/projected/615a6410-2922-4177-b812-0ace51a8a327-kube-api-access-wzsmj\") pod \"test-model-78e52a-kserve-79bc7f7dc7-zrnf4\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") " pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.146942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.146858    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:29.417326 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:29.417300    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"]
Sep 16 14:51:29.418673 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:51:29.418645    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod615a6410_2922_4177_b812_0ace51a8a327.slice/crio-b93094feb63b7e37f4b409879eb3ece53fa1a7995f9bbceb76017683d807aeb4 WatchSource:0}: Error finding container b93094feb63b7e37f4b409879eb3ece53fa1a7995f9bbceb76017683d807aeb4: Status 404 returned error can't find the container with id b93094feb63b7e37f4b409879eb3ece53fa1a7995f9bbceb76017683d807aeb4
Sep 16 14:51:30.121205 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:30.121163    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4" event={"ID":"615a6410-2922-4177-b812-0ace51a8a327","Type":"ContainerStarted","Data":"031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa"}
Sep 16 14:51:30.121622 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:30.121214    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4" event={"ID":"615a6410-2922-4177-b812-0ace51a8a327","Type":"ContainerStarted","Data":"b93094feb63b7e37f4b409879eb3ece53fa1a7995f9bbceb76017683d807aeb4"}
Sep 16 14:51:30.141285 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:30.141237    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4" podStartSLOduration=2.141221977 podStartE2EDuration="2.141221977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:51:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:51:30.138165023 +0000 UTC m=+964.489446724" watchObservedRunningTime="2026-09-16 14:51:30.141221977 +0000 UTC m=+964.492503683"
Sep 16 14:51:39.147165 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:39.147123    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:39.147702 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:39.147183    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:39.159615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:39.159586    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:39.188430 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:39.188402    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:51:58.938626 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:51:58.938594    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"]
Sep 16 14:52:13.969899 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:13.969838    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz" podUID="1f0e1710-b63e-4eb5-9986-7b5b751b0130" containerName="main" containerID="cri-o://bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516" gracePeriod=45
Sep 16 14:52:14.227455 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.227394    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:52:14.300017 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.299974    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0e1710-b63e-4eb5-9986-7b5b751b0130-tls-certs\") pod \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") "
Sep 16 14:52:14.300220 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.300058    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-model-cache\") pod \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") "
Sep 16 14:52:14.300220 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.300083    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-dshm\") pod \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") "
Sep 16 14:52:14.300220 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.300121    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-tmp-dir\") pod \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") "
Sep 16 14:52:14.300220 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.300171    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntkfj\" (UniqueName: \"kubernetes.io/projected/1f0e1710-b63e-4eb5-9986-7b5b751b0130-kube-api-access-ntkfj\") pod \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") "
Sep 16 14:52:14.300426 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.300239    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-home\") pod \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\" (UID: \"1f0e1710-b63e-4eb5-9986-7b5b751b0130\") "
Sep 16 14:52:14.300426 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.300348    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-model-cache" (OuterVolumeSpecName: "model-cache") pod "1f0e1710-b63e-4eb5-9986-7b5b751b0130" (UID: "1f0e1710-b63e-4eb5-9986-7b5b751b0130"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:14.300545 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.300414    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1f0e1710-b63e-4eb5-9986-7b5b751b0130" (UID: "1f0e1710-b63e-4eb5-9986-7b5b751b0130"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:14.300596 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.300553    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-home" (OuterVolumeSpecName: "home") pod "1f0e1710-b63e-4eb5-9986-7b5b751b0130" (UID: "1f0e1710-b63e-4eb5-9986-7b5b751b0130"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:14.300780 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.300759    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-home\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:14.300858 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.300783    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-model-cache\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:14.300858 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.300800    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-tmp-dir\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:14.302357 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.302329    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-dshm" (OuterVolumeSpecName: "dshm") pod "1f0e1710-b63e-4eb5-9986-7b5b751b0130" (UID: "1f0e1710-b63e-4eb5-9986-7b5b751b0130"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:14.302465 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.302378    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f0e1710-b63e-4eb5-9986-7b5b751b0130-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1f0e1710-b63e-4eb5-9986-7b5b751b0130" (UID: "1f0e1710-b63e-4eb5-9986-7b5b751b0130"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:52:14.302465 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.302418    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f0e1710-b63e-4eb5-9986-7b5b751b0130-kube-api-access-ntkfj" (OuterVolumeSpecName: "kube-api-access-ntkfj") pod "1f0e1710-b63e-4eb5-9986-7b5b751b0130" (UID: "1f0e1710-b63e-4eb5-9986-7b5b751b0130"). InnerVolumeSpecName "kube-api-access-ntkfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:52:14.388135 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.388104    2569 generic.go:356] "Generic (PLEG): container finished" podID="1f0e1710-b63e-4eb5-9986-7b5b751b0130" containerID="bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516" exitCode=0
Sep 16 14:52:14.388312 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.388145    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"
Sep 16 14:52:14.388312 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.388196    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz" event={"ID":"1f0e1710-b63e-4eb5-9986-7b5b751b0130","Type":"ContainerDied","Data":"bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516"}
Sep 16 14:52:14.388312 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.388243    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz" event={"ID":"1f0e1710-b63e-4eb5-9986-7b5b751b0130","Type":"ContainerDied","Data":"e30f4dbbb1d931bc52f21acd1a671fb782aa737d933d21a65fd9350f7be588ff"}
Sep 16 14:52:14.388312 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.388265    2569 scope.go:117] "RemoveContainer" containerID="bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516"
Sep 16 14:52:14.397605 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.397586    2569 scope.go:117] "RemoveContainer" containerID="bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516"
Sep 16 14:52:14.397860 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:52:14.397844    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516\": container with ID starting with bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516 not found: ID does not exist" containerID="bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516"
Sep 16 14:52:14.397902 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.397867    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516"} err="failed to get container status \"bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516\": rpc error: code = NotFound desc = could not find container \"bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516\": container with ID starting with bce8238d671a3d0f0fc1a8aebd5b89053f5408fc8e092bb2656f9c5b95f0f516 not found: ID does not exist"
Sep 16 14:52:14.401790 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.401772    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0e1710-b63e-4eb5-9986-7b5b751b0130-tls-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:14.401857 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.401791    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0e1710-b63e-4eb5-9986-7b5b751b0130-dshm\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:14.401857 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.401800    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntkfj\" (UniqueName: \"kubernetes.io/projected/1f0e1710-b63e-4eb5-9986-7b5b751b0130-kube-api-access-ntkfj\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:14.409586 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.409563    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"]
Sep 16 14:52:14.413820 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:14.413799    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-bde531/autores-model-bde531-kserve-6996457867-nxpwz"]
Sep 16 14:52:16.088162 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:16.088125    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f0e1710-b63e-4eb5-9986-7b5b751b0130" path="/var/lib/kubelet/pods/1f0e1710-b63e-4eb5-9986-7b5b751b0130/volumes"
Sep 16 14:52:36.018829 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:36.018789    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"]
Sep 16 14:52:36.019417 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:36.019137    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy" containerID="cri-o://2f67dfd05c3ebbe5a7a0655772effbfb07b440345abf7d4d01e1c82b28d380a7" gracePeriod=30
Sep 16 14:52:40.302562 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:40.302525    2569 patch_prober.go:28] interesting pod/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 14:52:40.302938 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:40.302596    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:52:41.542669 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.542638    2569 generic.go:356] "Generic (PLEG): container finished" podID="56534aad-d9fc-4c79-89eb-db666724948a" containerID="2f67dfd05c3ebbe5a7a0655772effbfb07b440345abf7d4d01e1c82b28d380a7" exitCode=0
Sep 16 14:52:41.543036 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.542709    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" event={"ID":"56534aad-d9fc-4c79-89eb-db666724948a","Type":"ContainerDied","Data":"2f67dfd05c3ebbe5a7a0655772effbfb07b440345abf7d4d01e1c82b28d380a7"}
Sep 16 14:52:41.543036 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.542791    2569 scope.go:117] "RemoveContainer" containerID="58d80e9d3ff78ef10863671dcb444cfcdc4a3f0fe8fbcb47bf9f42ba7a3df26f"
Sep 16 14:52:41.674340 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.674310    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:52:41.765096 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765066    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l42jm\" (UniqueName: \"kubernetes.io/projected/56534aad-d9fc-4c79-89eb-db666724948a-kube-api-access-l42jm\") pod \"56534aad-d9fc-4c79-89eb-db666724948a\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") "
Sep 16 14:52:41.765271 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765126    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-credential-socket\") pod \"56534aad-d9fc-4c79-89eb-db666724948a\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") "
Sep 16 14:52:41.765271 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765176    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56534aad-d9fc-4c79-89eb-db666724948a-istio-token\") pod \"56534aad-d9fc-4c79-89eb-db666724948a\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") "
Sep 16 14:52:41.765271 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765209    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-workload-certs\") pod \"56534aad-d9fc-4c79-89eb-db666724948a\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") "
Sep 16 14:52:41.765271 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765246    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56534aad-d9fc-4c79-89eb-db666724948a-istio-podinfo\") pod \"56534aad-d9fc-4c79-89eb-db666724948a\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") "
Sep 16 14:52:41.765524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765274    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-istio-data\") pod \"56534aad-d9fc-4c79-89eb-db666724948a\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") "
Sep 16 14:52:41.765524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765310    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-workload-socket\") pod \"56534aad-d9fc-4c79-89eb-db666724948a\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") "
Sep 16 14:52:41.765524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765313    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56534aad-d9fc-4c79-89eb-db666724948a" (UID: "56534aad-d9fc-4c79-89eb-db666724948a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:41.765524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765361    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56534aad-d9fc-4c79-89eb-db666724948a-istiod-ca-cert\") pod \"56534aad-d9fc-4c79-89eb-db666724948a\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") "
Sep 16 14:52:41.765524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765450    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-istio-envoy\") pod \"56534aad-d9fc-4c79-89eb-db666724948a\" (UID: \"56534aad-d9fc-4c79-89eb-db666724948a\") "
Sep 16 14:52:41.765524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765516    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56534aad-d9fc-4c79-89eb-db666724948a" (UID: "56534aad-d9fc-4c79-89eb-db666724948a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:41.765844 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765624    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56534aad-d9fc-4c79-89eb-db666724948a" (UID: "56534aad-d9fc-4c79-89eb-db666724948a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:41.765844 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765639    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-istio-data" (OuterVolumeSpecName: "istio-data") pod "56534aad-d9fc-4c79-89eb-db666724948a" (UID: "56534aad-d9fc-4c79-89eb-db666724948a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:41.765844 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765814    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56534aad-d9fc-4c79-89eb-db666724948a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56534aad-d9fc-4c79-89eb-db666724948a" (UID: "56534aad-d9fc-4c79-89eb-db666724948a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:52:41.766022 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765934    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-credential-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:41.766022 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765955    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-workload-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:41.766022 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765969    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-istio-data\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:41.766022 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765982    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-workload-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:41.766022 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.765994    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56534aad-d9fc-4c79-89eb-db666724948a-istiod-ca-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:41.767422 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.767395    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56534aad-d9fc-4c79-89eb-db666724948a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56534aad-d9fc-4c79-89eb-db666724948a" (UID: "56534aad-d9fc-4c79-89eb-db666724948a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:52:41.767584 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.767506    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56534aad-d9fc-4c79-89eb-db666724948a" (UID: "56534aad-d9fc-4c79-89eb-db666724948a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:41.767749 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.767725    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56534aad-d9fc-4c79-89eb-db666724948a-istio-token" (OuterVolumeSpecName: "istio-token") pod "56534aad-d9fc-4c79-89eb-db666724948a" (UID: "56534aad-d9fc-4c79-89eb-db666724948a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:52:41.767850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.767757    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56534aad-d9fc-4c79-89eb-db666724948a-kube-api-access-l42jm" (OuterVolumeSpecName: "kube-api-access-l42jm") pod "56534aad-d9fc-4c79-89eb-db666724948a" (UID: "56534aad-d9fc-4c79-89eb-db666724948a"). InnerVolumeSpecName "kube-api-access-l42jm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:52:41.866840 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.866771    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56534aad-d9fc-4c79-89eb-db666724948a-istio-token\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:41.866840 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.866795    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56534aad-d9fc-4c79-89eb-db666724948a-istio-podinfo\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:41.866840 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.866809    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56534aad-d9fc-4c79-89eb-db666724948a-istio-envoy\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:41.866840 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:41.866821    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l42jm\" (UniqueName: \"kubernetes.io/projected/56534aad-d9fc-4c79-89eb-db666724948a-kube-api-access-l42jm\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:52:42.549733 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:42.549697    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9" event={"ID":"56534aad-d9fc-4c79-89eb-db666724948a","Type":"ContainerDied","Data":"2b9cd333f206ccbde8ebaafd99906a45a1484a53e7db84be363722747e979bd1"}
Sep 16 14:52:42.550190 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:42.549739    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"
Sep 16 14:52:42.550190 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:42.549764    2569 scope.go:117] "RemoveContainer" containerID="2f67dfd05c3ebbe5a7a0655772effbfb07b440345abf7d4d01e1c82b28d380a7"
Sep 16 14:52:42.568902 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:42.568879    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"]
Sep 16 14:52:42.572582 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:42.572562    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9"]
Sep 16 14:52:44.089581 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:52:44.089542    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56534aad-d9fc-4c79-89eb-db666724948a" path="/var/lib/kubelet/pods/56534aad-d9fc-4c79-89eb-db666724948a/volumes"
Sep 16 14:53:13.222733 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.222698    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"]
Sep 16 14:53:13.223181 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.223106    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy"
Sep 16 14:53:13.223181 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.223119    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy"
Sep 16 14:53:13.223181 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.223129    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy"
Sep 16 14:53:13.223181 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.223135    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy"
Sep 16 14:53:13.223181 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.223143    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f0e1710-b63e-4eb5-9986-7b5b751b0130" containerName="main"
Sep 16 14:53:13.223181 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.223150    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f0e1710-b63e-4eb5-9986-7b5b751b0130" containerName="main"
Sep 16 14:53:13.223400 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.223216    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f0e1710-b63e-4eb5-9986-7b5b751b0130" containerName="main"
Sep 16 14:53:13.223400 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.223224    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy"
Sep 16 14:53:13.223400 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.223231    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="56534aad-d9fc-4c79-89eb-db666724948a" containerName="istio-proxy"
Sep 16 14:53:13.226254 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.226238    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.228724 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.228701    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e689e5\"/\"openshift-service-ca.crt\""
Sep 16 14:53:13.229425 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.229410    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e689e5\"/\"kube-root-ca.crt\""
Sep 16 14:53:13.229520 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.229415    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e689e5\"/\"test-model-e689e5-kserve-self-signed-certs\""
Sep 16 14:53:13.229520 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.229476    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e689e5\"/\"default-dockercfg-gc69w\""
Sep 16 14:53:13.237551 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.237530    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"]
Sep 16 14:53:13.367615 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.367576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2gvq\" (UniqueName: \"kubernetes.io/projected/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-kube-api-access-f2gvq\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.367776 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.367642    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-home\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.367776 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.367692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-tmp-dir\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.367776 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.367731    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-model-cache\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.367776 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.367752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-dshm\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.367950 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.367841    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-tls-certs\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.469314 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.469285    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-tls-certs\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.469487 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.469349    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2gvq\" (UniqueName: \"kubernetes.io/projected/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-kube-api-access-f2gvq\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.469487 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.469386    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-home\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.469487 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.469405    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-tmp-dir\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.469487 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.469432    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-model-cache\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.469487 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.469459    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-dshm\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.469874 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.469850    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-home\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.469874 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.469866    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-model-cache\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.469986 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.469906    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-tmp-dir\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.471587 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.471570    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-dshm\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.471704 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.471689    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-tls-certs\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.477526 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.477459    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2gvq\" (UniqueName: \"kubernetes.io/projected/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-kube-api-access-f2gvq\") pod \"test-model-e689e5-kserve-7b9564c765-qhz7f\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") " pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.536553 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.536510    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:13.825918 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:13.825887    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"]
Sep 16 14:53:13.826416 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:53:13.826393    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1ca3e33_5fa1_42a6_af14_99774c13a0c2.slice/crio-f8def1436d949aa71dd34c752bfd8d096aea467dd2708c020b504f6013d547d8 WatchSource:0}: Error finding container f8def1436d949aa71dd34c752bfd8d096aea467dd2708c020b504f6013d547d8: Status 404 returned error can't find the container with id f8def1436d949aa71dd34c752bfd8d096aea467dd2708c020b504f6013d547d8
Sep 16 14:53:14.742849 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:14.742812    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f" event={"ID":"a1ca3e33-5fa1-42a6-af14-99774c13a0c2","Type":"ContainerStarted","Data":"4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1"}
Sep 16 14:53:14.743227 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:14.742860    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f" event={"ID":"a1ca3e33-5fa1-42a6-af14-99774c13a0c2","Type":"ContainerStarted","Data":"f8def1436d949aa71dd34c752bfd8d096aea467dd2708c020b504f6013d547d8"}
Sep 16 14:53:14.762222 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:14.762178    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f" podStartSLOduration=1.762163709 podStartE2EDuration="1.762163709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:53:14.761087995 +0000 UTC m=+1069.112369705" watchObservedRunningTime="2026-09-16 14:53:14.762163709 +0000 UTC m=+1069.113445479"
Sep 16 14:53:23.537507 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:23.537408    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:23.537507 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:23.537477    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:23.550131 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:23.550105    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:23.807051 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:23.806974    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:53:46.447980 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.447947    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"]
Sep 16 14:53:46.452829 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.452805    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.455083 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.455066    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a743146e-openshift-default-dockercfg-xbxsj\""
Sep 16 14:53:46.466564 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.466539    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"]
Sep 16 14:53:46.599609 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.599576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-data\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.599609 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.599611    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-token\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.599827 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.599638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-credential-socket\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.599827 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.599722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02c97791-f50b-45fc-a6db-2f4d681a708d-istiod-ca-cert\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.599827 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.599776    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88g2z\" (UniqueName: \"kubernetes.io/projected/02c97791-f50b-45fc-a6db-2f4d681a708d-kube-api-access-88g2z\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.599827 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.599794    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-podinfo\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.599965 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.599853    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-workload-certs\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.599965 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.599915    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-envoy\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.599965 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.599946    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-workload-socket\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.700840 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.700751    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02c97791-f50b-45fc-a6db-2f4d681a708d-istiod-ca-cert\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.700988 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.700920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88g2z\" (UniqueName: \"kubernetes.io/projected/02c97791-f50b-45fc-a6db-2f4d681a708d-kube-api-access-88g2z\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.700988 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.700964    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-podinfo\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.701070 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.700994    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-workload-certs\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.701070 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.701028    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-envoy\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.701143 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.701068    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-workload-socket\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.701143 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.701122    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-data\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.701241 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.701145    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-token\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.701241 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.701183    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-credential-socket\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.701455 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.701404    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-workload-certs\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.701601 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.701579    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-workload-socket\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.701660 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.701599    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-credential-socket\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.701660 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.701611    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02c97791-f50b-45fc-a6db-2f4d681a708d-istiod-ca-cert\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.701660 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.701646    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-data\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.703831 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.703810    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-envoy\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.704036 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.704011    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-podinfo\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.710120 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.710098    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-token\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.710372 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.710351    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88g2z\" (UniqueName: \"kubernetes.io/projected/02c97791-f50b-45fc-a6db-2f4d681a708d-kube-api-access-88g2z\") pod \"e2e-mt-a743146e-openshift-default-55ffcf656-46rxq\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") " pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:46.763371 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:46.763325    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:47.149291 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:47.149258    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"]
Sep 16 14:53:47.152793 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:53:47.152764    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c97791_f50b_45fc_a6db_2f4d681a708d.slice/crio-1e17356ab5d56cc72ba4765bcd0b5baa14a6135548e4158b15e039ae47e84740 WatchSource:0}: Error finding container 1e17356ab5d56cc72ba4765bcd0b5baa14a6135548e4158b15e039ae47e84740: Status 404 returned error can't find the container with id 1e17356ab5d56cc72ba4765bcd0b5baa14a6135548e4158b15e039ae47e84740
Sep 16 14:53:47.155362 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:47.155322    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:53:47.155459 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:47.155415    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:53:47.155459 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:47.155444    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:53:47.937746 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:47.937707    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" event={"ID":"02c97791-f50b-45fc-a6db-2f4d681a708d","Type":"ContainerStarted","Data":"b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8"}
Sep 16 14:53:47.938191 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:47.937770    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" event={"ID":"02c97791-f50b-45fc-a6db-2f4d681a708d","Type":"ContainerStarted","Data":"1e17356ab5d56cc72ba4765bcd0b5baa14a6135548e4158b15e039ae47e84740"}
Sep 16 14:53:47.972006 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:47.971957    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" podStartSLOduration=1.971942052 podStartE2EDuration="1.971942052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:53:47.970436324 +0000 UTC m=+1102.321718032" watchObservedRunningTime="2026-09-16 14:53:47.971942052 +0000 UTC m=+1102.323223762"
Sep 16 14:53:48.764412 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:48.764375    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:48.769425 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:48.769400    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:48.943122 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:48.943096    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:53:48.944155 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:53:48.944136    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:54:16.106718 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:16.106685    2569 generic.go:356] "Generic (PLEG): container finished" podID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerID="b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8" exitCode=0
Sep 16 14:54:16.107175 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:16.106761    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" event={"ID":"02c97791-f50b-45fc-a6db-2f4d681a708d","Type":"ContainerDied","Data":"b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8"}
Sep 16 14:54:16.107227 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:16.107216    2569 scope.go:117] "RemoveContainer" containerID="b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8"
Sep 16 14:54:16.108588 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:16.108558    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:54:16.108689 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:16.108626    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:54:16.108689 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:16.108661    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:54:17.117237 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:17.117202    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" event={"ID":"02c97791-f50b-45fc-a6db-2f4d681a708d","Type":"ContainerStarted","Data":"baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167"}
Sep 16 14:54:17.765814 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:17.765761    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:54:17.766138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:17.765925    2569 patch_prober.go:28] interesting pod/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:54:17.766138 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:17.765975    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 14:54:18.764654 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:18.764617    2569 patch_prober.go:28] interesting pod/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:54:18.765027 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:18.764693    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 14:54:18.943818 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:18.943782    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:54:19.764346 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:19.764299    2569 patch_prober.go:28] interesting pod/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:54:19.764600 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:19.764395    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 14:54:20.764411 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:20.764362    2569 patch_prober.go:28] interesting pod/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:54:20.764923 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:20.764434    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 14:54:21.765519 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:21.764981    2569 patch_prober.go:28] interesting pod/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 14:54:21.765519 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:21.765063    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 14:54:22.815389 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:22.815335    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:54:22.817053 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:22.817030    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:54:49.567639 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:49.567543    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"]
Sep 16 14:54:49.568215 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:49.567809    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy" containerID="cri-o://baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167" gracePeriod=30
Sep 16 14:54:52.818532 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:52.818467    2569 patch_prober.go:28] interesting pod/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 14:54:52.818922 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:52.818552    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:54:54.828361 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.828331    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:54:54.936524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.936386    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-envoy\") pod \"02c97791-f50b-45fc-a6db-2f4d681a708d\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") "
Sep 16 14:54:54.936524 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.936450    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-workload-socket\") pod \"02c97791-f50b-45fc-a6db-2f4d681a708d\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") "
Sep 16 14:54:54.936767 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.936529    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-workload-certs\") pod \"02c97791-f50b-45fc-a6db-2f4d681a708d\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") "
Sep 16 14:54:54.936767 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.936568    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88g2z\" (UniqueName: \"kubernetes.io/projected/02c97791-f50b-45fc-a6db-2f4d681a708d-kube-api-access-88g2z\") pod \"02c97791-f50b-45fc-a6db-2f4d681a708d\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") "
Sep 16 14:54:54.936767 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.936631    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-data\") pod \"02c97791-f50b-45fc-a6db-2f4d681a708d\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") "
Sep 16 14:54:54.936767 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.936660    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02c97791-f50b-45fc-a6db-2f4d681a708d-istiod-ca-cert\") pod \"02c97791-f50b-45fc-a6db-2f4d681a708d\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") "
Sep 16 14:54:54.936767 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.936745    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-podinfo\") pod \"02c97791-f50b-45fc-a6db-2f4d681a708d\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") "
Sep 16 14:54:54.937019 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.936773    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02c97791-f50b-45fc-a6db-2f4d681a708d" (UID: "02c97791-f50b-45fc-a6db-2f4d681a708d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:54:54.937019 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.936840    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-credential-socket\") pod \"02c97791-f50b-45fc-a6db-2f4d681a708d\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") "
Sep 16 14:54:54.937019 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.936883    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02c97791-f50b-45fc-a6db-2f4d681a708d" (UID: "02c97791-f50b-45fc-a6db-2f4d681a708d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:54:54.937019 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.936897    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-token\") pod \"02c97791-f50b-45fc-a6db-2f4d681a708d\" (UID: \"02c97791-f50b-45fc-a6db-2f4d681a708d\") "
Sep 16 14:54:54.937019 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.936977    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-data" (OuterVolumeSpecName: "istio-data") pod "02c97791-f50b-45fc-a6db-2f4d681a708d" (UID: "02c97791-f50b-45fc-a6db-2f4d681a708d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:54:54.937280 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.937111    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02c97791-f50b-45fc-a6db-2f4d681a708d" (UID: "02c97791-f50b-45fc-a6db-2f4d681a708d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:54:54.937280 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.937157    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02c97791-f50b-45fc-a6db-2f4d681a708d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02c97791-f50b-45fc-a6db-2f4d681a708d" (UID: "02c97791-f50b-45fc-a6db-2f4d681a708d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:54:54.937371 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.937315    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02c97791-f50b-45fc-a6db-2f4d681a708d-istiod-ca-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:54:54.937371 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.937336    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-credential-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:54:54.937371 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.937351    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-workload-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:54:54.937371 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.937364    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-workload-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:54:54.937371 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.937372    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-data\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:54:54.939241 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.939209    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02c97791-f50b-45fc-a6db-2f4d681a708d" (UID: "02c97791-f50b-45fc-a6db-2f4d681a708d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:54:54.939241 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.939208    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02c97791-f50b-45fc-a6db-2f4d681a708d" (UID: "02c97791-f50b-45fc-a6db-2f4d681a708d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:54:54.939410 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.939304    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02c97791-f50b-45fc-a6db-2f4d681a708d-kube-api-access-88g2z" (OuterVolumeSpecName: "kube-api-access-88g2z") pod "02c97791-f50b-45fc-a6db-2f4d681a708d" (UID: "02c97791-f50b-45fc-a6db-2f4d681a708d"). InnerVolumeSpecName "kube-api-access-88g2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:54:54.939410 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:54.939335    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-token" (OuterVolumeSpecName: "istio-token") pod "02c97791-f50b-45fc-a6db-2f4d681a708d" (UID: "02c97791-f50b-45fc-a6db-2f4d681a708d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:54:55.038116 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.038073    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88g2z\" (UniqueName: \"kubernetes.io/projected/02c97791-f50b-45fc-a6db-2f4d681a708d-kube-api-access-88g2z\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:54:55.038116 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.038110    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-podinfo\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:54:55.038116 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.038120    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-token\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:54:55.038366 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.038129    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02c97791-f50b-45fc-a6db-2f4d681a708d-istio-envoy\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:54:55.384165 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.384125    2569 generic.go:356] "Generic (PLEG): container finished" podID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerID="baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167" exitCode=0
Sep 16 14:54:55.384333 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.384185    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"
Sep 16 14:54:55.384333 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.384217    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" event={"ID":"02c97791-f50b-45fc-a6db-2f4d681a708d","Type":"ContainerDied","Data":"baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167"}
Sep 16 14:54:55.384333 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.384284    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq" event={"ID":"02c97791-f50b-45fc-a6db-2f4d681a708d","Type":"ContainerDied","Data":"1e17356ab5d56cc72ba4765bcd0b5baa14a6135548e4158b15e039ae47e84740"}
Sep 16 14:54:55.384333 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.384316    2569 scope.go:117] "RemoveContainer" containerID="baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167"
Sep 16 14:54:55.398678 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.398651    2569 scope.go:117] "RemoveContainer" containerID="b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8"
Sep 16 14:54:55.407834 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.407812    2569 scope.go:117] "RemoveContainer" containerID="baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167"
Sep 16 14:54:55.408152 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:54:55.408129    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167\": container with ID starting with baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167 not found: ID does not exist" containerID="baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167"
Sep 16 14:54:55.408209 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.408164    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167"} err="failed to get container status \"baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167\": rpc error: code = NotFound desc = could not find container \"baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167\": container with ID starting with baaa55f2c095bf932c71a597e97c2d772ecf6639c2acab63d2db40be21375167 not found: ID does not exist"
Sep 16 14:54:55.408209 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.408185    2569 scope.go:117] "RemoveContainer" containerID="b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8"
Sep 16 14:54:55.408567 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:54:55.408520    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8\": container with ID starting with b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8 not found: ID does not exist" containerID="b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8"
Sep 16 14:54:55.408729 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.408562    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8"} err="failed to get container status \"b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8\": rpc error: code = NotFound desc = could not find container \"b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8\": container with ID starting with b4f7907107efd86de9551e4af7ac13e512ccc080e5cc4a0a2b04a2b4e5ff9cf8 not found: ID does not exist"
Sep 16 14:54:55.412292 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.412261    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"]
Sep 16 14:54:55.416881 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:55.416849    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq"]
Sep 16 14:54:56.089818 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:54:56.089781    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" path="/var/lib/kubelet/pods/02c97791-f50b-45fc-a6db-2f4d681a708d/volumes"
Sep 16 14:55:14.895332 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.895282    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"]
Sep 16 14:55:14.895818 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.895798    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy"
Sep 16 14:55:14.895818 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.895818    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy"
Sep 16 14:55:14.895916 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.895907    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy"
Sep 16 14:55:14.900487 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.900466    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:14.902763 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.902738    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-780e10\"/\"distinct-w0-780e10-kserve-self-signed-certs\""
Sep 16 14:55:14.907236 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.907200    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"]
Sep 16 14:55:14.960317 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.960274    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-model-cache\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:14.960317 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.960323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-home\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:14.960567 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.960358    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-dshm\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:14.960567 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.960405    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b24b758d-7fb4-4cd3-a6ed-7c682b623845-tls-certs\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:14.960567 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.960514    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzfdz\" (UniqueName: \"kubernetes.io/projected/b24b758d-7fb4-4cd3-a6ed-7c682b623845-kube-api-access-pzfdz\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:14.960567 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:14.960554    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-tmp-dir\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.061637 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.061597    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzfdz\" (UniqueName: \"kubernetes.io/projected/b24b758d-7fb4-4cd3-a6ed-7c682b623845-kube-api-access-pzfdz\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.061637 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.061641    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-tmp-dir\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.061868 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.061692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-model-cache\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.061868 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.061713    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-home\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.061868 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.061733    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-dshm\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.061868 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.061787    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b24b758d-7fb4-4cd3-a6ed-7c682b623845-tls-certs\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.062123 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.062089    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-model-cache\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.062256 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.062175    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-tmp-dir\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.062256 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.062222    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-home\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.064098 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.064076    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-dshm\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.064374 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.064353    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b24b758d-7fb4-4cd3-a6ed-7c682b623845-tls-certs\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.070537 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.070479    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzfdz\" (UniqueName: \"kubernetes.io/projected/b24b758d-7fb4-4cd3-a6ed-7c682b623845-kube-api-access-pzfdz\") pod \"distinct-w0-780e10-kserve-df7bdb9d6-76l4m\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.210665 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.210563    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:15.487169 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.487139    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"]
Sep 16 14:55:15.488834 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:55:15.488801    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb24b758d_7fb4_4cd3_a6ed_7c682b623845.slice/crio-71fecd4466a28504c43bc61e64a96b148ad11527116d5dd76b0ea746c753587a WatchSource:0}: Error finding container 71fecd4466a28504c43bc61e64a96b148ad11527116d5dd76b0ea746c753587a: Status 404 returned error can't find the container with id 71fecd4466a28504c43bc61e64a96b148ad11527116d5dd76b0ea746c753587a
Sep 16 14:55:15.508663 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:15.508629    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m" event={"ID":"b24b758d-7fb4-4cd3-a6ed-7c682b623845","Type":"ContainerStarted","Data":"71fecd4466a28504c43bc61e64a96b148ad11527116d5dd76b0ea746c753587a"}
Sep 16 14:55:16.516464 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:16.516429    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m" event={"ID":"b24b758d-7fb4-4cd3-a6ed-7c682b623845","Type":"ContainerStarted","Data":"9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6"}
Sep 16 14:55:16.532969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:16.532915    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m" podStartSLOduration=2.5328966250000002 podStartE2EDuration="2.532896625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:55:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:55:16.531908253 +0000 UTC m=+1190.883189984" watchObservedRunningTime="2026-09-16 14:55:16.532896625 +0000 UTC m=+1190.884178332"
Sep 16 14:55:25.211048 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:25.210996    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:25.211742 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:25.211084    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:25.223697 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:25.223667    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:25.580774 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:25.580743    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 14:55:26.142406 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:26.142379    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 14:55:26.145960 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:26.145938    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 14:55:36.966897 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:36.966860    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"]
Sep 16 14:55:36.967356 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:36.967321    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy"
Sep 16 14:55:36.967356 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:36.967342    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy"
Sep 16 14:55:36.967480 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:36.967468    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c97791-f50b-45fc-a6db-2f4d681a708d" containerName="istio-proxy"
Sep 16 14:55:36.971677 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:36.971655    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:36.975205 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:36.975183    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-f4d89a-openshift-default-dockercfg-s5jds\""
Sep 16 14:55:36.985203 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:36.985173    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"]
Sep 16 14:55:37.103705 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.103655    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-podinfo\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.103884 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.103737    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-workload-socket\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.103884 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.103762    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l58qx\" (UniqueName: \"kubernetes.io/projected/bc3d471c-de77-463f-96da-a00a1daf1f28-kube-api-access-l58qx\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.103884 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.103808    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-data\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.103884 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.103845    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc3d471c-de77-463f-96da-a00a1daf1f28-istiod-ca-cert\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.103884 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.103881    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-token\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.104167 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.103916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-workload-certs\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.104167 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.103964    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-envoy\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.104167 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.104074    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-credential-socket\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.204876 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.204836    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-workload-socket\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205073 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.204881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l58qx\" (UniqueName: \"kubernetes.io/projected/bc3d471c-de77-463f-96da-a00a1daf1f28-kube-api-access-l58qx\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205073 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.204920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-data\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205073 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.204955    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc3d471c-de77-463f-96da-a00a1daf1f28-istiod-ca-cert\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205073 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.204987    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-token\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.205165    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-workload-certs\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205288 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.205218    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-envoy\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205387 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.205286    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-data\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205387 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.205303    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-workload-socket\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205387 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.205352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-credential-socket\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205584 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.205418    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-podinfo\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205584 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.205559    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-workload-certs\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205787 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.205763    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-credential-socket\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.205922 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.205783    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc3d471c-de77-463f-96da-a00a1daf1f28-istiod-ca-cert\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.207750 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.207727    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-envoy\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.207931 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.207916    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-podinfo\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.213377 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.213351    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-token\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.213509 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.213429    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l58qx\" (UniqueName: \"kubernetes.io/projected/bc3d471c-de77-463f-96da-a00a1daf1f28-kube-api-access-l58qx\") pod \"e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") " pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.283599 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.283553    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:37.573626 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.573482    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"]
Sep 16 14:55:37.582118 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:55:37.582051    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3d471c_de77_463f_96da_a00a1daf1f28.slice/crio-e163c2c3380ecd630f00c4a74f396781343d56bdb1625690973e351f5f146467 WatchSource:0}: Error finding container e163c2c3380ecd630f00c4a74f396781343d56bdb1625690973e351f5f146467: Status 404 returned error can't find the container with id e163c2c3380ecd630f00c4a74f396781343d56bdb1625690973e351f5f146467
Sep 16 14:55:37.586872 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.585678    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:55:37.586872 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.585772    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:55:37.586872 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.585813    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:55:37.649458 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:37.649413    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j" event={"ID":"bc3d471c-de77-463f-96da-a00a1daf1f28","Type":"ContainerStarted","Data":"e163c2c3380ecd630f00c4a74f396781343d56bdb1625690973e351f5f146467"}
Sep 16 14:55:38.145474 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.145432    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"]
Sep 16 14:55:38.149071 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.149043    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.158754 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.158729    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-ba69d2-openshift-default-dockercfg-9l2fb\""
Sep 16 14:55:38.180604 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.180564    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"]
Sep 16 14:55:38.217958 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.217922    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istiod-ca-cert\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.218270 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.218232    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-workload-socket\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.218386 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.218284    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-data\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.218445 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.218397    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-workload-certs\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.218612 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.218585    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-envoy\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.218715 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.218643    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-credential-socket\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.218843 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.218828    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-podinfo\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.218903 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.218858    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgr66\" (UniqueName: \"kubernetes.io/projected/4058afc9-8257-44ae-82e4-7f6544ae8a7f-kube-api-access-rgr66\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.218903 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.218893    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-token\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.319570 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.319522    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istiod-ca-cert\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.319769 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.319592    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-workload-socket\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.319769 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.319616    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-data\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.319769 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.319660    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-workload-certs\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.319769 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.319720    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-envoy\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.319769 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.319749    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-credential-socket\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.320057 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.319825    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-podinfo\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.320057 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.319855    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgr66\" (UniqueName: \"kubernetes.io/projected/4058afc9-8257-44ae-82e4-7f6544ae8a7f-kube-api-access-rgr66\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.320057 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.319892    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-token\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.320057 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.320036    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-workload-socket\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.320257 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.320144    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-credential-socket\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.320257 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.320159    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-data\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.320332 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.320258    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-workload-certs\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.320332 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.320305    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istiod-ca-cert\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.322137 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.322110    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-envoy\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.322528 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.322441    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-podinfo\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.331809 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.331776    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-token\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.331997 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.331971    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgr66\" (UniqueName: \"kubernetes.io/projected/4058afc9-8257-44ae-82e4-7f6544ae8a7f-kube-api-access-rgr66\") pod \"e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") " pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.460173 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.459819    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:38.657008 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.656970    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j" event={"ID":"bc3d471c-de77-463f-96da-a00a1daf1f28","Type":"ContainerStarted","Data":"7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c"}
Sep 16 14:55:38.678031 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.677974    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j" podStartSLOduration=2.6779583540000003 podStartE2EDuration="2.677958354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:55:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:55:38.676405474 +0000 UTC m=+1213.027687193" watchObservedRunningTime="2026-09-16 14:55:38.677958354 +0000 UTC m=+1213.029240062"
Sep 16 14:55:38.751506 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.751468    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"]
Sep 16 14:55:38.752830 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:55:38.752800    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4058afc9_8257_44ae_82e4_7f6544ae8a7f.slice/crio-fd8c13432e29e2a1cc1227a6a7658ebeb6da4f218596c43b13d981bbd4c8fc9e WatchSource:0}: Error finding container fd8c13432e29e2a1cc1227a6a7658ebeb6da4f218596c43b13d981bbd4c8fc9e: Status 404 returned error can't find the container with id fd8c13432e29e2a1cc1227a6a7658ebeb6da4f218596c43b13d981bbd4c8fc9e
Sep 16 14:55:38.755236 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.755207    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:55:38.755298 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.755277    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:55:38.755353 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:38.755308    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:55:39.283943 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:39.283900    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:39.289374 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:39.289344    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:39.665128 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:39.665030    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" event={"ID":"4058afc9-8257-44ae-82e4-7f6544ae8a7f","Type":"ContainerStarted","Data":"d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea"}
Sep 16 14:55:39.665128 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:39.665096    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" event={"ID":"4058afc9-8257-44ae-82e4-7f6544ae8a7f","Type":"ContainerStarted","Data":"fd8c13432e29e2a1cc1227a6a7658ebeb6da4f218596c43b13d981bbd4c8fc9e"}
Sep 16 14:55:39.665366 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:39.665320    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:39.666383 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:39.666360    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:55:39.698342 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:39.698287    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" podStartSLOduration=1.6982682599999999 podStartE2EDuration="1.69826826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:55:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:55:39.69614642 +0000 UTC m=+1214.047428126" watchObservedRunningTime="2026-09-16 14:55:39.69826826 +0000 UTC m=+1214.049549969"
Sep 16 14:55:40.460467 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:40.460426    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:40.466378 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:40.466349    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:40.672904 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:40.672873    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:55:40.674415 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:55:40.674386    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:56:02.180601 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:02.180561    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"]
Sep 16 14:56:17.200554 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.200488    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4" podUID="615a6410-2922-4177-b812-0ace51a8a327" containerName="main" containerID="cri-o://031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa" gracePeriod=45
Sep 16 14:56:17.490844 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.490816    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:56:17.662487 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.662453    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzsmj\" (UniqueName: \"kubernetes.io/projected/615a6410-2922-4177-b812-0ace51a8a327-kube-api-access-wzsmj\") pod \"615a6410-2922-4177-b812-0ace51a8a327\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") "
Sep 16 14:56:17.662487 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.662512    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-tmp-dir\") pod \"615a6410-2922-4177-b812-0ace51a8a327\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") "
Sep 16 14:56:17.662780 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.662638    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/615a6410-2922-4177-b812-0ace51a8a327-tls-certs\") pod \"615a6410-2922-4177-b812-0ace51a8a327\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") "
Sep 16 14:56:17.662780 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.662689    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-home\") pod \"615a6410-2922-4177-b812-0ace51a8a327\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") "
Sep 16 14:56:17.662780 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.662709    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-dshm\") pod \"615a6410-2922-4177-b812-0ace51a8a327\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") "
Sep 16 14:56:17.662930 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.662788    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-model-cache\") pod \"615a6410-2922-4177-b812-0ace51a8a327\" (UID: \"615a6410-2922-4177-b812-0ace51a8a327\") "
Sep 16 14:56:17.662930 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.662818    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "615a6410-2922-4177-b812-0ace51a8a327" (UID: "615a6410-2922-4177-b812-0ace51a8a327"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:17.662930 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.662862    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-home" (OuterVolumeSpecName: "home") pod "615a6410-2922-4177-b812-0ace51a8a327" (UID: "615a6410-2922-4177-b812-0ace51a8a327"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:17.663070 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.663042    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-model-cache" (OuterVolumeSpecName: "model-cache") pod "615a6410-2922-4177-b812-0ace51a8a327" (UID: "615a6410-2922-4177-b812-0ace51a8a327"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:17.663190 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.663172    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-tmp-dir\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:17.663242 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.663194    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-home\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:17.663242 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.663206    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-model-cache\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:17.664943 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.664911    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/615a6410-2922-4177-b812-0ace51a8a327-kube-api-access-wzsmj" (OuterVolumeSpecName: "kube-api-access-wzsmj") pod "615a6410-2922-4177-b812-0ace51a8a327" (UID: "615a6410-2922-4177-b812-0ace51a8a327"). InnerVolumeSpecName "kube-api-access-wzsmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:56:17.664943 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.664922    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-dshm" (OuterVolumeSpecName: "dshm") pod "615a6410-2922-4177-b812-0ace51a8a327" (UID: "615a6410-2922-4177-b812-0ace51a8a327"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:17.665093 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.664985    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/615a6410-2922-4177-b812-0ace51a8a327-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "615a6410-2922-4177-b812-0ace51a8a327" (UID: "615a6410-2922-4177-b812-0ace51a8a327"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:56:17.764581 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.764530    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/615a6410-2922-4177-b812-0ace51a8a327-tls-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:17.764581 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.764572    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/615a6410-2922-4177-b812-0ace51a8a327-dshm\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:17.764581 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.764585    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzsmj\" (UniqueName: \"kubernetes.io/projected/615a6410-2922-4177-b812-0ace51a8a327-kube-api-access-wzsmj\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:17.904358 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.904322    2569 generic.go:356] "Generic (PLEG): container finished" podID="615a6410-2922-4177-b812-0ace51a8a327" containerID="031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa" exitCode=0
Sep 16 14:56:17.904636 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.904372    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"
Sep 16 14:56:17.904636 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.904405    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4" event={"ID":"615a6410-2922-4177-b812-0ace51a8a327","Type":"ContainerDied","Data":"031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa"}
Sep 16 14:56:17.904636 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.904453    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4" event={"ID":"615a6410-2922-4177-b812-0ace51a8a327","Type":"ContainerDied","Data":"b93094feb63b7e37f4b409879eb3ece53fa1a7995f9bbceb76017683d807aeb4"}
Sep 16 14:56:17.904636 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.904475    2569 scope.go:117] "RemoveContainer" containerID="031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa"
Sep 16 14:56:17.914743 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.914722    2569 scope.go:117] "RemoveContainer" containerID="031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa"
Sep 16 14:56:17.915096 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:56:17.915074    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa\": container with ID starting with 031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa not found: ID does not exist" containerID="031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa"
Sep 16 14:56:17.915153 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.915107    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa"} err="failed to get container status \"031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa\": rpc error: code = NotFound desc = could not find container \"031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa\": container with ID starting with 031dda679f388962514a963ae1ed0840ffa1b5a711a43c06cc6bd88ae96af8fa not found: ID does not exist"
Sep 16 14:56:17.941841 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.941784    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"]
Sep 16 14:56:17.956165 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:17.956118    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-78e52a/test-model-78e52a-kserve-79bc7f7dc7-zrnf4"]
Sep 16 14:56:18.089075 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:18.088994    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="615a6410-2922-4177-b812-0ace51a8a327" path="/var/lib/kubelet/pods/615a6410-2922-4177-b812-0ace51a8a327/volumes"
Sep 16 14:56:22.949035 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:22.949002    2569 generic.go:356] "Generic (PLEG): container finished" podID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerID="d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea" exitCode=0
Sep 16 14:56:22.949476 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:22.949076    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" event={"ID":"4058afc9-8257-44ae-82e4-7f6544ae8a7f","Type":"ContainerDied","Data":"d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea"}
Sep 16 14:56:22.949563 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:22.949550    2569 scope.go:117] "RemoveContainer" containerID="d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea"
Sep 16 14:56:22.950757 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:22.950730    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:56:22.950817 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:22.950797    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:56:22.950852 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:22.950835    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:56:23.962372 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:23.962328    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" event={"ID":"4058afc9-8257-44ae-82e4-7f6544ae8a7f","Type":"ContainerStarted","Data":"bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562"}
Sep 16 14:56:24.461054 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:24.461013    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:56:24.462357 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:24.462326    2569 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 14:56:24.462513 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:24.462380    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 14:56:25.461000 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:25.460960    2569 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 14:56:25.461401 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:25.461022    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 14:56:25.673104 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:25.673044    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:56:26.128837 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:26.128804    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"]
Sep 16 14:56:26.461005 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:26.460903    2569 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 14:56:26.461277 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:26.461245    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 14:56:27.461057 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:27.461010    2569 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 14:56:27.461276 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:27.461075    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 14:56:28.460374 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:28.460333    2569 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 14:56:28.460818 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:28.460392    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 14:56:29.516237 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:29.516197    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:56:29.517669 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:29.517643    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 14:56:37.195257 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.195217    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"]
Sep 16 14:56:37.195797 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.195710    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="615a6410-2922-4177-b812-0ace51a8a327" containerName="main"
Sep 16 14:56:37.195797 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.195723    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="615a6410-2922-4177-b812-0ace51a8a327" containerName="main"
Sep 16 14:56:37.195797 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.195796    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="615a6410-2922-4177-b812-0ace51a8a327" containerName="main"
Sep 16 14:56:37.198809 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.198783    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.203600 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.203572    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-adb97937-serving-cert\""
Sep 16 14:56:37.290998 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.290959    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e4b266-d5fb-422f-b585-949268afacfd-metrics-certs\") pod \"maas-api-e2e-mt-adb97937-7946664658-qrzcd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.291172 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.291012    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvd2b\" (UniqueName: \"kubernetes.io/projected/f8e4b266-d5fb-422f-b585-949268afacfd-kube-api-access-lvd2b\") pod \"maas-api-e2e-mt-adb97937-7946664658-qrzcd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.291172 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.291129    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e4b266-d5fb-422f-b585-949268afacfd-openshift-service-ca\") pod \"maas-api-e2e-mt-adb97937-7946664658-qrzcd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.291254 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.291213    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e4b266-d5fb-422f-b585-949268afacfd-maas-api-tls\") pod \"maas-api-e2e-mt-adb97937-7946664658-qrzcd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.310674 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.310635    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"]
Sep 16 14:56:37.392111 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.392073    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e4b266-d5fb-422f-b585-949268afacfd-maas-api-tls\") pod \"maas-api-e2e-mt-adb97937-7946664658-qrzcd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.392272 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.392242    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e4b266-d5fb-422f-b585-949268afacfd-metrics-certs\") pod \"maas-api-e2e-mt-adb97937-7946664658-qrzcd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.392334 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.392296    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvd2b\" (UniqueName: \"kubernetes.io/projected/f8e4b266-d5fb-422f-b585-949268afacfd-kube-api-access-lvd2b\") pod \"maas-api-e2e-mt-adb97937-7946664658-qrzcd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.392392 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.392377    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e4b266-d5fb-422f-b585-949268afacfd-openshift-service-ca\") pod \"maas-api-e2e-mt-adb97937-7946664658-qrzcd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.393025 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.393001    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e4b266-d5fb-422f-b585-949268afacfd-openshift-service-ca\") pod \"maas-api-e2e-mt-adb97937-7946664658-qrzcd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.394677 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.394654    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e4b266-d5fb-422f-b585-949268afacfd-metrics-certs\") pod \"maas-api-e2e-mt-adb97937-7946664658-qrzcd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.394757 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.394691    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e4b266-d5fb-422f-b585-949268afacfd-maas-api-tls\") pod \"maas-api-e2e-mt-adb97937-7946664658-qrzcd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.412629 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.412600    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvd2b\" (UniqueName: \"kubernetes.io/projected/f8e4b266-d5fb-422f-b585-949268afacfd-kube-api-access-lvd2b\") pod \"maas-api-e2e-mt-adb97937-7946664658-qrzcd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.510631 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.510588    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:37.819355 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.819325    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"]
Sep 16 14:56:37.820585 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:56:37.820558    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e4b266_d5fb_422f_b585_949268afacfd.slice/crio-88cad510ace8447d8ea3e0710f78ce895bd4d785376a610e9ca8f8d9a7305184 WatchSource:0}: Error finding container 88cad510ace8447d8ea3e0710f78ce895bd4d785376a610e9ca8f8d9a7305184: Status 404 returned error can't find the container with id 88cad510ace8447d8ea3e0710f78ce895bd4d785376a610e9ca8f8d9a7305184
Sep 16 14:56:37.822135 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:37.822117    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:56:38.048788 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:38.048747    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd" event={"ID":"f8e4b266-d5fb-422f-b585-949268afacfd","Type":"ContainerStarted","Data":"88cad510ace8447d8ea3e0710f78ce895bd4d785376a610e9ca8f8d9a7305184"}
Sep 16 14:56:39.592565 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:39.592531    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"]
Sep 16 14:56:39.592988 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:39.592761    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy" containerID="cri-o://e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13" gracePeriod=30
Sep 16 14:56:39.717804 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:39.717767    2569 patch_prober.go:28] interesting pod/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 14:56:39.717969 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:39.717826    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:56:40.064819 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:40.064771    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd" event={"ID":"f8e4b266-d5fb-422f-b585-949268afacfd","Type":"ContainerStarted","Data":"34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f"}
Sep 16 14:56:40.065006 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:40.064852    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:40.129895 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:40.129835    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd" podStartSLOduration=1.944227607 podStartE2EDuration="3.129816842s" totalImagesPullingTime="1.185589235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:56:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:56:40.128312396 +0000 UTC m=+1274.479594106" watchObservedRunningTime="2026-09-16 14:56:40.129816842 +0000 UTC m=+1274.481098552"
Sep 16 14:56:41.171569 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.171510    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f" podUID="a1ca3e33-5fa1-42a6-af14-99774c13a0c2" containerName="main" containerID="cri-o://4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1" gracePeriod=45
Sep 16 14:56:41.432772 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.432707    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:56:41.564622 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.564578    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-tls-certs\") pod \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") "
Sep 16 14:56:41.564622 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.564632    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-model-cache\") pod \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") "
Sep 16 14:56:41.564891 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.564729    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-dshm\") pod \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") "
Sep 16 14:56:41.564891 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.564765    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2gvq\" (UniqueName: \"kubernetes.io/projected/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-kube-api-access-f2gvq\") pod \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") "
Sep 16 14:56:41.564891 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.564787    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-tmp-dir\") pod \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") "
Sep 16 14:56:41.564891 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.564809    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-home\") pod \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\" (UID: \"a1ca3e33-5fa1-42a6-af14-99774c13a0c2\") "
Sep 16 14:56:41.565103 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.564959    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-model-cache" (OuterVolumeSpecName: "model-cache") pod "a1ca3e33-5fa1-42a6-af14-99774c13a0c2" (UID: "a1ca3e33-5fa1-42a6-af14-99774c13a0c2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:41.565159 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.565099    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a1ca3e33-5fa1-42a6-af14-99774c13a0c2" (UID: "a1ca3e33-5fa1-42a6-af14-99774c13a0c2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:41.565159 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.565128    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-home" (OuterVolumeSpecName: "home") pod "a1ca3e33-5fa1-42a6-af14-99774c13a0c2" (UID: "a1ca3e33-5fa1-42a6-af14-99774c13a0c2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:41.565358 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.565336    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-model-cache\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:41.565439 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.565362    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-tmp-dir\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:41.565439 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.565376    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-home\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:41.567064 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.567024    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-kube-api-access-f2gvq" (OuterVolumeSpecName: "kube-api-access-f2gvq") pod "a1ca3e33-5fa1-42a6-af14-99774c13a0c2" (UID: "a1ca3e33-5fa1-42a6-af14-99774c13a0c2"). InnerVolumeSpecName "kube-api-access-f2gvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:56:41.567064 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.567052    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-dshm" (OuterVolumeSpecName: "dshm") pod "a1ca3e33-5fa1-42a6-af14-99774c13a0c2" (UID: "a1ca3e33-5fa1-42a6-af14-99774c13a0c2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:41.567064 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.567040    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a1ca3e33-5fa1-42a6-af14-99774c13a0c2" (UID: "a1ca3e33-5fa1-42a6-af14-99774c13a0c2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:56:41.666937 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.666880    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-tls-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:41.666937 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.666923    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-dshm\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:41.666937 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:41.666932    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2gvq\" (UniqueName: \"kubernetes.io/projected/a1ca3e33-5fa1-42a6-af14-99774c13a0c2-kube-api-access-f2gvq\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:42.078372 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:42.078331    2569 generic.go:356] "Generic (PLEG): container finished" podID="a1ca3e33-5fa1-42a6-af14-99774c13a0c2" containerID="4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1" exitCode=0
Sep 16 14:56:42.078601 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:42.078377    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"
Sep 16 14:56:42.078601 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:42.078418    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f" event={"ID":"a1ca3e33-5fa1-42a6-af14-99774c13a0c2","Type":"ContainerDied","Data":"4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1"}
Sep 16 14:56:42.078601 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:42.078475    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f" event={"ID":"a1ca3e33-5fa1-42a6-af14-99774c13a0c2","Type":"ContainerDied","Data":"f8def1436d949aa71dd34c752bfd8d096aea467dd2708c020b504f6013d547d8"}
Sep 16 14:56:42.078601 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:42.078524    2569 scope.go:117] "RemoveContainer" containerID="4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1"
Sep 16 14:56:42.089846 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:42.089821    2569 scope.go:117] "RemoveContainer" containerID="4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1"
Sep 16 14:56:42.090185 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:56:42.090164    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1\": container with ID starting with 4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1 not found: ID does not exist" containerID="4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1"
Sep 16 14:56:42.090241 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:42.090195    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1"} err="failed to get container status \"4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1\": rpc error: code = NotFound desc = could not find container \"4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1\": container with ID starting with 4891f9cbde7fb0a1f01748bcd47699c7ba3aeb96555402b1ef29dda5000e2dc1 not found: ID does not exist"
Sep 16 14:56:42.116102 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:42.116052    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"]
Sep 16 14:56:42.125277 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:42.125237    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e689e5/test-model-e689e5-kserve-7b9564c765-qhz7f"]
Sep 16 14:56:44.088589 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:44.088558    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1ca3e33-5fa1-42a6-af14-99774c13a0c2" path="/var/lib/kubelet/pods/a1ca3e33-5fa1-42a6-af14-99774c13a0c2/volumes"
Sep 16 14:56:44.855398 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:44.855327    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:56:45.002667 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.002623    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-workload-socket\") pod \"026b604d-55ca-45db-9db8-4985cb9e51d2\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") "
Sep 16 14:56:45.002880 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.002682    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-token\") pod \"026b604d-55ca-45db-9db8-4985cb9e51d2\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") "
Sep 16 14:56:45.002880 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.002714    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-podinfo\") pod \"026b604d-55ca-45db-9db8-4985cb9e51d2\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") "
Sep 16 14:56:45.002880 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.002739    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s744j\" (UniqueName: \"kubernetes.io/projected/026b604d-55ca-45db-9db8-4985cb9e51d2-kube-api-access-s744j\") pod \"026b604d-55ca-45db-9db8-4985cb9e51d2\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") "
Sep 16 14:56:45.002880 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.002764    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/026b604d-55ca-45db-9db8-4985cb9e51d2-istiod-ca-cert\") pod \"026b604d-55ca-45db-9db8-4985cb9e51d2\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") "
Sep 16 14:56:45.003088 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.002881    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-envoy\") pod \"026b604d-55ca-45db-9db8-4985cb9e51d2\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") "
Sep 16 14:56:45.003088 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.002945    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "026b604d-55ca-45db-9db8-4985cb9e51d2" (UID: "026b604d-55ca-45db-9db8-4985cb9e51d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:45.003088 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.003003    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-workload-certs\") pod \"026b604d-55ca-45db-9db8-4985cb9e51d2\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") "
Sep 16 14:56:45.003088 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.003077    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-credential-socket\") pod \"026b604d-55ca-45db-9db8-4985cb9e51d2\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") "
Sep 16 14:56:45.003335 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.003107    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-data\") pod \"026b604d-55ca-45db-9db8-4985cb9e51d2\" (UID: \"026b604d-55ca-45db-9db8-4985cb9e51d2\") "
Sep 16 14:56:45.003335 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.003272    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "026b604d-55ca-45db-9db8-4985cb9e51d2" (UID: "026b604d-55ca-45db-9db8-4985cb9e51d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:45.003443 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.003340    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/026b604d-55ca-45db-9db8-4985cb9e51d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "026b604d-55ca-45db-9db8-4985cb9e51d2" (UID: "026b604d-55ca-45db-9db8-4985cb9e51d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:56:45.003572 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.003529    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "026b604d-55ca-45db-9db8-4985cb9e51d2" (UID: "026b604d-55ca-45db-9db8-4985cb9e51d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:45.003572 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.003557    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "026b604d-55ca-45db-9db8-4985cb9e51d2" (UID: "026b604d-55ca-45db-9db8-4985cb9e51d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:45.003737 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.003683    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-workload-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:45.003737 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.003706    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-credential-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:45.003737 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.003720    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-data\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:45.003737 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.003734    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-workload-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:45.003880 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.003749    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/026b604d-55ca-45db-9db8-4985cb9e51d2-istiod-ca-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:45.005185 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.005159    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "026b604d-55ca-45db-9db8-4985cb9e51d2" (UID: "026b604d-55ca-45db-9db8-4985cb9e51d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:56:45.005292 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.005181    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/026b604d-55ca-45db-9db8-4985cb9e51d2-kube-api-access-s744j" (OuterVolumeSpecName: "kube-api-access-s744j") pod "026b604d-55ca-45db-9db8-4985cb9e51d2" (UID: "026b604d-55ca-45db-9db8-4985cb9e51d2"). InnerVolumeSpecName "kube-api-access-s744j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:56:45.005470 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.005454    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "026b604d-55ca-45db-9db8-4985cb9e51d2" (UID: "026b604d-55ca-45db-9db8-4985cb9e51d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:56:45.005557 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.005453    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "026b604d-55ca-45db-9db8-4985cb9e51d2" (UID: "026b604d-55ca-45db-9db8-4985cb9e51d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:56:45.099059 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.099022    2569 generic.go:356] "Generic (PLEG): container finished" podID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerID="e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13" exitCode=0
Sep 16 14:56:45.099518 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.099065    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"
Sep 16 14:56:45.099518 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.099108    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" event={"ID":"026b604d-55ca-45db-9db8-4985cb9e51d2","Type":"ContainerDied","Data":"e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13"}
Sep 16 14:56:45.099518 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.099164    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp" event={"ID":"026b604d-55ca-45db-9db8-4985cb9e51d2","Type":"ContainerDied","Data":"5dca436465a39ef107ee9c3bb05536654de32ff9e335e5b604c5c58cbfba62d8"}
Sep 16 14:56:45.099518 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.099189    2569 scope.go:117] "RemoveContainer" containerID="e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13"
Sep 16 14:56:45.104649 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.104624    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-token\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:45.104649 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.104652    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-podinfo\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:45.104802 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.104668    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s744j\" (UniqueName: \"kubernetes.io/projected/026b604d-55ca-45db-9db8-4985cb9e51d2-kube-api-access-s744j\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:45.104802 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.104682    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/026b604d-55ca-45db-9db8-4985cb9e51d2-istio-envoy\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:56:45.109647 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.109630    2569 scope.go:117] "RemoveContainer" containerID="1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee"
Sep 16 14:56:45.118813 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.118792    2569 scope.go:117] "RemoveContainer" containerID="e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13"
Sep 16 14:56:45.119140 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:56:45.119115    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13\": container with ID starting with e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13 not found: ID does not exist" containerID="e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13"
Sep 16 14:56:45.119204 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.119149    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13"} err="failed to get container status \"e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13\": rpc error: code = NotFound desc = could not find container \"e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13\": container with ID starting with e958d192ededb44e5b387814e52e4cdfb36bf8cb1ee6669cc81cce767dc2cc13 not found: ID does not exist"
Sep 16 14:56:45.119204 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.119168    2569 scope.go:117] "RemoveContainer" containerID="1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee"
Sep 16 14:56:45.119422 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:56:45.119404    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee\": container with ID starting with 1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee not found: ID does not exist" containerID="1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee"
Sep 16 14:56:45.119468 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.119430    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee"} err="failed to get container status \"1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee\": rpc error: code = NotFound desc = could not find container \"1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee\": container with ID starting with 1ec6a6e7b25b1051359b84371ed9a40b546b9b2485aadcc1598cba0e0dcbf0ee not found: ID does not exist"
Sep 16 14:56:45.136236 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.136198    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"]
Sep 16 14:56:45.147447 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:45.142715    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp"]
Sep 16 14:56:46.076391 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:46.076357    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:56:46.088800 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:56:46.088758    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" path="/var/lib/kubelet/pods/026b604d-55ca-45db-9db8-4985cb9e51d2/volumes"
Sep 16 14:57:03.260588 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:03.260553    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"]
Sep 16 14:57:03.261007 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:03.260768    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" podUID="d54b5284-549b-46b4-a55b-deff968e9787" containerName="istio-proxy" containerID="cri-o://3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242" gracePeriod=30
Sep 16 14:57:04.418758 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.418723    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"]
Sep 16 14:57:04.419173 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.419160    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy"
Sep 16 14:57:04.419173 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.419174    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy"
Sep 16 14:57:04.419272 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.419202    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ca3e33-5fa1-42a6-af14-99774c13a0c2" containerName="main"
Sep 16 14:57:04.419272 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.419208    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ca3e33-5fa1-42a6-af14-99774c13a0c2" containerName="main"
Sep 16 14:57:04.419355 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.419275    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy"
Sep 16 14:57:04.419355 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.419292    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ca3e33-5fa1-42a6-af14-99774c13a0c2" containerName="main"
Sep 16 14:57:04.422535 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.422517    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.436798 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.436768    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-d28bd5-openshift-default-dockercfg-shzkb\""
Sep 16 14:57:04.513422 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.513370    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-token\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.513422 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.513416    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-credential-socket\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.513699 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.513442    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-workload-certs\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.513699 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.513588    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-data\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.513699 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.513651    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-envoy\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.513856 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.513725    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istiod-ca-cert\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.513856 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.513804    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-podinfo\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.513856 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.513832    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-workload-socket\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.513948 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.513926    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf4t7\" (UniqueName: \"kubernetes.io/projected/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-kube-api-access-gf4t7\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.555183 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.555140    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"]
Sep 16 14:57:04.615583 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.615536    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-envoy\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.615792 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.615611    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istiod-ca-cert\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.615792 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.615653    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-podinfo\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.615792 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.615669    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-workload-socket\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.615792 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.615734    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf4t7\" (UniqueName: \"kubernetes.io/projected/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-kube-api-access-gf4t7\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.615792 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.615760    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-token\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.615792 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.615784    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-credential-socket\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.616128 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.615814    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-workload-certs\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.616128 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.615854    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-data\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.616227 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.616153    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-workload-socket\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.616340 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.616318    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-data\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.616401 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.616362    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-credential-socket\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.616401 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.616374    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-workload-certs\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.616536 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.616430    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istiod-ca-cert\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.618028 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.617995    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-envoy\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.618352 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.618330    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-podinfo\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.638435 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.638409    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-token\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.639471 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.639447    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf4t7\" (UniqueName: \"kubernetes.io/projected/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-kube-api-access-gf4t7\") pod \"e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") " pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:04.733637 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:04.733535    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:05.046069 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:05.046040    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"]
Sep 16 14:57:05.046875 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:57:05.046848    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c6b494_3987_40cd_a1e5_61aa33a9e1d4.slice/crio-72cfbd8b23220362fb1f45b7f0fb89f18f0e9ff74b28e5150fb60cb4620ffc85 WatchSource:0}: Error finding container 72cfbd8b23220362fb1f45b7f0fb89f18f0e9ff74b28e5150fb60cb4620ffc85: Status 404 returned error can't find the container with id 72cfbd8b23220362fb1f45b7f0fb89f18f0e9ff74b28e5150fb60cb4620ffc85
Sep 16 14:57:05.049132 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:05.049102    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:57:05.049209 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:05.049166    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:57:05.049209 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:05.049193    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:57:05.221164 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:05.221117    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" event={"ID":"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4","Type":"ContainerStarted","Data":"482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e"}
Sep 16 14:57:05.221335 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:05.221180    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" event={"ID":"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4","Type":"ContainerStarted","Data":"72cfbd8b23220362fb1f45b7f0fb89f18f0e9ff74b28e5150fb60cb4620ffc85"}
Sep 16 14:57:05.271416 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:05.271351    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" podStartSLOduration=1.271325118 podStartE2EDuration="1.271325118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:57:05.26695025 +0000 UTC m=+1299.618231959" watchObservedRunningTime="2026-09-16 14:57:05.271325118 +0000 UTC m=+1299.622606831"
Sep 16 14:57:05.733650 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:05.733607    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:06.739169 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:06.739139    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:07.236908 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:07.236858    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:07.247881 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:07.247830    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:07.776357 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:07.776324    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"]
Sep 16 14:57:07.776800 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:07.776564    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j" podUID="bc3d471c-de77-463f-96da-a00a1daf1f28" containerName="istio-proxy" containerID="cri-o://7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c" gracePeriod=30
Sep 16 14:57:08.518032 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.518006    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:57:08.663056 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.662963    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-istio-data\") pod \"d54b5284-549b-46b4-a55b-deff968e9787\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") "
Sep 16 14:57:08.663056 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663025    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-workload-socket\") pod \"d54b5284-549b-46b4-a55b-deff968e9787\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") "
Sep 16 14:57:08.663056 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663044    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-credential-socket\") pod \"d54b5284-549b-46b4-a55b-deff968e9787\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") "
Sep 16 14:57:08.663340 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663117    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d54b5284-549b-46b4-a55b-deff968e9787-istio-podinfo\") pod \"d54b5284-549b-46b4-a55b-deff968e9787\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") "
Sep 16 14:57:08.663340 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663142    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d54b5284-549b-46b4-a55b-deff968e9787-istio-token\") pod \"d54b5284-549b-46b4-a55b-deff968e9787\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") "
Sep 16 14:57:08.663340 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663166    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d54b5284-549b-46b4-a55b-deff968e9787-istiod-ca-cert\") pod \"d54b5284-549b-46b4-a55b-deff968e9787\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") "
Sep 16 14:57:08.663340 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663187    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhtqb\" (UniqueName: \"kubernetes.io/projected/d54b5284-549b-46b4-a55b-deff968e9787-kube-api-access-xhtqb\") pod \"d54b5284-549b-46b4-a55b-deff968e9787\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") "
Sep 16 14:57:08.663340 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663256    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-workload-certs\") pod \"d54b5284-549b-46b4-a55b-deff968e9787\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") "
Sep 16 14:57:08.663340 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663302    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-istio-envoy\") pod \"d54b5284-549b-46b4-a55b-deff968e9787\" (UID: \"d54b5284-549b-46b4-a55b-deff968e9787\") "
Sep 16 14:57:08.663340 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663317    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-istio-data" (OuterVolumeSpecName: "istio-data") pod "d54b5284-549b-46b4-a55b-deff968e9787" (UID: "d54b5284-549b-46b4-a55b-deff968e9787"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:57:08.663752 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663328    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d54b5284-549b-46b4-a55b-deff968e9787" (UID: "d54b5284-549b-46b4-a55b-deff968e9787"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:57:08.663752 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663415    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d54b5284-549b-46b4-a55b-deff968e9787" (UID: "d54b5284-549b-46b4-a55b-deff968e9787"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:57:08.663752 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663686    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d54b5284-549b-46b4-a55b-deff968e9787-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d54b5284-549b-46b4-a55b-deff968e9787" (UID: "d54b5284-549b-46b4-a55b-deff968e9787"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:57:08.663752 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663700    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-workload-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:08.663752 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663717    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-credential-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:08.663752 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663731    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-istio-data\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:08.664057 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.663843    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d54b5284-549b-46b4-a55b-deff968e9787" (UID: "d54b5284-549b-46b4-a55b-deff968e9787"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:57:08.665680 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.665649    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d54b5284-549b-46b4-a55b-deff968e9787" (UID: "d54b5284-549b-46b4-a55b-deff968e9787"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:57:08.665680 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.665650    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d54b5284-549b-46b4-a55b-deff968e9787-istio-token" (OuterVolumeSpecName: "istio-token") pod "d54b5284-549b-46b4-a55b-deff968e9787" (UID: "d54b5284-549b-46b4-a55b-deff968e9787"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:57:08.665931 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.665914    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d54b5284-549b-46b4-a55b-deff968e9787-kube-api-access-xhtqb" (OuterVolumeSpecName: "kube-api-access-xhtqb") pod "d54b5284-549b-46b4-a55b-deff968e9787" (UID: "d54b5284-549b-46b4-a55b-deff968e9787"). InnerVolumeSpecName "kube-api-access-xhtqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:57:08.665995 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.665913    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d54b5284-549b-46b4-a55b-deff968e9787-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d54b5284-549b-46b4-a55b-deff968e9787" (UID: "d54b5284-549b-46b4-a55b-deff968e9787"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:57:08.765117 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.765080    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d54b5284-549b-46b4-a55b-deff968e9787-istio-podinfo\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:08.765117 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.765113    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d54b5284-549b-46b4-a55b-deff968e9787-istio-token\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:08.765117 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.765122    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d54b5284-549b-46b4-a55b-deff968e9787-istiod-ca-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:08.765368 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.765131    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhtqb\" (UniqueName: \"kubernetes.io/projected/d54b5284-549b-46b4-a55b-deff968e9787-kube-api-access-xhtqb\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:08.765368 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.765142    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-workload-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:08.765368 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:08.765151    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d54b5284-549b-46b4-a55b-deff968e9787-istio-envoy\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:09.252239 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.252205    2569 generic.go:356] "Generic (PLEG): container finished" podID="d54b5284-549b-46b4-a55b-deff968e9787" containerID="3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242" exitCode=0
Sep 16 14:57:09.252849 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.252255    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"
Sep 16 14:57:09.252849 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.252287    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" event={"ID":"d54b5284-549b-46b4-a55b-deff968e9787","Type":"ContainerDied","Data":"3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242"}
Sep 16 14:57:09.252849 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.252342    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t" event={"ID":"d54b5284-549b-46b4-a55b-deff968e9787","Type":"ContainerDied","Data":"aa6ea6e3319c83b7611833e924c52445e8bc3dc18d634c1166990bdafc81734c"}
Sep 16 14:57:09.252849 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.252368    2569 scope.go:117] "RemoveContainer" containerID="3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242"
Sep 16 14:57:09.263096 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.263078    2569 scope.go:117] "RemoveContainer" containerID="f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4"
Sep 16 14:57:09.278457 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.278426    2569 scope.go:117] "RemoveContainer" containerID="3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242"
Sep 16 14:57:09.283735 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:57:09.278907    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242\": container with ID starting with 3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242 not found: ID does not exist" containerID="3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242"
Sep 16 14:57:09.283735 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.278951    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242"} err="failed to get container status \"3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242\": rpc error: code = NotFound desc = could not find container \"3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242\": container with ID starting with 3849ea7af73d5fa378fc9db2e3dfe7d427e9fde6a87b0b7451ec7031d1a1e242 not found: ID does not exist"
Sep 16 14:57:09.283735 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.278978    2569 scope.go:117] "RemoveContainer" containerID="f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4"
Sep 16 14:57:09.283735 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:57:09.279271    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4\": container with ID starting with f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4 not found: ID does not exist" containerID="f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4"
Sep 16 14:57:09.283735 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.279312    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4"} err="failed to get container status \"f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4\": rpc error: code = NotFound desc = could not find container \"f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4\": container with ID starting with f69a7998b074440c54d9f66e0da3e1d1f3527d10eb76f885675373e584c6f4a4 not found: ID does not exist"
Sep 16 14:57:09.285177 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.285117    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"]
Sep 16 14:57:09.302624 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.302592    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t"]
Sep 16 14:57:09.668763 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.668667    2569 patch_prober.go:28] interesting pod/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 14:57:09.668943 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:09.668782    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j" podUID="bc3d471c-de77-463f-96da-a00a1daf1f28" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:57:10.088634 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:10.088595    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d54b5284-549b-46b4-a55b-deff968e9787" path="/var/lib/kubelet/pods/d54b5284-549b-46b4-a55b-deff968e9787/volumes"
Sep 16 14:57:13.031411 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.031383    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:57:13.113463 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113369    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-data\") pod \"bc3d471c-de77-463f-96da-a00a1daf1f28\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") "
Sep 16 14:57:13.113463 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113441    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-credential-socket\") pod \"bc3d471c-de77-463f-96da-a00a1daf1f28\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") "
Sep 16 14:57:13.113773 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113473    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-token\") pod \"bc3d471c-de77-463f-96da-a00a1daf1f28\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") "
Sep 16 14:57:13.113773 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113548    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-workload-certs\") pod \"bc3d471c-de77-463f-96da-a00a1daf1f28\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") "
Sep 16 14:57:13.113773 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113596    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-workload-socket\") pod \"bc3d471c-de77-463f-96da-a00a1daf1f28\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") "
Sep 16 14:57:13.113773 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113642    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-podinfo\") pod \"bc3d471c-de77-463f-96da-a00a1daf1f28\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") "
Sep 16 14:57:13.113773 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113677    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc3d471c-de77-463f-96da-a00a1daf1f28" (UID: "bc3d471c-de77-463f-96da-a00a1daf1f28"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:57:13.113773 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113705    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-envoy\") pod \"bc3d471c-de77-463f-96da-a00a1daf1f28\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") "
Sep 16 14:57:13.113773 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113718    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc3d471c-de77-463f-96da-a00a1daf1f28" (UID: "bc3d471c-de77-463f-96da-a00a1daf1f28"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:57:13.113773 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113753    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l58qx\" (UniqueName: \"kubernetes.io/projected/bc3d471c-de77-463f-96da-a00a1daf1f28-kube-api-access-l58qx\") pod \"bc3d471c-de77-463f-96da-a00a1daf1f28\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") "
Sep 16 14:57:13.114158 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113788    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc3d471c-de77-463f-96da-a00a1daf1f28-istiod-ca-cert\") pod \"bc3d471c-de77-463f-96da-a00a1daf1f28\" (UID: \"bc3d471c-de77-463f-96da-a00a1daf1f28\") "
Sep 16 14:57:13.114158 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113862    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc3d471c-de77-463f-96da-a00a1daf1f28" (UID: "bc3d471c-de77-463f-96da-a00a1daf1f28"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:57:13.114158 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.113897    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc3d471c-de77-463f-96da-a00a1daf1f28" (UID: "bc3d471c-de77-463f-96da-a00a1daf1f28"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:57:13.114303 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.114199    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-data\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:13.114303 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.114220    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-credential-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:13.114303 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.114221    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc3d471c-de77-463f-96da-a00a1daf1f28-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc3d471c-de77-463f-96da-a00a1daf1f28" (UID: "bc3d471c-de77-463f-96da-a00a1daf1f28"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:57:13.114303 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.114235    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-workload-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:13.114303 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.114251    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-workload-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:13.115920 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.115896    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc3d471c-de77-463f-96da-a00a1daf1f28" (UID: "bc3d471c-de77-463f-96da-a00a1daf1f28"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:57:13.116035 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.115980    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc3d471c-de77-463f-96da-a00a1daf1f28-kube-api-access-l58qx" (OuterVolumeSpecName: "kube-api-access-l58qx") pod "bc3d471c-de77-463f-96da-a00a1daf1f28" (UID: "bc3d471c-de77-463f-96da-a00a1daf1f28"). InnerVolumeSpecName "kube-api-access-l58qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:57:13.116281 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.116258    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc3d471c-de77-463f-96da-a00a1daf1f28" (UID: "bc3d471c-de77-463f-96da-a00a1daf1f28"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:57:13.116379 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.116261    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc3d471c-de77-463f-96da-a00a1daf1f28" (UID: "bc3d471c-de77-463f-96da-a00a1daf1f28"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:57:13.215235 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.215168    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-podinfo\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:13.215235 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.215207    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-envoy\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:13.215235 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.215226    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l58qx\" (UniqueName: \"kubernetes.io/projected/bc3d471c-de77-463f-96da-a00a1daf1f28-kube-api-access-l58qx\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:13.215235 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.215243    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc3d471c-de77-463f-96da-a00a1daf1f28-istiod-ca-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:13.215575 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.215258    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc3d471c-de77-463f-96da-a00a1daf1f28-istio-token\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:57:13.281398 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.281363    2569 generic.go:356] "Generic (PLEG): container finished" podID="bc3d471c-de77-463f-96da-a00a1daf1f28" containerID="7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c" exitCode=0
Sep 16 14:57:13.281625 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.281407    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"
Sep 16 14:57:13.281625 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.281449    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j" event={"ID":"bc3d471c-de77-463f-96da-a00a1daf1f28","Type":"ContainerDied","Data":"7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c"}
Sep 16 14:57:13.281625 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.281533    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j" event={"ID":"bc3d471c-de77-463f-96da-a00a1daf1f28","Type":"ContainerDied","Data":"e163c2c3380ecd630f00c4a74f396781343d56bdb1625690973e351f5f146467"}
Sep 16 14:57:13.281625 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.281564    2569 scope.go:117] "RemoveContainer" containerID="7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c"
Sep 16 14:57:13.292798 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.292776    2569 scope.go:117] "RemoveContainer" containerID="7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c"
Sep 16 14:57:13.293066 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:57:13.293044    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c\": container with ID starting with 7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c not found: ID does not exist" containerID="7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c"
Sep 16 14:57:13.293120 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.293075    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c"} err="failed to get container status \"7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c\": rpc error: code = NotFound desc = could not find container \"7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c\": container with ID starting with 7ab3b541064bbaa73a317b24314651e7ebb11a13ee086d411c43f574c78e2c3c not found: ID does not exist"
Sep 16 14:57:13.309791 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.309759    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"]
Sep 16 14:57:13.315427 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:13.315399    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j"]
Sep 16 14:57:14.088989 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:14.088955    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc3d471c-de77-463f-96da-a00a1daf1f28" path="/var/lib/kubelet/pods/bc3d471c-de77-463f-96da-a00a1daf1f28/volumes"
Sep 16 14:57:15.229100 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.229070    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"]
Sep 16 14:57:15.229587 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.229480    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d54b5284-549b-46b4-a55b-deff968e9787" containerName="istio-proxy"
Sep 16 14:57:15.229587 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.229510    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d54b5284-549b-46b4-a55b-deff968e9787" containerName="istio-proxy"
Sep 16 14:57:15.229587 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.229519    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d54b5284-549b-46b4-a55b-deff968e9787" containerName="istio-proxy"
Sep 16 14:57:15.229587 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.229525    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d54b5284-549b-46b4-a55b-deff968e9787" containerName="istio-proxy"
Sep 16 14:57:15.229587 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.229534    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy"
Sep 16 14:57:15.229587 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.229540    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy"
Sep 16 14:57:15.229587 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.229550    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3d471c-de77-463f-96da-a00a1daf1f28" containerName="istio-proxy"
Sep 16 14:57:15.229587 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.229556    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3d471c-de77-463f-96da-a00a1daf1f28" containerName="istio-proxy"
Sep 16 14:57:15.229853 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.229617    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="026b604d-55ca-45db-9db8-4985cb9e51d2" containerName="istio-proxy"
Sep 16 14:57:15.229853 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.229627    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d54b5284-549b-46b4-a55b-deff968e9787" containerName="istio-proxy"
Sep 16 14:57:15.229853 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.229636    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc3d471c-de77-463f-96da-a00a1daf1f28" containerName="istio-proxy"
Sep 16 14:57:15.234230 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.234212    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.241750 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.241728    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-d28bd5-serving-cert\""
Sep 16 14:57:15.254234 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.254202    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"]
Sep 16 14:57:15.335341 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.335305    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f2a440-babf-4ec5-8ca6-1859f5895554-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.335529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.335429    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trlv4\" (UniqueName: \"kubernetes.io/projected/42f2a440-babf-4ec5-8ca6-1859f5895554-kube-api-access-trlv4\") pod \"maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.335529 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.335479    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42f2a440-babf-4ec5-8ca6-1859f5895554-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.335642 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.335529    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42f2a440-babf-4ec5-8ca6-1859f5895554-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.436254 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.436219    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42f2a440-babf-4ec5-8ca6-1859f5895554-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.436435 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.436271    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f2a440-babf-4ec5-8ca6-1859f5895554-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.436435 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.436370    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trlv4\" (UniqueName: \"kubernetes.io/projected/42f2a440-babf-4ec5-8ca6-1859f5895554-kube-api-access-trlv4\") pod \"maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.436435 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.436401    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42f2a440-babf-4ec5-8ca6-1859f5895554-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.436939 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.436915    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42f2a440-babf-4ec5-8ca6-1859f5895554-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.439002 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.438980    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f2a440-babf-4ec5-8ca6-1859f5895554-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.439054 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.438980    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42f2a440-babf-4ec5-8ca6-1859f5895554-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.448724 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.448692    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trlv4\" (UniqueName: \"kubernetes.io/projected/42f2a440-babf-4ec5-8ca6-1859f5895554-kube-api-access-trlv4\") pod \"maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.545165 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.545128    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:15.825080 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:15.825052    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"]
Sep 16 14:57:15.826145 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:57:15.826110    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f2a440_babf_4ec5_8ca6_1859f5895554.slice/crio-58ff7b01d5ddf62b3d833d7624809fb9e5a3fa44577129f5c7bb7c6dbb081682 WatchSource:0}: Error finding container 58ff7b01d5ddf62b3d833d7624809fb9e5a3fa44577129f5c7bb7c6dbb081682: Status 404 returned error can't find the container with id 58ff7b01d5ddf62b3d833d7624809fb9e5a3fa44577129f5c7bb7c6dbb081682
Sep 16 14:57:16.300562 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:16.300527    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t" event={"ID":"42f2a440-babf-4ec5-8ca6-1859f5895554","Type":"ContainerStarted","Data":"58ff7b01d5ddf62b3d833d7624809fb9e5a3fa44577129f5c7bb7c6dbb081682"}
Sep 16 14:57:17.308739 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:17.308700    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t" event={"ID":"42f2a440-babf-4ec5-8ca6-1859f5895554","Type":"ContainerStarted","Data":"d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca"}
Sep 16 14:57:17.309149 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:17.308828    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:17.363286 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:17.363216    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t" podStartSLOduration=1.8817220479999999 podStartE2EDuration="2.3632002s" totalImagesPullingTime="481.478152ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:57:17.360304739 +0000 UTC m=+1311.711586448" watchObservedRunningTime="2026-09-16 14:57:17.3632002 +0000 UTC m=+1311.714481909"
Sep 16 14:57:23.320260 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:23.320222    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 14:57:24.015577 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.015540    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"]
Sep 16 14:57:24.016031 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.016018    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d54b5284-549b-46b4-a55b-deff968e9787" containerName="istio-proxy"
Sep 16 14:57:24.019187 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.019173    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.022403 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.022378    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-780e10\"/\"distinct-2-w0-780e10-kserve-self-signed-certs\""
Sep 16 14:57:24.026188 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.025980    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d47999a2-2a91-4e15-bba9-7821aa5c85e7-tls-certs\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.026188 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.026044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-tmp-dir\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.026188 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.026155    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-dshm\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.026380 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.026195    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-home\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.026380 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.026324    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-model-cache\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.026542 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.026378    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmgq5\" (UniqueName: \"kubernetes.io/projected/d47999a2-2a91-4e15-bba9-7821aa5c85e7-kube-api-access-wmgq5\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.031828 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.031804    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"]
Sep 16 14:57:24.127656 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.127621    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d47999a2-2a91-4e15-bba9-7821aa5c85e7-tls-certs\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.127850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.127672    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-tmp-dir\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.127850 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.127715    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-dshm\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.127971 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.127838    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-home\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.128030 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.127964    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-model-cache\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.128030 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.128022    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmgq5\" (UniqueName: \"kubernetes.io/projected/d47999a2-2a91-4e15-bba9-7821aa5c85e7-kube-api-access-wmgq5\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.128149 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.128099    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-tmp-dir\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.128199 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.128169    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-home\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.128319 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.128300    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-model-cache\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.129942 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.129919    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-dshm\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.130191 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.130174    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d47999a2-2a91-4e15-bba9-7821aa5c85e7-tls-certs\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.140092 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.140061    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmgq5\" (UniqueName: \"kubernetes.io/projected/d47999a2-2a91-4e15-bba9-7821aa5c85e7-kube-api-access-wmgq5\") pod \"distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") " pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.329596 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.329479    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:24.618917 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:24.618890    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"]
Sep 16 14:57:24.619975 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:57:24.619950    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd47999a2_2a91_4e15_bba9_7821aa5c85e7.slice/crio-272fa82b0e867534d7cc64fb312bf8feb726edd04fef5b91709ff0f7b0e72bf3 WatchSource:0}: Error finding container 272fa82b0e867534d7cc64fb312bf8feb726edd04fef5b91709ff0f7b0e72bf3: Status 404 returned error can't find the container with id 272fa82b0e867534d7cc64fb312bf8feb726edd04fef5b91709ff0f7b0e72bf3
Sep 16 14:57:25.358801 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:25.358759    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8" event={"ID":"d47999a2-2a91-4e15-bba9-7821aa5c85e7","Type":"ContainerStarted","Data":"ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93"}
Sep 16 14:57:25.359220 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:25.358813    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8" event={"ID":"d47999a2-2a91-4e15-bba9-7821aa5c85e7","Type":"ContainerStarted","Data":"272fa82b0e867534d7cc64fb312bf8feb726edd04fef5b91709ff0f7b0e72bf3"}
Sep 16 14:57:25.390636 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:25.390584    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8" podStartSLOduration=2.3905686 podStartE2EDuration="2.3905686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:57:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:57:25.389259362 +0000 UTC m=+1319.740541070" watchObservedRunningTime="2026-09-16 14:57:25.3905686 +0000 UTC m=+1319.741850309"
Sep 16 14:57:34.330103 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:34.330070    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:34.330549 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:34.330120    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:34.342341 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:34.342316    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:34.420729 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:34.420699    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 14:57:35.417250 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:35.417168    2569 generic.go:356] "Generic (PLEG): container finished" podID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerID="482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e" exitCode=0
Sep 16 14:57:35.417633 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:35.417244    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" event={"ID":"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4","Type":"ContainerDied","Data":"482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e"}
Sep 16 14:57:35.417691 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:35.417669    2569 scope.go:117] "RemoveContainer" containerID="482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e"
Sep 16 14:57:35.418879 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:35.418850    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:57:35.418958 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:35.418925    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:57:35.418996 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:35.418956    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:57:36.424853 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:36.424821    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" event={"ID":"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4","Type":"ContainerStarted","Data":"cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066"}
Sep 16 14:57:36.751675 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:36.751636    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:36.752743 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:36.752713    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 16 14:57:36.752874 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:36.752788    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 16 14:57:37.237122 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:37.237027    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:37.734406 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:37.734365    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 16 14:57:37.734919 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:37.734444    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 16 14:57:38.734391 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:38.734353    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 16 14:57:38.734742 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:38.734709    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 16 14:57:39.734245 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:39.734207    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 16 14:57:39.734554 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:39.734519    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 16 14:57:40.735003 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:40.734964    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 16 14:57:40.735696 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:40.735665    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 16 14:57:41.737964 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:41.737932    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:41.738883 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:41.738862    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 14:57:53.159422 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.159324    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"]
Sep 16 14:57:53.162599 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.162578    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.165121 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.165097    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-cadcf4-serving-cert\""
Sep 16 14:57:53.192576 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.192550    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"]
Sep 16 14:57:53.330436 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.330402    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.330658 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.330487    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.330658 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.330623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsh69\" (UniqueName: \"kubernetes.io/projected/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-kube-api-access-bsh69\") pod \"maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.330757 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.330732    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.431675 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.431601    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.431675 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.431644    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.431886 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.431677    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.431886 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.431747    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsh69\" (UniqueName: \"kubernetes.io/projected/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-kube-api-access-bsh69\") pod \"maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.432381 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.432358    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.434077 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.434050    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.434175 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.434103    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.443668 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.443646    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsh69\" (UniqueName: \"kubernetes.io/projected/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-kube-api-access-bsh69\") pod \"maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.472447 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.472425    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:53.751642 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:53.751610    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"]
Sep 16 14:57:53.752663 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:57:53.752637    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb208d4f3_7b40_48d0_8d1f_fc3a74a7e06a.slice/crio-ebcfc1c8ca92896967c612ae19e89eb27122fc8e7fac568ba1dcf516e2b16930 WatchSource:0}: Error finding container ebcfc1c8ca92896967c612ae19e89eb27122fc8e7fac568ba1dcf516e2b16930: Status 404 returned error can't find the container with id ebcfc1c8ca92896967c612ae19e89eb27122fc8e7fac568ba1dcf516e2b16930
Sep 16 14:57:54.554604 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:54.554563    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6" event={"ID":"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a","Type":"ContainerStarted","Data":"b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d"}
Sep 16 14:57:54.555036 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:54.554751    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:57:54.555036 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:54.554793    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6" event={"ID":"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a","Type":"ContainerStarted","Data":"ebcfc1c8ca92896967c612ae19e89eb27122fc8e7fac568ba1dcf516e2b16930"}
Sep 16 14:57:54.585033 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:57:54.584978    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6" podStartSLOduration=0.958761593 podStartE2EDuration="1.584962439s" totalImagesPullingTime="626.200846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:57:54.584609289 +0000 UTC m=+1348.935890999" watchObservedRunningTime="2026-09-16 14:57:54.584962439 +0000 UTC m=+1348.936244177"
Sep 16 14:58:00.566186 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:58:00.566154    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 14:59:17.976705 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:17.976672    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"]
Sep 16 14:59:17.977149 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:17.976858    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd" podUID="f8e4b266-d5fb-422f-b585-949268afacfd" containerName="maas-api" containerID="cri-o://34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f" gracePeriod=30
Sep 16 14:59:18.219661 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.219628    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:59:18.258414 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.258385    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e4b266-d5fb-422f-b585-949268afacfd-openshift-service-ca\") pod \"f8e4b266-d5fb-422f-b585-949268afacfd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") "
Sep 16 14:59:18.258582 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.258471    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e4b266-d5fb-422f-b585-949268afacfd-metrics-certs\") pod \"f8e4b266-d5fb-422f-b585-949268afacfd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") "
Sep 16 14:59:18.258582 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.258523    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvd2b\" (UniqueName: \"kubernetes.io/projected/f8e4b266-d5fb-422f-b585-949268afacfd-kube-api-access-lvd2b\") pod \"f8e4b266-d5fb-422f-b585-949268afacfd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") "
Sep 16 14:59:18.258582 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.258560    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e4b266-d5fb-422f-b585-949268afacfd-maas-api-tls\") pod \"f8e4b266-d5fb-422f-b585-949268afacfd\" (UID: \"f8e4b266-d5fb-422f-b585-949268afacfd\") "
Sep 16 14:59:18.258802 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.258775    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8e4b266-d5fb-422f-b585-949268afacfd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8e4b266-d5fb-422f-b585-949268afacfd" (UID: "f8e4b266-d5fb-422f-b585-949268afacfd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:59:18.259046 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.259023    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e4b266-d5fb-422f-b585-949268afacfd-openshift-service-ca\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:59:18.260592 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.260560    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8e4b266-d5fb-422f-b585-949268afacfd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8e4b266-d5fb-422f-b585-949268afacfd" (UID: "f8e4b266-d5fb-422f-b585-949268afacfd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:59:18.260592 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.260578    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8e4b266-d5fb-422f-b585-949268afacfd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f8e4b266-d5fb-422f-b585-949268afacfd" (UID: "f8e4b266-d5fb-422f-b585-949268afacfd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:59:18.260713 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.260636    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e4b266-d5fb-422f-b585-949268afacfd-kube-api-access-lvd2b" (OuterVolumeSpecName: "kube-api-access-lvd2b") pod "f8e4b266-d5fb-422f-b585-949268afacfd" (UID: "f8e4b266-d5fb-422f-b585-949268afacfd"). InnerVolumeSpecName "kube-api-access-lvd2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:59:18.360452 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.360395    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e4b266-d5fb-422f-b585-949268afacfd-metrics-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:59:18.360452 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.360418    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvd2b\" (UniqueName: \"kubernetes.io/projected/f8e4b266-d5fb-422f-b585-949268afacfd-kube-api-access-lvd2b\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:59:18.360452 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:18.360429    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e4b266-d5fb-422f-b585-949268afacfd-maas-api-tls\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 14:59:19.063560 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:19.063521    2569 generic.go:356] "Generic (PLEG): container finished" podID="f8e4b266-d5fb-422f-b585-949268afacfd" containerID="34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f" exitCode=0
Sep 16 14:59:19.064021 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:19.063627    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"
Sep 16 14:59:19.064021 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:19.063649    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd" event={"ID":"f8e4b266-d5fb-422f-b585-949268afacfd","Type":"ContainerDied","Data":"34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f"}
Sep 16 14:59:19.064021 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:19.063712    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd" event={"ID":"f8e4b266-d5fb-422f-b585-949268afacfd","Type":"ContainerDied","Data":"88cad510ace8447d8ea3e0710f78ce895bd4d785376a610e9ca8f8d9a7305184"}
Sep 16 14:59:19.064021 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:19.063742    2569 scope.go:117] "RemoveContainer" containerID="34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f"
Sep 16 14:59:19.077985 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:19.077959    2569 scope.go:117] "RemoveContainer" containerID="34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f"
Sep 16 14:59:19.078290 ip-10-0-132-120 kubenswrapper[2569]: E0916 14:59:19.078267    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f\": container with ID starting with 34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f not found: ID does not exist" containerID="34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f"
Sep 16 14:59:19.078350 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:19.078297    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f"} err="failed to get container status \"34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f\": rpc error: code = NotFound desc = could not find container \"34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f\": container with ID starting with 34be948084ec72e484d58ed698e98978990edd1a4657e90b425fd7873173424f not found: ID does not exist"
Sep 16 14:59:19.100504 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:19.100468    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"]
Sep 16 14:59:19.107091 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:19.107069    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-adb97937-7946664658-qrzcd"]
Sep 16 14:59:20.087832 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:20.087799    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8e4b266-d5fb-422f-b585-949268afacfd" path="/var/lib/kubelet/pods/f8e4b266-d5fb-422f-b585-949268afacfd/volumes"
Sep 16 14:59:21.225463 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.225429    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"]
Sep 16 14:59:21.225867 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.225854    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e4b266-d5fb-422f-b585-949268afacfd" containerName="maas-api"
Sep 16 14:59:21.225867 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.225868    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e4b266-d5fb-422f-b585-949268afacfd" containerName="maas-api"
Sep 16 14:59:21.225965 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.225955    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8e4b266-d5fb-422f-b585-949268afacfd" containerName="maas-api"
Sep 16 14:59:21.230182 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.230165    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.233753 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.233732    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-e33b3f\"/\"kube-root-ca.crt\""
Sep 16 14:59:21.233843 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.233734    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-e33b3f\"/\"default-dockercfg-kg2wc\""
Sep 16 14:59:21.233843 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.233805    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-e33b3f\"/\"distinct-w4-e33b3f-kserve-self-signed-certs\""
Sep 16 14:59:21.236694 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.236573    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-e33b3f\"/\"openshift-service-ca.crt\""
Sep 16 14:59:21.243320 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.243300    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"]
Sep 16 14:59:21.288608 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.288586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-home\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.288736 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.288625    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-tls-certs\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.288736 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.288729    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-model-cache\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.288829 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.288747    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-tmp-dir\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.288829 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.288786    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rnjw\" (UniqueName: \"kubernetes.io/projected/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-kube-api-access-2rnjw\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.288934 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.288879    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-dshm\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.390309 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.390280    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-tls-certs\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.390452 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.390357    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-model-cache\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.390452 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.390375    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-tmp-dir\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.390452 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.390404    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rnjw\" (UniqueName: \"kubernetes.io/projected/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-kube-api-access-2rnjw\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.390452 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.390428    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-dshm\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.390700 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.390516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-home\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.390846 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.390824    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-tmp-dir\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.390916 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.390864    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-model-cache\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.390958 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.390912    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-home\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.392527 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.392503    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-dshm\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.392752 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.392736    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-tls-certs\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.406658 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.406639    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rnjw\" (UniqueName: \"kubernetes.io/projected/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-kube-api-access-2rnjw\") pod \"distinct-w4-e33b3f-kserve-85d9db698c-lr848\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") " pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.539070 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.539032    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:21.825835 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:21.825809    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"]
Sep 16 14:59:21.827021 ip-10-0-132-120 kubenswrapper[2569]: W0916 14:59:21.826992    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ef6dc77_88a6_4b78_8006_2bd82b0369ff.slice/crio-033994c78a7f48b7f92da5f41f2f279d35ab040ac5546f2b384aa03e566fc9b4 WatchSource:0}: Error finding container 033994c78a7f48b7f92da5f41f2f279d35ab040ac5546f2b384aa03e566fc9b4: Status 404 returned error can't find the container with id 033994c78a7f48b7f92da5f41f2f279d35ab040ac5546f2b384aa03e566fc9b4
Sep 16 14:59:22.088630 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:22.088538    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848" event={"ID":"7ef6dc77-88a6-4b78-8006-2bd82b0369ff","Type":"ContainerStarted","Data":"472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c"}
Sep 16 14:59:22.088630 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:22.088622    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848" event={"ID":"7ef6dc77-88a6-4b78-8006-2bd82b0369ff","Type":"ContainerStarted","Data":"033994c78a7f48b7f92da5f41f2f279d35ab040ac5546f2b384aa03e566fc9b4"}
Sep 16 14:59:22.112076 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:22.112021    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848" podStartSLOduration=1.112005096 podStartE2EDuration="1.112005096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:59:22.108956 +0000 UTC m=+1436.460237708" watchObservedRunningTime="2026-09-16 14:59:22.112005096 +0000 UTC m=+1436.463286856"
Sep 16 14:59:31.539562 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:31.539525    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:31.539920 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:31.539576    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:31.551840 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:31.551814    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 14:59:32.148924 ip-10-0-132-120 kubenswrapper[2569]: I0916 14:59:32.148893    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 15:00:00.243327 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:00.243289    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq"]
Sep 16 15:00:00.246728 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:00.246704    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq"
Sep 16 15:00:00.249343 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:00.249323    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5dqq2\""
Sep 16 15:00:00.256588 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:00.256568    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq"
Sep 16 15:00:00.264161 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:00.264139    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq"]
Sep 16 15:00:00.539280 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:00.539253    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq"]
Sep 16 15:00:00.540939 ip-10-0-132-120 kubenswrapper[2569]: W0916 15:00:00.540908    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4d4ed7_26cc_4006_9886_b18365fc25c1.slice/crio-bff949844aa62f2cbb4b01a7d131a9b3b2aead647ae1ce475e07240a251ca243 WatchSource:0}: Error finding container bff949844aa62f2cbb4b01a7d131a9b3b2aead647ae1ce475e07240a251ca243: Status 404 returned error can't find the container with id bff949844aa62f2cbb4b01a7d131a9b3b2aead647ae1ce475e07240a251ca243
Sep 16 15:00:01.306501 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:01.306456    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq" event={"ID":"fd4d4ed7-26cc-4006-9886-b18365fc25c1","Type":"ContainerStarted","Data":"bff949844aa62f2cbb4b01a7d131a9b3b2aead647ae1ce475e07240a251ca243"}
Sep 16 15:00:04.328861 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:04.328822    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq" event={"ID":"fd4d4ed7-26cc-4006-9886-b18365fc25c1","Type":"ContainerStarted","Data":"ea9f20a147c663338bcb3ca19abc37e9e97187c3b31235a82cd855fe758f20fd"}
Sep 16 15:00:04.346854 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:04.346803    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq" podStartSLOduration=1.408971784 podStartE2EDuration="4.346788098s" totalImagesPullingTime="2.937816314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:00:04.343954078 +0000 UTC m=+1478.695235784" watchObservedRunningTime="2026-09-16 15:00:04.346788098 +0000 UTC m=+1478.698069806"
Sep 16 15:00:05.336028 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:05.335986    2569 generic.go:356] "Generic (PLEG): container finished" podID="fd4d4ed7-26cc-4006-9886-b18365fc25c1" containerID="ea9f20a147c663338bcb3ca19abc37e9e97187c3b31235a82cd855fe758f20fd" exitCode=0
Sep 16 15:00:05.336450 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:05.336037    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq" event={"ID":"fd4d4ed7-26cc-4006-9886-b18365fc25c1","Type":"ContainerDied","Data":"ea9f20a147c663338bcb3ca19abc37e9e97187c3b31235a82cd855fe758f20fd"}
Sep 16 15:00:06.476248 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:06.476218    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq"
Sep 16 15:00:07.348110 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:07.348079    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq"
Sep 16 15:00:07.348318 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:07.348118    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq" event={"ID":"fd4d4ed7-26cc-4006-9886-b18365fc25c1","Type":"ContainerDied","Data":"bff949844aa62f2cbb4b01a7d131a9b3b2aead647ae1ce475e07240a251ca243"}
Sep 16 15:00:07.348318 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:07.348162    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bff949844aa62f2cbb4b01a7d131a9b3b2aead647ae1ce475e07240a251ca243"
Sep 16 15:00:26.185795 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:26.185766    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 15:00:26.189883 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:00:26.189862    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 15:01:51.735913 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.735883    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"]
Sep 16 15:01:51.736421 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.736329    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd4d4ed7-26cc-4006-9886-b18365fc25c1" containerName="cleanup"
Sep 16 15:01:51.736421 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.736343    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd4d4ed7-26cc-4006-9886-b18365fc25c1" containerName="cleanup"
Sep 16 15:01:51.736545 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.736424    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd4d4ed7-26cc-4006-9886-b18365fc25c1" containerName="cleanup"
Sep 16 15:01:51.739610 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.739591    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:51.741871 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.741848    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-079e6e-serving-cert\""
Sep 16 15:01:51.758372 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.758350    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"]
Sep 16 15:01:51.842941 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.842904    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ad9792-551a-46be-baa3-c925c83c53a4-openshift-service-ca\") pod \"maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:51.842941 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.842936    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn2gx\" (UniqueName: \"kubernetes.io/projected/a4ad9792-551a-46be-baa3-c925c83c53a4-kube-api-access-dn2gx\") pod \"maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:51.843150 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.842959    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4ad9792-551a-46be-baa3-c925c83c53a4-maas-api-tls\") pod \"maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:51.843150 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.843055    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4ad9792-551a-46be-baa3-c925c83c53a4-metrics-certs\") pod \"maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:51.944152 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.944118    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ad9792-551a-46be-baa3-c925c83c53a4-openshift-service-ca\") pod \"maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:51.944152 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.944152    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn2gx\" (UniqueName: \"kubernetes.io/projected/a4ad9792-551a-46be-baa3-c925c83c53a4-kube-api-access-dn2gx\") pod \"maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:51.944408 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.944189    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4ad9792-551a-46be-baa3-c925c83c53a4-maas-api-tls\") pod \"maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:51.944408 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.944256    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4ad9792-551a-46be-baa3-c925c83c53a4-metrics-certs\") pod \"maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:51.944892 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.944871    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ad9792-551a-46be-baa3-c925c83c53a4-openshift-service-ca\") pod \"maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:51.946666 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.946643    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4ad9792-551a-46be-baa3-c925c83c53a4-metrics-certs\") pod \"maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:51.946774 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.946717    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4ad9792-551a-46be-baa3-c925c83c53a4-maas-api-tls\") pod \"maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:51.954549 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:51.954528    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn2gx\" (UniqueName: \"kubernetes.io/projected/a4ad9792-551a-46be-baa3-c925c83c53a4-kube-api-access-dn2gx\") pod \"maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:52.050269 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:52.050244    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:52.337541 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:52.330987    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"]
Sep 16 15:01:52.341758 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:52.338876    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 15:01:52.341758 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:52.338872    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"]
Sep 16 15:01:52.347895 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:52.347839    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"]
Sep 16 15:01:52.379785 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:52.379761    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"]
Sep 16 15:01:52.972674 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:52.972637    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr" event={"ID":"a4ad9792-551a-46be-baa3-c925c83c53a4","Type":"ContainerStarted","Data":"754ab6a8ba80cecef125bedee3c9ed58e138fedef7aefb7577b969816bc294c1"}
Sep 16 15:01:53.979715 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:53.979681    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr" event={"ID":"a4ad9792-551a-46be-baa3-c925c83c53a4","Type":"ContainerStarted","Data":"ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2"}
Sep 16 15:01:53.980130 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:53.979742    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:01:53.999643 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:53.999593    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr" podStartSLOduration=2.192737538 podStartE2EDuration="2.999578954s" totalImagesPullingTime="806.841416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:01:53.9966319 +0000 UTC m=+1588.347913610" watchObservedRunningTime="2026-09-16 15:01:53.999578954 +0000 UTC m=+1588.350860717"
Sep 16 15:01:59.990608 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:01:59.990578    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:02:07.365671 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.365603    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8" podUID="d47999a2-2a91-4e15-bba9-7821aa5c85e7" containerName="main" containerID="cri-o://ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93" gracePeriod=45
Sep 16 15:02:07.375855 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.375822    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m" podUID="b24b758d-7fb4-4cd3-a6ed-7c682b623845" containerName="main" containerID="cri-o://9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6" gracePeriod=45
Sep 16 15:02:07.398684 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.398646    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m" podUID="d647ef3e-3d75-4807-a29d-94dbb1f3a603" containerName="main" containerID="cri-o://5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54" gracePeriod=45
Sep 16 15:02:07.676290 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.676269    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 15:02:07.678974 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.678954    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 15:02:07.682355 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.682332    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 15:02:07.805965 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.805924    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-model-cache\") pod \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") "
Sep 16 15:02:07.806150 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.805979    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtdn8\" (UniqueName: \"kubernetes.io/projected/d647ef3e-3d75-4807-a29d-94dbb1f3a603-kube-api-access-qtdn8\") pod \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") "
Sep 16 15:02:07.806150 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806008    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-tmp-dir\") pod \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") "
Sep 16 15:02:07.806150 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806036    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-dshm\") pod \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") "
Sep 16 15:02:07.806150 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806052    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-dshm\") pod \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") "
Sep 16 15:02:07.806150 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806080    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d647ef3e-3d75-4807-a29d-94dbb1f3a603-tls-certs\") pod \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") "
Sep 16 15:02:07.806150 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806145    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-home\") pod \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") "
Sep 16 15:02:07.806482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806190    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-tmp-dir\") pod \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") "
Sep 16 15:02:07.806482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806213    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-home\") pod \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") "
Sep 16 15:02:07.806482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806266    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-model-cache\") pod \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") "
Sep 16 15:02:07.806482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806255    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-model-cache" (OuterVolumeSpecName: "model-cache") pod "d47999a2-2a91-4e15-bba9-7821aa5c85e7" (UID: "d47999a2-2a91-4e15-bba9-7821aa5c85e7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:07.806482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806288    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-model-cache\") pod \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") "
Sep 16 15:02:07.806482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806334    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b24b758d-7fb4-4cd3-a6ed-7c682b623845" (UID: "b24b758d-7fb4-4cd3-a6ed-7c682b623845"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:07.806482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806348    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d47999a2-2a91-4e15-bba9-7821aa5c85e7-tls-certs\") pod \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") "
Sep 16 15:02:07.806482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806414    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-home\") pod \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\" (UID: \"d647ef3e-3d75-4807-a29d-94dbb1f3a603\") "
Sep 16 15:02:07.806482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806442    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzfdz\" (UniqueName: \"kubernetes.io/projected/b24b758d-7fb4-4cd3-a6ed-7c682b623845-kube-api-access-pzfdz\") pod \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") "
Sep 16 15:02:07.806482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806440    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-model-cache" (OuterVolumeSpecName: "model-cache") pod "b24b758d-7fb4-4cd3-a6ed-7c682b623845" (UID: "b24b758d-7fb4-4cd3-a6ed-7c682b623845"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:07.806482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806473    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b24b758d-7fb4-4cd3-a6ed-7c682b623845-tls-certs\") pod \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\" (UID: \"b24b758d-7fb4-4cd3-a6ed-7c682b623845\") "
Sep 16 15:02:07.807069 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806522    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmgq5\" (UniqueName: \"kubernetes.io/projected/d47999a2-2a91-4e15-bba9-7821aa5c85e7-kube-api-access-wmgq5\") pod \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") "
Sep 16 15:02:07.807069 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806545    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-home" (OuterVolumeSpecName: "home") pod "d47999a2-2a91-4e15-bba9-7821aa5c85e7" (UID: "d47999a2-2a91-4e15-bba9-7821aa5c85e7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:07.807069 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806551    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-tmp-dir\") pod \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") "
Sep 16 15:02:07.807069 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806571    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-home" (OuterVolumeSpecName: "home") pod "b24b758d-7fb4-4cd3-a6ed-7c682b623845" (UID: "b24b758d-7fb4-4cd3-a6ed-7c682b623845"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:07.807069 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806613    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-dshm\") pod \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\" (UID: \"d47999a2-2a91-4e15-bba9-7821aa5c85e7\") "
Sep 16 15:02:07.807069 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806652    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-model-cache" (OuterVolumeSpecName: "model-cache") pod "d647ef3e-3d75-4807-a29d-94dbb1f3a603" (UID: "d647ef3e-3d75-4807-a29d-94dbb1f3a603"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:07.807069 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806736    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d47999a2-2a91-4e15-bba9-7821aa5c85e7" (UID: "d47999a2-2a91-4e15-bba9-7821aa5c85e7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:07.807069 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.806776    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d647ef3e-3d75-4807-a29d-94dbb1f3a603" (UID: "d647ef3e-3d75-4807-a29d-94dbb1f3a603"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:07.807069 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.807049    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-home\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.807069 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.807068    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-tmp-dir\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.807607 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.807082    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-home\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.807607 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.807095    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-model-cache\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.807607 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.807108    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-model-cache\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.807607 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.807120    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-tmp-dir\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.807607 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.807131    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-model-cache\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.807607 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.807144    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-tmp-dir\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.808254 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.807972    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-home" (OuterVolumeSpecName: "home") pod "d647ef3e-3d75-4807-a29d-94dbb1f3a603" (UID: "d647ef3e-3d75-4807-a29d-94dbb1f3a603"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:07.809812 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.809788    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-dshm" (OuterVolumeSpecName: "dshm") pod "d647ef3e-3d75-4807-a29d-94dbb1f3a603" (UID: "d647ef3e-3d75-4807-a29d-94dbb1f3a603"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:07.809939 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.809815    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d647ef3e-3d75-4807-a29d-94dbb1f3a603-kube-api-access-qtdn8" (OuterVolumeSpecName: "kube-api-access-qtdn8") pod "d647ef3e-3d75-4807-a29d-94dbb1f3a603" (UID: "d647ef3e-3d75-4807-a29d-94dbb1f3a603"). InnerVolumeSpecName "kube-api-access-qtdn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:02:07.809939 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.809868    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-dshm" (OuterVolumeSpecName: "dshm") pod "d47999a2-2a91-4e15-bba9-7821aa5c85e7" (UID: "d47999a2-2a91-4e15-bba9-7821aa5c85e7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:07.810125 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.810081    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d47999a2-2a91-4e15-bba9-7821aa5c85e7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d47999a2-2a91-4e15-bba9-7821aa5c85e7" (UID: "d47999a2-2a91-4e15-bba9-7821aa5c85e7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:02:07.810194 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.810142    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d647ef3e-3d75-4807-a29d-94dbb1f3a603-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d647ef3e-3d75-4807-a29d-94dbb1f3a603" (UID: "d647ef3e-3d75-4807-a29d-94dbb1f3a603"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:02:07.810250 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.810238    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-dshm" (OuterVolumeSpecName: "dshm") pod "b24b758d-7fb4-4cd3-a6ed-7c682b623845" (UID: "b24b758d-7fb4-4cd3-a6ed-7c682b623845"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:07.810412 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.810387    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b24b758d-7fb4-4cd3-a6ed-7c682b623845-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b24b758d-7fb4-4cd3-a6ed-7c682b623845" (UID: "b24b758d-7fb4-4cd3-a6ed-7c682b623845"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:02:07.811117 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.811091    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b24b758d-7fb4-4cd3-a6ed-7c682b623845-kube-api-access-pzfdz" (OuterVolumeSpecName: "kube-api-access-pzfdz") pod "b24b758d-7fb4-4cd3-a6ed-7c682b623845" (UID: "b24b758d-7fb4-4cd3-a6ed-7c682b623845"). InnerVolumeSpecName "kube-api-access-pzfdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:02:07.811539 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.811510    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d47999a2-2a91-4e15-bba9-7821aa5c85e7-kube-api-access-wmgq5" (OuterVolumeSpecName: "kube-api-access-wmgq5") pod "d47999a2-2a91-4e15-bba9-7821aa5c85e7" (UID: "d47999a2-2a91-4e15-bba9-7821aa5c85e7"). InnerVolumeSpecName "kube-api-access-wmgq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:02:07.907807 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.907727    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b24b758d-7fb4-4cd3-a6ed-7c682b623845-tls-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.907807 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.907756    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmgq5\" (UniqueName: \"kubernetes.io/projected/d47999a2-2a91-4e15-bba9-7821aa5c85e7-kube-api-access-wmgq5\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.907807 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.907765    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d47999a2-2a91-4e15-bba9-7821aa5c85e7-dshm\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.907807 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.907774    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtdn8\" (UniqueName: \"kubernetes.io/projected/d647ef3e-3d75-4807-a29d-94dbb1f3a603-kube-api-access-qtdn8\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.907807 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.907783    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b24b758d-7fb4-4cd3-a6ed-7c682b623845-dshm\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.907807 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.907791    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-dshm\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.907807 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.907798    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d647ef3e-3d75-4807-a29d-94dbb1f3a603-tls-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.907807 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.907806    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d47999a2-2a91-4e15-bba9-7821aa5c85e7-tls-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.907807 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.907813    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d647ef3e-3d75-4807-a29d-94dbb1f3a603-home\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:07.908185 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:07.907820    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzfdz\" (UniqueName: \"kubernetes.io/projected/b24b758d-7fb4-4cd3-a6ed-7c682b623845-kube-api-access-pzfdz\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:08.065186 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.065150    2569 generic.go:356] "Generic (PLEG): container finished" podID="b24b758d-7fb4-4cd3-a6ed-7c682b623845" containerID="9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6" exitCode=0
Sep 16 15:02:08.065186 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.065189    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"
Sep 16 15:02:08.065394 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.065231    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m" event={"ID":"b24b758d-7fb4-4cd3-a6ed-7c682b623845","Type":"ContainerDied","Data":"9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6"}
Sep 16 15:02:08.065394 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.065270    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m" event={"ID":"b24b758d-7fb4-4cd3-a6ed-7c682b623845","Type":"ContainerDied","Data":"71fecd4466a28504c43bc61e64a96b148ad11527116d5dd76b0ea746c753587a"}
Sep 16 15:02:08.065394 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.065289    2569 scope.go:117] "RemoveContainer" containerID="9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6"
Sep 16 15:02:08.066634 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.066607    2569 generic.go:356] "Generic (PLEG): container finished" podID="d647ef3e-3d75-4807-a29d-94dbb1f3a603" containerID="5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54" exitCode=0
Sep 16 15:02:08.066746 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.066652    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"
Sep 16 15:02:08.066746 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.066691    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m" event={"ID":"d647ef3e-3d75-4807-a29d-94dbb1f3a603","Type":"ContainerDied","Data":"5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54"}
Sep 16 15:02:08.066746 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.066726    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m" event={"ID":"d647ef3e-3d75-4807-a29d-94dbb1f3a603","Type":"ContainerDied","Data":"129eed0681934e89d26c64ee99aec95ac6e8ba85224aea2f5c998eb7a217cfb8"}
Sep 16 15:02:08.068174 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.068151    2569 generic.go:356] "Generic (PLEG): container finished" podID="d47999a2-2a91-4e15-bba9-7821aa5c85e7" containerID="ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93" exitCode=0
Sep 16 15:02:08.068348 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.068201    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"
Sep 16 15:02:08.068348 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.068230    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8" event={"ID":"d47999a2-2a91-4e15-bba9-7821aa5c85e7","Type":"ContainerDied","Data":"ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93"}
Sep 16 15:02:08.068348 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.068273    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8" event={"ID":"d47999a2-2a91-4e15-bba9-7821aa5c85e7","Type":"ContainerDied","Data":"272fa82b0e867534d7cc64fb312bf8feb726edd04fef5b91709ff0f7b0e72bf3"}
Sep 16 15:02:08.076623 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.076604    2569 scope.go:117] "RemoveContainer" containerID="9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6"
Sep 16 15:02:08.077022 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:02:08.076844    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6\": container with ID starting with 9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6 not found: ID does not exist" containerID="9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6"
Sep 16 15:02:08.077022 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.076871    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6"} err="failed to get container status \"9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6\": rpc error: code = NotFound desc = could not find container \"9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6\": container with ID starting with 9f7f7b692e9be4ccddf6f7a4798fffd5a0462ba2dbd2b9dfa0112c71bb27f3c6 not found: ID does not exist"
Sep 16 15:02:08.077022 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.076888    2569 scope.go:117] "RemoveContainer" containerID="5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54"
Sep 16 15:02:08.087419 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.087399    2569 scope.go:117] "RemoveContainer" containerID="5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54"
Sep 16 15:02:08.087730 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:02:08.087710    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54\": container with ID starting with 5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54 not found: ID does not exist" containerID="5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54"
Sep 16 15:02:08.087795 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.087738    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54"} err="failed to get container status \"5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54\": rpc error: code = NotFound desc = could not find container \"5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54\": container with ID starting with 5a8268c9d6085353a96ed58bf19c39d07338c6f6e01ed7b469ea3f67b8de1d54 not found: ID does not exist"
Sep 16 15:02:08.087795 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.087753    2569 scope.go:117] "RemoveContainer" containerID="ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93"
Sep 16 15:02:08.092977 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.092958    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"]
Sep 16 15:02:08.096591 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.096561    2569 scope.go:117] "RemoveContainer" containerID="ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93"
Sep 16 15:02:08.096894 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:02:08.096878    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93\": container with ID starting with ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93 not found: ID does not exist" containerID="ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93"
Sep 16 15:02:08.096940 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.096900    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93"} err="failed to get container status \"ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93\": rpc error: code = NotFound desc = could not find container \"ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93\": container with ID starting with ff8c89caaebce1f59973c772ed94e65cd745a186fd113dc663d1d0785cbdab93 not found: ID does not exist"
Sep 16 15:02:08.097955 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.097938    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/distinct-w0-780e10-kserve-df7bdb9d6-76l4m"]
Sep 16 15:02:08.108523 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.108503    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"]
Sep 16 15:02:08.112600 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.112582    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/simulator-w0-780e10-kserve-577777b6c4-7h46m"]
Sep 16 15:02:08.122277 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.122256    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"]
Sep 16 15:02:08.126104 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:08.126087    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-780e10/distinct-2-w0-780e10-kserve-85bfb8779c-5bdh8"]
Sep 16 15:02:10.087759 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:10.087722    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b24b758d-7fb4-4cd3-a6ed-7c682b623845" path="/var/lib/kubelet/pods/b24b758d-7fb4-4cd3-a6ed-7c682b623845/volumes"
Sep 16 15:02:10.088140 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:10.088126    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d47999a2-2a91-4e15-bba9-7821aa5c85e7" path="/var/lib/kubelet/pods/d47999a2-2a91-4e15-bba9-7821aa5c85e7/volumes"
Sep 16 15:02:10.088472 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:10.088461    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d647ef3e-3d75-4807-a29d-94dbb1f3a603" path="/var/lib/kubelet/pods/d647ef3e-3d75-4807-a29d-94dbb1f3a603/volumes"
Sep 16 15:02:11.153919 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.153878    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"]
Sep 16 15:02:11.154386 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.154132    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy" containerID="cri-o://48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d" gracePeriod=30
Sep 16 15:02:11.488877 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.488804    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"]
Sep 16 15:02:11.489257 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.489243    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b24b758d-7fb4-4cd3-a6ed-7c682b623845" containerName="main"
Sep 16 15:02:11.489310 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.489258    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b24b758d-7fb4-4cd3-a6ed-7c682b623845" containerName="main"
Sep 16 15:02:11.489310 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.489289    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d47999a2-2a91-4e15-bba9-7821aa5c85e7" containerName="main"
Sep 16 15:02:11.489310 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.489296    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d47999a2-2a91-4e15-bba9-7821aa5c85e7" containerName="main"
Sep 16 15:02:11.489310 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.489306    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d647ef3e-3d75-4807-a29d-94dbb1f3a603" containerName="main"
Sep 16 15:02:11.489310 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.489312    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d647ef3e-3d75-4807-a29d-94dbb1f3a603" containerName="main"
Sep 16 15:02:11.489476 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.489385    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b24b758d-7fb4-4cd3-a6ed-7c682b623845" containerName="main"
Sep 16 15:02:11.489476 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.489396    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d47999a2-2a91-4e15-bba9-7821aa5c85e7" containerName="main"
Sep 16 15:02:11.489476 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.489402    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d647ef3e-3d75-4807-a29d-94dbb1f3a603" containerName="main"
Sep 16 15:02:11.494376 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.494351    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.499061 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.499041    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-eecd90-openshift-default-dockercfg-gp2np\""
Sep 16 15:02:11.517299 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.517270    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"]
Sep 16 15:02:11.545308 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.545281    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-workload-socket\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.545463 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.545318    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-envoy\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.545547 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.545463    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-token\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.545547 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.545521    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istiod-ca-cert\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.545653 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.545560    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-data\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.545653 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.545581    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-workload-certs\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.545653 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.545603    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-podinfo\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.545653 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.545633    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-credential-socket\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.545855 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.545666    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhgbs\" (UniqueName: \"kubernetes.io/projected/36b16229-8e8f-4c73-b02f-5b3366e26cf2-kube-api-access-rhgbs\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.647379 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.647321    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-token\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.647597 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.647401    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istiod-ca-cert\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.647597 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.647434    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-data\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.647597 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.647467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-workload-certs\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.647597 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.647516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-podinfo\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.647597 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.647545    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-credential-socket\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.647882 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.647605    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhgbs\" (UniqueName: \"kubernetes.io/projected/36b16229-8e8f-4c73-b02f-5b3366e26cf2-kube-api-access-rhgbs\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.647882 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.647657    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-workload-socket\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.647882 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.647696    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-envoy\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.650833 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.648618    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-workload-certs\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.650833 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.648854    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-data\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.650833 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.648963    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istiod-ca-cert\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.650833 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.649200    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-credential-socket\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.650833 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.649709    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-workload-socket\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.651970 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.651911    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-envoy\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.652735 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.652262    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-podinfo\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.660042 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.659993    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhgbs\" (UniqueName: \"kubernetes.io/projected/36b16229-8e8f-4c73-b02f-5b3366e26cf2-kube-api-access-rhgbs\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.662233 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.662212    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-token\") pod \"e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") " pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:11.805402 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:11.805364    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:12.098974 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:12.098951    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"]
Sep 16 15:02:12.100554 ip-10-0-132-120 kubenswrapper[2569]: W0916 15:02:12.100525    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b16229_8e8f_4c73_b02f_5b3366e26cf2.slice/crio-ad573d9ae5387f4ab9e7f453d30086aae372c9e9058e594194dbe10afadd1f10 WatchSource:0}: Error finding container ad573d9ae5387f4ab9e7f453d30086aae372c9e9058e594194dbe10afadd1f10: Status 404 returned error can't find the container with id ad573d9ae5387f4ab9e7f453d30086aae372c9e9058e594194dbe10afadd1f10
Sep 16 15:02:12.102754 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:12.102719    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 15:02:12.102839 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:12.102802    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 15:02:12.102877 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:12.102849    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 15:02:13.099857 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:13.099821    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" event={"ID":"36b16229-8e8f-4c73-b02f-5b3366e26cf2","Type":"ContainerStarted","Data":"f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953"}
Sep 16 15:02:13.100232 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:13.099877    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" event={"ID":"36b16229-8e8f-4c73-b02f-5b3366e26cf2","Type":"ContainerStarted","Data":"ad573d9ae5387f4ab9e7f453d30086aae372c9e9058e594194dbe10afadd1f10"}
Sep 16 15:02:13.125509 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:13.125455    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" podStartSLOduration=2.125439626 podStartE2EDuration="2.125439626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:02:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:02:13.12334469 +0000 UTC m=+1607.474626400" watchObservedRunningTime="2026-09-16 15:02:13.125439626 +0000 UTC m=+1607.476721398"
Sep 16 15:02:13.806255 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:13.806221    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:13.811163 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:13.811131    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:14.105772 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:14.105689    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:14.106661 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:14.106638    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:16.419018 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.418957    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 15:02:16.501042 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501007    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llvhj\" (UniqueName: \"kubernetes.io/projected/b9b749f7-69c5-4e09-b284-0837723989a4-kube-api-access-llvhj\") pod \"b9b749f7-69c5-4e09-b284-0837723989a4\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") "
Sep 16 15:02:16.501231 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501055    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9b749f7-69c5-4e09-b284-0837723989a4-istio-token\") pod \"b9b749f7-69c5-4e09-b284-0837723989a4\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") "
Sep 16 15:02:16.501231 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501105    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-istio-envoy\") pod \"b9b749f7-69c5-4e09-b284-0837723989a4\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") "
Sep 16 15:02:16.501231 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501144    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-workload-certs\") pod \"b9b749f7-69c5-4e09-b284-0837723989a4\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") "
Sep 16 15:02:16.501231 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501168    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9b749f7-69c5-4e09-b284-0837723989a4-istiod-ca-cert\") pod \"b9b749f7-69c5-4e09-b284-0837723989a4\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") "
Sep 16 15:02:16.501450 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501260    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-workload-socket\") pod \"b9b749f7-69c5-4e09-b284-0837723989a4\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") "
Sep 16 15:02:16.501450 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501291    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-credential-socket\") pod \"b9b749f7-69c5-4e09-b284-0837723989a4\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") "
Sep 16 15:02:16.501450 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501347    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9b749f7-69c5-4e09-b284-0837723989a4-istio-podinfo\") pod \"b9b749f7-69c5-4e09-b284-0837723989a4\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") "
Sep 16 15:02:16.501450 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501379    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-istio-data\") pod \"b9b749f7-69c5-4e09-b284-0837723989a4\" (UID: \"b9b749f7-69c5-4e09-b284-0837723989a4\") "
Sep 16 15:02:16.501670 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501621    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9b749f7-69c5-4e09-b284-0837723989a4" (UID: "b9b749f7-69c5-4e09-b284-0837723989a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:16.501670 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501559    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9b749f7-69c5-4e09-b284-0837723989a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9b749f7-69c5-4e09-b284-0837723989a4" (UID: "b9b749f7-69c5-4e09-b284-0837723989a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:02:16.501670 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501644    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9b749f7-69c5-4e09-b284-0837723989a4" (UID: "b9b749f7-69c5-4e09-b284-0837723989a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:16.501883 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501708    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9b749f7-69c5-4e09-b284-0837723989a4" (UID: "b9b749f7-69c5-4e09-b284-0837723989a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:16.501958 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501874    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9b749f7-69c5-4e09-b284-0837723989a4" (UID: "b9b749f7-69c5-4e09-b284-0837723989a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:16.501958 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501885    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-workload-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:16.501958 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501909    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-credential-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:16.501958 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501925    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-workload-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:16.501958 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.501937    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9b749f7-69c5-4e09-b284-0837723989a4-istiod-ca-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:16.503426 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.503386    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b749f7-69c5-4e09-b284-0837723989a4-kube-api-access-llvhj" (OuterVolumeSpecName: "kube-api-access-llvhj") pod "b9b749f7-69c5-4e09-b284-0837723989a4" (UID: "b9b749f7-69c5-4e09-b284-0837723989a4"). InnerVolumeSpecName "kube-api-access-llvhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:02:16.503622 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.503596    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9b749f7-69c5-4e09-b284-0837723989a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9b749f7-69c5-4e09-b284-0837723989a4" (UID: "b9b749f7-69c5-4e09-b284-0837723989a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 15:02:16.503781 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.503761    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b749f7-69c5-4e09-b284-0837723989a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9b749f7-69c5-4e09-b284-0837723989a4" (UID: "b9b749f7-69c5-4e09-b284-0837723989a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:02:16.503873 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.503794    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9b749f7-69c5-4e09-b284-0837723989a4" (UID: "b9b749f7-69c5-4e09-b284-0837723989a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:02:16.602961 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.602929    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9b749f7-69c5-4e09-b284-0837723989a4-istio-podinfo\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:16.602961 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.602955    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-istio-data\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:16.602961 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.602965    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llvhj\" (UniqueName: \"kubernetes.io/projected/b9b749f7-69c5-4e09-b284-0837723989a4-kube-api-access-llvhj\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:16.603189 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.602977    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9b749f7-69c5-4e09-b284-0837723989a4-istio-token\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:16.603189 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:16.602986    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9b749f7-69c5-4e09-b284-0837723989a4-istio-envoy\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:02:17.125902 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:17.125869    2569 generic.go:356] "Generic (PLEG): container finished" podID="b9b749f7-69c5-4e09-b284-0837723989a4" containerID="48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d" exitCode=0
Sep 16 15:02:17.126079 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:17.125915    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"
Sep 16 15:02:17.126079 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:17.125938    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" event={"ID":"b9b749f7-69c5-4e09-b284-0837723989a4","Type":"ContainerDied","Data":"48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d"}
Sep 16 15:02:17.126079 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:17.125978    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg" event={"ID":"b9b749f7-69c5-4e09-b284-0837723989a4","Type":"ContainerDied","Data":"0e546747f422586cccafaf11a729856135e881540a8eff80cbe59caf0de5ad25"}
Sep 16 15:02:17.126079 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:17.125999    2569 scope.go:117] "RemoveContainer" containerID="48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d"
Sep 16 15:02:17.135753 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:17.135735    2569 scope.go:117] "RemoveContainer" containerID="65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d"
Sep 16 15:02:17.144228 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:17.144211    2569 scope.go:117] "RemoveContainer" containerID="48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d"
Sep 16 15:02:17.144447 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:02:17.144431    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d\": container with ID starting with 48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d not found: ID does not exist" containerID="48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d"
Sep 16 15:02:17.144531 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:17.144454    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d"} err="failed to get container status \"48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d\": rpc error: code = NotFound desc = could not find container \"48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d\": container with ID starting with 48ba26feacb8b816aa859d7b777e7b39791c89d5f1cc08e1f57e6c88df19ad0d not found: ID does not exist"
Sep 16 15:02:17.144531 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:17.144471    2569 scope.go:117] "RemoveContainer" containerID="65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d"
Sep 16 15:02:17.144691 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:02:17.144671    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d\": container with ID starting with 65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d not found: ID does not exist" containerID="65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d"
Sep 16 15:02:17.144783 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:17.144690    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d"} err="failed to get container status \"65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d\": rpc error: code = NotFound desc = could not find container \"65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d\": container with ID starting with 65d7528bc88c3de99b8657f614042d524e8ff98be65a36d63ea153d47402e72d not found: ID does not exist"
Sep 16 15:02:17.151645 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:17.151624    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"]
Sep 16 15:02:17.161726 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:17.161703    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg"]
Sep 16 15:02:18.088477 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.088435    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" path="/var/lib/kubelet/pods/b9b749f7-69c5-4e09-b284-0837723989a4/volumes"
Sep 16 15:02:18.217674 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.217635    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"]
Sep 16 15:02:18.218315 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.218292    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy"
Sep 16 15:02:18.218315 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.218315    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy"
Sep 16 15:02:18.218510 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.218442    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy"
Sep 16 15:02:18.218510 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.218457    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy"
Sep 16 15:02:18.223415 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.223391    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.226126 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.226104    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-eecd90-serving-cert\""
Sep 16 15:02:18.235521 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.235470    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"]
Sep 16 15:02:18.319515 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.319468    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrd6k\" (UniqueName: \"kubernetes.io/projected/4894ae12-d9a5-49fd-b705-875e97a9c416-kube-api-access-jrd6k\") pod \"maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.319652 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.319612    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4894ae12-d9a5-49fd-b705-875e97a9c416-openshift-service-ca\") pod \"maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.319652 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.319650    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4894ae12-d9a5-49fd-b705-875e97a9c416-metrics-certs\") pod \"maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.319735 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.319693    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4894ae12-d9a5-49fd-b705-875e97a9c416-maas-api-tls\") pod \"maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.420542 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.420413    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrd6k\" (UniqueName: \"kubernetes.io/projected/4894ae12-d9a5-49fd-b705-875e97a9c416-kube-api-access-jrd6k\") pod \"maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.420682 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.420546    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4894ae12-d9a5-49fd-b705-875e97a9c416-openshift-service-ca\") pod \"maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.420682 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.420580    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4894ae12-d9a5-49fd-b705-875e97a9c416-metrics-certs\") pod \"maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.420790 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.420730    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4894ae12-d9a5-49fd-b705-875e97a9c416-maas-api-tls\") pod \"maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.421306 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.421277    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4894ae12-d9a5-49fd-b705-875e97a9c416-openshift-service-ca\") pod \"maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.422987 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.422964    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4894ae12-d9a5-49fd-b705-875e97a9c416-metrics-certs\") pod \"maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.423095 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.423027    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4894ae12-d9a5-49fd-b705-875e97a9c416-maas-api-tls\") pod \"maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.429534 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.429511    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrd6k\" (UniqueName: \"kubernetes.io/projected/4894ae12-d9a5-49fd-b705-875e97a9c416-kube-api-access-jrd6k\") pod \"maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.536597 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.536562    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:18.814716 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:18.814454    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"]
Sep 16 15:02:18.816080 ip-10-0-132-120 kubenswrapper[2569]: W0916 15:02:18.816043    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4894ae12_d9a5_49fd_b705_875e97a9c416.slice/crio-6978e8e916cb9a294fd02601f13da0b6d6404836b64600bc6fbe96b3be6234cd WatchSource:0}: Error finding container 6978e8e916cb9a294fd02601f13da0b6d6404836b64600bc6fbe96b3be6234cd: Status 404 returned error can't find the container with id 6978e8e916cb9a294fd02601f13da0b6d6404836b64600bc6fbe96b3be6234cd
Sep 16 15:02:19.139201 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:19.139110    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc" event={"ID":"4894ae12-d9a5-49fd-b705-875e97a9c416","Type":"ContainerStarted","Data":"6978e8e916cb9a294fd02601f13da0b6d6404836b64600bc6fbe96b3be6234cd"}
Sep 16 15:02:20.145892 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:20.145858    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc" event={"ID":"4894ae12-d9a5-49fd-b705-875e97a9c416","Type":"ContainerStarted","Data":"843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09"}
Sep 16 15:02:20.146357 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:20.145918    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:20.170888 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:20.170842    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc" podStartSLOduration=1.5418767899999999 podStartE2EDuration="2.170827771s" totalImagesPullingTime="628.950981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:02:20.164954042 +0000 UTC m=+1614.516235752" watchObservedRunningTime="2026-09-16 15:02:20.170827771 +0000 UTC m=+1614.522109478"
Sep 16 15:02:26.157608 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:26.157577    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:02:44.249211 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:44.249179    2569 patch_prober.go:28] interesting pod/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": read tcp 10.134.0.2:52488->10.134.0.64:15021: read: connection reset by peer" start-of-body=
Sep 16 15:02:44.249639 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:44.249264    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": read tcp 10.134.0.2:52488->10.134.0.64:15021: read: connection reset by peer"
Sep 16 15:02:44.296769 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:44.296740    2569 generic.go:356] "Generic (PLEG): container finished" podID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerID="f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953" exitCode=0
Sep 16 15:02:44.296894 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:44.296787    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" event={"ID":"36b16229-8e8f-4c73-b02f-5b3366e26cf2","Type":"ContainerDied","Data":"f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953"}
Sep 16 15:02:44.297206 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:44.297187    2569 scope.go:117] "RemoveContainer" containerID="f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953"
Sep 16 15:02:44.298405 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:44.298371    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 15:02:44.298520 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:44.298459    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 15:02:44.298572 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:44.298533    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 15:02:45.304254 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:45.304213    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" event={"ID":"36b16229-8e8f-4c73-b02f-5b3366e26cf2","Type":"ContainerStarted","Data":"21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a"}
Sep 16 15:02:45.806508 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:45.806456    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:45.806713 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:45.806690    2569 patch_prober.go:28] interesting pod/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 15:02:45.806761 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:45.806739    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 15:02:46.806699 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:46.806659    2569 patch_prober.go:28] interesting pod/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 15:02:46.807093 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:46.806715    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 15:02:47.806746 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:47.806708    2569 patch_prober.go:28] interesting pod/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 15:02:47.807109 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:47.806773    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 15:02:48.805821 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:48.805782    2569 patch_prober.go:28] interesting pod/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 15:02:48.805996 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:48.805853    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 15:02:49.806548 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:49.806512    2569 patch_prober.go:28] interesting pod/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 15:02:49.806940 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:49.806570    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 15:02:50.809920 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:50.809890    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:50.810378 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:50.810339    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:02:50.811026 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:02:50.811007    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:03:03.844031 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:03.843989    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"]
Sep 16 15:03:03.844581 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:03.844258    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr" podUID="a4ad9792-551a-46be-baa3-c925c83c53a4" containerName="maas-api" containerID="cri-o://ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2" gracePeriod=30
Sep 16 15:03:04.098409 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.097968    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:03:04.209198 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.209161    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ad9792-551a-46be-baa3-c925c83c53a4-openshift-service-ca\") pod \"a4ad9792-551a-46be-baa3-c925c83c53a4\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") "
Sep 16 15:03:04.209379 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.209270    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn2gx\" (UniqueName: \"kubernetes.io/projected/a4ad9792-551a-46be-baa3-c925c83c53a4-kube-api-access-dn2gx\") pod \"a4ad9792-551a-46be-baa3-c925c83c53a4\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") "
Sep 16 15:03:04.209379 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.209298    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4ad9792-551a-46be-baa3-c925c83c53a4-maas-api-tls\") pod \"a4ad9792-551a-46be-baa3-c925c83c53a4\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") "
Sep 16 15:03:04.209379 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.209332    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4ad9792-551a-46be-baa3-c925c83c53a4-metrics-certs\") pod \"a4ad9792-551a-46be-baa3-c925c83c53a4\" (UID: \"a4ad9792-551a-46be-baa3-c925c83c53a4\") "
Sep 16 15:03:04.209623 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.209594    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4ad9792-551a-46be-baa3-c925c83c53a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a4ad9792-551a-46be-baa3-c925c83c53a4" (UID: "a4ad9792-551a-46be-baa3-c925c83c53a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:03:04.209940 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.209895    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ad9792-551a-46be-baa3-c925c83c53a4-openshift-service-ca\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:04.211455 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.211433    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ad9792-551a-46be-baa3-c925c83c53a4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a4ad9792-551a-46be-baa3-c925c83c53a4" (UID: "a4ad9792-551a-46be-baa3-c925c83c53a4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:03:04.211865 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.211834    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ad9792-551a-46be-baa3-c925c83c53a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a4ad9792-551a-46be-baa3-c925c83c53a4" (UID: "a4ad9792-551a-46be-baa3-c925c83c53a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:03:04.211865 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.211854    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4ad9792-551a-46be-baa3-c925c83c53a4-kube-api-access-dn2gx" (OuterVolumeSpecName: "kube-api-access-dn2gx") pod "a4ad9792-551a-46be-baa3-c925c83c53a4" (UID: "a4ad9792-551a-46be-baa3-c925c83c53a4"). InnerVolumeSpecName "kube-api-access-dn2gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:04.311360 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.311310    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn2gx\" (UniqueName: \"kubernetes.io/projected/a4ad9792-551a-46be-baa3-c925c83c53a4-kube-api-access-dn2gx\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:04.311360 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.311348    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4ad9792-551a-46be-baa3-c925c83c53a4-maas-api-tls\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:04.311360 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.311367    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4ad9792-551a-46be-baa3-c925c83c53a4-metrics-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:04.436814 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.436725    2569 generic.go:356] "Generic (PLEG): container finished" podID="a4ad9792-551a-46be-baa3-c925c83c53a4" containerID="ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2" exitCode=0
Sep 16 15:03:04.436814 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.436799    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"
Sep 16 15:03:04.436987 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.436805    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr" event={"ID":"a4ad9792-551a-46be-baa3-c925c83c53a4","Type":"ContainerDied","Data":"ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2"}
Sep 16 15:03:04.436987 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.436885    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr" event={"ID":"a4ad9792-551a-46be-baa3-c925c83c53a4","Type":"ContainerDied","Data":"754ab6a8ba80cecef125bedee3c9ed58e138fedef7aefb7577b969816bc294c1"}
Sep 16 15:03:04.436987 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.436907    2569 scope.go:117] "RemoveContainer" containerID="ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2"
Sep 16 15:03:04.446562 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.446547    2569 scope.go:117] "RemoveContainer" containerID="ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2"
Sep 16 15:03:04.446912 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:03:04.446883    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2\": container with ID starting with ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2 not found: ID does not exist" containerID="ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2"
Sep 16 15:03:04.447022 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.446922    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2"} err="failed to get container status \"ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2\": rpc error: code = NotFound desc = could not find container \"ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2\": container with ID starting with ba81751035dcf0c98feeea07366aed5d2e89f0b5b896e1dde474332b068706b2 not found: ID does not exist"
Sep 16 15:03:04.464660 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.464628    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"]
Sep 16 15:03:04.468234 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:04.468211    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-079e6e-554b8598cc-ppkkr"]
Sep 16 15:03:06.088724 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:06.088687    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4ad9792-551a-46be-baa3-c925c83c53a4" path="/var/lib/kubelet/pods/a4ad9792-551a-46be-baa3-c925c83c53a4/volumes"
Sep 16 15:03:13.877794 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:13.877756    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"]
Sep 16 15:03:24.342986 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.342954    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"]
Sep 16 15:03:24.343369 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.343215    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb" podUID="a3de88bc-20a4-4125-9fe9-0dbf761f4039" containerName="maas-api" containerID="cri-o://3ccee06e40dfcdfd3f4772a9dab02f498091c8fabfdc579d9cea8c6360c51e19" gracePeriod=30
Sep 16 15:03:24.559315 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.559281    2569 generic.go:356] "Generic (PLEG): container finished" podID="a3de88bc-20a4-4125-9fe9-0dbf761f4039" containerID="3ccee06e40dfcdfd3f4772a9dab02f498091c8fabfdc579d9cea8c6360c51e19" exitCode=0
Sep 16 15:03:24.559519 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.559350    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb" event={"ID":"a3de88bc-20a4-4125-9fe9-0dbf761f4039","Type":"ContainerDied","Data":"3ccee06e40dfcdfd3f4772a9dab02f498091c8fabfdc579d9cea8c6360c51e19"}
Sep 16 15:03:24.596885 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.596795    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 15:03:24.714900 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.714870    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92qp6\" (UniqueName: \"kubernetes.io/projected/a3de88bc-20a4-4125-9fe9-0dbf761f4039-kube-api-access-92qp6\") pod \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") "
Sep 16 15:03:24.715082 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.714935    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3de88bc-20a4-4125-9fe9-0dbf761f4039-maas-api-tls\") pod \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") "
Sep 16 15:03:24.715082 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.714968    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3de88bc-20a4-4125-9fe9-0dbf761f4039-openshift-service-ca\") pod \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") "
Sep 16 15:03:24.715082 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.715043    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3de88bc-20a4-4125-9fe9-0dbf761f4039-metrics-certs\") pod \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\" (UID: \"a3de88bc-20a4-4125-9fe9-0dbf761f4039\") "
Sep 16 15:03:24.715376 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.715322    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3de88bc-20a4-4125-9fe9-0dbf761f4039-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a3de88bc-20a4-4125-9fe9-0dbf761f4039" (UID: "a3de88bc-20a4-4125-9fe9-0dbf761f4039"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:03:24.717010 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.716981    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3de88bc-20a4-4125-9fe9-0dbf761f4039-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a3de88bc-20a4-4125-9fe9-0dbf761f4039" (UID: "a3de88bc-20a4-4125-9fe9-0dbf761f4039"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:03:24.717103 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.717023    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3de88bc-20a4-4125-9fe9-0dbf761f4039-kube-api-access-92qp6" (OuterVolumeSpecName: "kube-api-access-92qp6") pod "a3de88bc-20a4-4125-9fe9-0dbf761f4039" (UID: "a3de88bc-20a4-4125-9fe9-0dbf761f4039"). InnerVolumeSpecName "kube-api-access-92qp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:24.717143 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.717121    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3de88bc-20a4-4125-9fe9-0dbf761f4039-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a3de88bc-20a4-4125-9fe9-0dbf761f4039" (UID: "a3de88bc-20a4-4125-9fe9-0dbf761f4039"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:03:24.816070 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.816034    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92qp6\" (UniqueName: \"kubernetes.io/projected/a3de88bc-20a4-4125-9fe9-0dbf761f4039-kube-api-access-92qp6\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:24.816070 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.816065    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3de88bc-20a4-4125-9fe9-0dbf761f4039-maas-api-tls\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:24.816070 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.816075    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3de88bc-20a4-4125-9fe9-0dbf761f4039-openshift-service-ca\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:24.816297 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:24.816084    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3de88bc-20a4-4125-9fe9-0dbf761f4039-metrics-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:25.567613 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:25.567587    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"
Sep 16 15:03:25.567998 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:25.567581    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb" event={"ID":"a3de88bc-20a4-4125-9fe9-0dbf761f4039","Type":"ContainerDied","Data":"5de42af15d067d7bce88ee1e6350f14f8ec1f487def0813f532859230f7e5830"}
Sep 16 15:03:25.567998 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:25.567712    2569 scope.go:117] "RemoveContainer" containerID="3ccee06e40dfcdfd3f4772a9dab02f498091c8fabfdc579d9cea8c6360c51e19"
Sep 16 15:03:25.589608 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:25.589582    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"]
Sep 16 15:03:25.593632 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:25.593610    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-e33b3f-85b9ffc9ff-7q2pb"]
Sep 16 15:03:26.088660 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:26.088630    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3de88bc-20a4-4125-9fe9-0dbf761f4039" path="/var/lib/kubelet/pods/a3de88bc-20a4-4125-9fe9-0dbf761f4039/volumes"
Sep 16 15:03:28.862040 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:28.862002    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"]
Sep 16 15:03:28.862391 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:28.862217    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc" podUID="4894ae12-d9a5-49fd-b705-875e97a9c416" containerName="maas-api" containerID="cri-o://843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09" gracePeriod=30
Sep 16 15:03:28.897077 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:28.897042    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848" podUID="7ef6dc77-88a6-4b78-8006-2bd82b0369ff" containerName="main" containerID="cri-o://472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c" gracePeriod=45
Sep 16 15:03:29.139453 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.139425    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:03:29.179568 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.179535    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 15:03:29.263408 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.263380    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4894ae12-d9a5-49fd-b705-875e97a9c416-maas-api-tls\") pod \"4894ae12-d9a5-49fd-b705-875e97a9c416\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") "
Sep 16 15:03:29.263593 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.263415    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-tmp-dir\") pod \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") "
Sep 16 15:03:29.263593 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.263462    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrd6k\" (UniqueName: \"kubernetes.io/projected/4894ae12-d9a5-49fd-b705-875e97a9c416-kube-api-access-jrd6k\") pod \"4894ae12-d9a5-49fd-b705-875e97a9c416\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") "
Sep 16 15:03:29.263593 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.263562    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-model-cache\") pod \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") "
Sep 16 15:03:29.263762 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.263614    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-dshm\") pod \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") "
Sep 16 15:03:29.263762 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.263700    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7ef6dc77-88a6-4b78-8006-2bd82b0369ff" (UID: "7ef6dc77-88a6-4b78-8006-2bd82b0369ff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:29.263762 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.263725    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rnjw\" (UniqueName: \"kubernetes.io/projected/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-kube-api-access-2rnjw\") pod \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") "
Sep 16 15:03:29.263905 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.263764    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4894ae12-d9a5-49fd-b705-875e97a9c416-metrics-certs\") pod \"4894ae12-d9a5-49fd-b705-875e97a9c416\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") "
Sep 16 15:03:29.263905 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.263806    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-model-cache" (OuterVolumeSpecName: "model-cache") pod "7ef6dc77-88a6-4b78-8006-2bd82b0369ff" (UID: "7ef6dc77-88a6-4b78-8006-2bd82b0369ff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:29.263905 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.263812    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4894ae12-d9a5-49fd-b705-875e97a9c416-openshift-service-ca\") pod \"4894ae12-d9a5-49fd-b705-875e97a9c416\" (UID: \"4894ae12-d9a5-49fd-b705-875e97a9c416\") "
Sep 16 15:03:29.263905 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.263879    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-tls-certs\") pod \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") "
Sep 16 15:03:29.264112 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.263936    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-home\") pod \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\" (UID: \"7ef6dc77-88a6-4b78-8006-2bd82b0369ff\") "
Sep 16 15:03:29.264167 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.264148    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4894ae12-d9a5-49fd-b705-875e97a9c416-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4894ae12-d9a5-49fd-b705-875e97a9c416" (UID: "4894ae12-d9a5-49fd-b705-875e97a9c416"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:03:29.264371 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.264334    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-home" (OuterVolumeSpecName: "home") pod "7ef6dc77-88a6-4b78-8006-2bd82b0369ff" (UID: "7ef6dc77-88a6-4b78-8006-2bd82b0369ff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:29.264482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.264433    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-model-cache\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:29.264482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.264450    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4894ae12-d9a5-49fd-b705-875e97a9c416-openshift-service-ca\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:29.264482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.264463    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-home\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:29.264669 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.264516    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-tmp-dir\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:29.266059 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.266028    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4894ae12-d9a5-49fd-b705-875e97a9c416-kube-api-access-jrd6k" (OuterVolumeSpecName: "kube-api-access-jrd6k") pod "4894ae12-d9a5-49fd-b705-875e97a9c416" (UID: "4894ae12-d9a5-49fd-b705-875e97a9c416"). InnerVolumeSpecName "kube-api-access-jrd6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:29.266186 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.266122    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4894ae12-d9a5-49fd-b705-875e97a9c416-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4894ae12-d9a5-49fd-b705-875e97a9c416" (UID: "4894ae12-d9a5-49fd-b705-875e97a9c416"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:03:29.266186 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.266137    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4894ae12-d9a5-49fd-b705-875e97a9c416-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4894ae12-d9a5-49fd-b705-875e97a9c416" (UID: "4894ae12-d9a5-49fd-b705-875e97a9c416"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:03:29.266420 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.266387    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7ef6dc77-88a6-4b78-8006-2bd82b0369ff" (UID: "7ef6dc77-88a6-4b78-8006-2bd82b0369ff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:03:29.266534 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.266442    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-dshm" (OuterVolumeSpecName: "dshm") pod "7ef6dc77-88a6-4b78-8006-2bd82b0369ff" (UID: "7ef6dc77-88a6-4b78-8006-2bd82b0369ff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:29.266534 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.266514    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-kube-api-access-2rnjw" (OuterVolumeSpecName: "kube-api-access-2rnjw") pod "7ef6dc77-88a6-4b78-8006-2bd82b0369ff" (UID: "7ef6dc77-88a6-4b78-8006-2bd82b0369ff"). InnerVolumeSpecName "kube-api-access-2rnjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:29.366052 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.365979    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4894ae12-d9a5-49fd-b705-875e97a9c416-maas-api-tls\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:29.366052 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.366009    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrd6k\" (UniqueName: \"kubernetes.io/projected/4894ae12-d9a5-49fd-b705-875e97a9c416-kube-api-access-jrd6k\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:29.366052 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.366020    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-dshm\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:29.366052 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.366029    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rnjw\" (UniqueName: \"kubernetes.io/projected/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-kube-api-access-2rnjw\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:29.366052 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.366038    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4894ae12-d9a5-49fd-b705-875e97a9c416-metrics-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:29.366052 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.366045    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef6dc77-88a6-4b78-8006-2bd82b0369ff-tls-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:29.593380 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.593340    2569 generic.go:356] "Generic (PLEG): container finished" podID="7ef6dc77-88a6-4b78-8006-2bd82b0369ff" containerID="472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c" exitCode=0
Sep 16 15:03:29.593380 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.593380    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"
Sep 16 15:03:29.593690 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.593428    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848" event={"ID":"7ef6dc77-88a6-4b78-8006-2bd82b0369ff","Type":"ContainerDied","Data":"472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c"}
Sep 16 15:03:29.593690 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.593470    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848" event={"ID":"7ef6dc77-88a6-4b78-8006-2bd82b0369ff","Type":"ContainerDied","Data":"033994c78a7f48b7f92da5f41f2f279d35ab040ac5546f2b384aa03e566fc9b4"}
Sep 16 15:03:29.593690 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.593519    2569 scope.go:117] "RemoveContainer" containerID="472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c"
Sep 16 15:03:29.595072 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.595041    2569 generic.go:356] "Generic (PLEG): container finished" podID="4894ae12-d9a5-49fd-b705-875e97a9c416" containerID="843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09" exitCode=0
Sep 16 15:03:29.595072 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.595069    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"
Sep 16 15:03:29.595254 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.595108    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc" event={"ID":"4894ae12-d9a5-49fd-b705-875e97a9c416","Type":"ContainerDied","Data":"843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09"}
Sep 16 15:03:29.595254 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.595149    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc" event={"ID":"4894ae12-d9a5-49fd-b705-875e97a9c416","Type":"ContainerDied","Data":"6978e8e916cb9a294fd02601f13da0b6d6404836b64600bc6fbe96b3be6234cd"}
Sep 16 15:03:29.604877 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.604861    2569 scope.go:117] "RemoveContainer" containerID="472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c"
Sep 16 15:03:29.605132 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:03:29.605114    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c\": container with ID starting with 472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c not found: ID does not exist" containerID="472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c"
Sep 16 15:03:29.605207 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.605143    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c"} err="failed to get container status \"472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c\": rpc error: code = NotFound desc = could not find container \"472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c\": container with ID starting with 472f7ebd0b0819e8eeb6588ff19032694c4405db3847cf545ea5c66ba74a782c not found: ID does not exist"
Sep 16 15:03:29.605207 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.605166    2569 scope.go:117] "RemoveContainer" containerID="843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09"
Sep 16 15:03:29.614442 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.614416    2569 scope.go:117] "RemoveContainer" containerID="843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09"
Sep 16 15:03:29.614864 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:03:29.614838    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09\": container with ID starting with 843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09 not found: ID does not exist" containerID="843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09"
Sep 16 15:03:29.614971 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.614869    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09"} err="failed to get container status \"843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09\": rpc error: code = NotFound desc = could not find container \"843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09\": container with ID starting with 843d0ab491a4afb48f28ed56068f62f72f1db7aea46ce504e16cce1daf660f09 not found: ID does not exist"
Sep 16 15:03:29.620236 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.620161    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"]
Sep 16 15:03:29.623049 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.623025    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-e33b3f/distinct-w4-e33b3f-kserve-85d9db698c-lr848"]
Sep 16 15:03:29.634725 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.634687    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"]
Sep 16 15:03:29.640260 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:29.640238    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eecd90-65cd8bd5fd-m44bc"]
Sep 16 15:03:30.088352 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:30.088318    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4894ae12-d9a5-49fd-b705-875e97a9c416" path="/var/lib/kubelet/pods/4894ae12-d9a5-49fd-b705-875e97a9c416/volumes"
Sep 16 15:03:30.088759 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:30.088744    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ef6dc77-88a6-4b78-8006-2bd82b0369ff" path="/var/lib/kubelet/pods/7ef6dc77-88a6-4b78-8006-2bd82b0369ff/volumes"
Sep 16 15:03:32.460854 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:32.460813    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"]
Sep 16 15:03:32.461240 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:32.461047    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy" containerID="cri-o://2d9c222246d06bd5a64b7746c169feb15fe06301ef1ec0ef60323acd2ca95e4e" gracePeriod=30
Sep 16 15:03:33.987807 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:33.987765    2569 patch_prober.go:28] interesting pod/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 15:03:33.988208 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:33.987828    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 15:03:35.878664 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:35.878631    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"]
Sep 16 15:03:35.879065 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:35.878833    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy" containerID="cri-o://21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a" gracePeriod=30
Sep 16 15:03:37.647768 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.647731    2569 generic.go:356] "Generic (PLEG): container finished" podID="234d76d0-12a4-4050-b591-f43afea59d0a" containerID="2d9c222246d06bd5a64b7746c169feb15fe06301ef1ec0ef60323acd2ca95e4e" exitCode=0
Sep 16 15:03:37.648191 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.647941    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" event={"ID":"234d76d0-12a4-4050-b591-f43afea59d0a","Type":"ContainerDied","Data":"2d9c222246d06bd5a64b7746c169feb15fe06301ef1ec0ef60323acd2ca95e4e"}
Sep 16 15:03:37.648191 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.648004    2569 scope.go:117] "RemoveContainer" containerID="08a3a4ab3e00dd81a1eb20e16471475e6613cad4a11a885ac51a2296536d3771"
Sep 16 15:03:37.717274 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.717248    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 15:03:37.848658 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.848617    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-istio-data\") pod \"234d76d0-12a4-4050-b591-f43afea59d0a\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") "
Sep 16 15:03:37.848930 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.848842    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-workload-certs\") pod \"234d76d0-12a4-4050-b591-f43afea59d0a\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") "
Sep 16 15:03:37.848930 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.848882    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-workload-socket\") pod \"234d76d0-12a4-4050-b591-f43afea59d0a\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") "
Sep 16 15:03:37.849052 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.848942    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/234d76d0-12a4-4050-b591-f43afea59d0a-istio-podinfo\") pod \"234d76d0-12a4-4050-b591-f43afea59d0a\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") "
Sep 16 15:03:37.849052 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.848978    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/234d76d0-12a4-4050-b591-f43afea59d0a-istio-token\") pod \"234d76d0-12a4-4050-b591-f43afea59d0a\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") "
Sep 16 15:03:37.849052 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.849004    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-credential-socket\") pod \"234d76d0-12a4-4050-b591-f43afea59d0a\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") "
Sep 16 15:03:37.849208 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.849074    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/234d76d0-12a4-4050-b591-f43afea59d0a-istiod-ca-cert\") pod \"234d76d0-12a4-4050-b591-f43afea59d0a\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") "
Sep 16 15:03:37.849208 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.849105    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-istio-envoy\") pod \"234d76d0-12a4-4050-b591-f43afea59d0a\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") "
Sep 16 15:03:37.849208 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.849157    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km4nw\" (UniqueName: \"kubernetes.io/projected/234d76d0-12a4-4050-b591-f43afea59d0a-kube-api-access-km4nw\") pod \"234d76d0-12a4-4050-b591-f43afea59d0a\" (UID: \"234d76d0-12a4-4050-b591-f43afea59d0a\") "
Sep 16 15:03:37.850303 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.850126    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "234d76d0-12a4-4050-b591-f43afea59d0a" (UID: "234d76d0-12a4-4050-b591-f43afea59d0a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:37.850718 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.850502    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-istio-data" (OuterVolumeSpecName: "istio-data") pod "234d76d0-12a4-4050-b591-f43afea59d0a" (UID: "234d76d0-12a4-4050-b591-f43afea59d0a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:37.851044 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.850866    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "234d76d0-12a4-4050-b591-f43afea59d0a" (UID: "234d76d0-12a4-4050-b591-f43afea59d0a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:37.851539 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.851241    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/234d76d0-12a4-4050-b591-f43afea59d0a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "234d76d0-12a4-4050-b591-f43afea59d0a" (UID: "234d76d0-12a4-4050-b591-f43afea59d0a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:03:37.852080 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.852037    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "234d76d0-12a4-4050-b591-f43afea59d0a" (UID: "234d76d0-12a4-4050-b591-f43afea59d0a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:37.854323 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.854276    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "234d76d0-12a4-4050-b591-f43afea59d0a" (UID: "234d76d0-12a4-4050-b591-f43afea59d0a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:37.854415 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.854358    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/234d76d0-12a4-4050-b591-f43afea59d0a-istio-token" (OuterVolumeSpecName: "istio-token") pod "234d76d0-12a4-4050-b591-f43afea59d0a" (UID: "234d76d0-12a4-4050-b591-f43afea59d0a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:37.855317 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.855283    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/234d76d0-12a4-4050-b591-f43afea59d0a-kube-api-access-km4nw" (OuterVolumeSpecName: "kube-api-access-km4nw") pod "234d76d0-12a4-4050-b591-f43afea59d0a" (UID: "234d76d0-12a4-4050-b591-f43afea59d0a"). InnerVolumeSpecName "kube-api-access-km4nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:37.855754 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.855730    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/234d76d0-12a4-4050-b591-f43afea59d0a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "234d76d0-12a4-4050-b591-f43afea59d0a" (UID: "234d76d0-12a4-4050-b591-f43afea59d0a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 15:03:37.950706 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.950670    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km4nw\" (UniqueName: \"kubernetes.io/projected/234d76d0-12a4-4050-b591-f43afea59d0a-kube-api-access-km4nw\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:37.950706 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.950704    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-istio-data\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:37.950706 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.950715    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-workload-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:37.950939 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.950723    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-workload-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:37.950939 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.950732    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/234d76d0-12a4-4050-b591-f43afea59d0a-istio-podinfo\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:37.950939 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.950740    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/234d76d0-12a4-4050-b591-f43afea59d0a-istio-token\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:37.950939 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.950748    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-credential-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:37.950939 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.950756    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/234d76d0-12a4-4050-b591-f43afea59d0a-istiod-ca-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:37.950939 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:37.950763    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/234d76d0-12a4-4050-b591-f43afea59d0a-istio-envoy\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:38.654774 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:38.654745    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"
Sep 16 15:03:38.655226 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:38.654772    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh" event={"ID":"234d76d0-12a4-4050-b591-f43afea59d0a","Type":"ContainerDied","Data":"35f30a340b82b74957514beeb9da617bb01c136f6bd265b518e7954632d4cebc"}
Sep 16 15:03:38.655226 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:38.654830    2569 scope.go:117] "RemoveContainer" containerID="2d9c222246d06bd5a64b7746c169feb15fe06301ef1ec0ef60323acd2ca95e4e"
Sep 16 15:03:38.676412 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:38.676382    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"]
Sep 16 15:03:38.684709 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:38.684670    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh"]
Sep 16 15:03:40.088313 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:40.088279    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" path="/var/lib/kubelet/pods/234d76d0-12a4-4050-b591-f43afea59d0a/volumes"
Sep 16 15:03:41.131852 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.131829    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:03:41.179066 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.178994    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-data\") pod \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") "
Sep 16 15:03:41.179205 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179065    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-token\") pod \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") "
Sep 16 15:03:41.179205 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179087    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-podinfo\") pod \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") "
Sep 16 15:03:41.179205 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179104    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-credential-socket\") pod \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") "
Sep 16 15:03:41.179205 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179135    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-workload-certs\") pod \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") "
Sep 16 15:03:41.179205 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179159    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-envoy\") pod \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") "
Sep 16 15:03:41.179205 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179180    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhgbs\" (UniqueName: \"kubernetes.io/projected/36b16229-8e8f-4c73-b02f-5b3366e26cf2-kube-api-access-rhgbs\") pod \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") "
Sep 16 15:03:41.179558 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179214    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istiod-ca-cert\") pod \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") "
Sep 16 15:03:41.179558 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179275    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-workload-socket\") pod \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\" (UID: \"36b16229-8e8f-4c73-b02f-5b3366e26cf2\") "
Sep 16 15:03:41.179558 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179285    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-data" (OuterVolumeSpecName: "istio-data") pod "36b16229-8e8f-4c73-b02f-5b3366e26cf2" (UID: "36b16229-8e8f-4c73-b02f-5b3366e26cf2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:41.179726 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179573    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "36b16229-8e8f-4c73-b02f-5b3366e26cf2" (UID: "36b16229-8e8f-4c73-b02f-5b3366e26cf2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:41.179726 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179656    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-workload-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:41.179726 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179675    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-data\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:41.179726 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.179669    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "36b16229-8e8f-4c73-b02f-5b3366e26cf2" (UID: "36b16229-8e8f-4c73-b02f-5b3366e26cf2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:03:41.180031 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.180002    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "36b16229-8e8f-4c73-b02f-5b3366e26cf2" (UID: "36b16229-8e8f-4c73-b02f-5b3366e26cf2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:41.180160 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.180065    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "36b16229-8e8f-4c73-b02f-5b3366e26cf2" (UID: "36b16229-8e8f-4c73-b02f-5b3366e26cf2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:41.181398 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.181361    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b16229-8e8f-4c73-b02f-5b3366e26cf2-kube-api-access-rhgbs" (OuterVolumeSpecName: "kube-api-access-rhgbs") pod "36b16229-8e8f-4c73-b02f-5b3366e26cf2" (UID: "36b16229-8e8f-4c73-b02f-5b3366e26cf2"). InnerVolumeSpecName "kube-api-access-rhgbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:41.181398 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.181376    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "36b16229-8e8f-4c73-b02f-5b3366e26cf2" (UID: "36b16229-8e8f-4c73-b02f-5b3366e26cf2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 15:03:41.181800 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.181775    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-token" (OuterVolumeSpecName: "istio-token") pod "36b16229-8e8f-4c73-b02f-5b3366e26cf2" (UID: "36b16229-8e8f-4c73-b02f-5b3366e26cf2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:41.181867 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.181819    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "36b16229-8e8f-4c73-b02f-5b3366e26cf2" (UID: "36b16229-8e8f-4c73-b02f-5b3366e26cf2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:41.281166 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.281128    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-token\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:41.281166 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.281160    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-podinfo\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:41.281166 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.281172    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-credential-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:41.281399 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.281182    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istio-envoy\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:41.281399 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.281190    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhgbs\" (UniqueName: \"kubernetes.io/projected/36b16229-8e8f-4c73-b02f-5b3366e26cf2-kube-api-access-rhgbs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:41.281399 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.281199    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36b16229-8e8f-4c73-b02f-5b3366e26cf2-istiod-ca-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:41.281399 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.281207    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b16229-8e8f-4c73-b02f-5b3366e26cf2-workload-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:03:41.678965 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.678933    2569 generic.go:356] "Generic (PLEG): container finished" podID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerID="21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a" exitCode=0
Sep 16 15:03:41.679181 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.678987    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"
Sep 16 15:03:41.679181 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.678997    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" event={"ID":"36b16229-8e8f-4c73-b02f-5b3366e26cf2","Type":"ContainerDied","Data":"21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a"}
Sep 16 15:03:41.679181 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.679038    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n" event={"ID":"36b16229-8e8f-4c73-b02f-5b3366e26cf2","Type":"ContainerDied","Data":"ad573d9ae5387f4ab9e7f453d30086aae372c9e9058e594194dbe10afadd1f10"}
Sep 16 15:03:41.679181 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.679058    2569 scope.go:117] "RemoveContainer" containerID="21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a"
Sep 16 15:03:41.688954 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.688921    2569 scope.go:117] "RemoveContainer" containerID="f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953"
Sep 16 15:03:41.696983 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.696967    2569 scope.go:117] "RemoveContainer" containerID="21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a"
Sep 16 15:03:41.697245 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:03:41.697222    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a\": container with ID starting with 21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a not found: ID does not exist" containerID="21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a"
Sep 16 15:03:41.697288 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.697254    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a"} err="failed to get container status \"21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a\": rpc error: code = NotFound desc = could not find container \"21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a\": container with ID starting with 21c34da3fcd1e6b3ce98fc7af953c7cc48d3e6ede43225c80f8496110598724a not found: ID does not exist"
Sep 16 15:03:41.697288 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.697270    2569 scope.go:117] "RemoveContainer" containerID="f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953"
Sep 16 15:03:41.697529 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:03:41.697502    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953\": container with ID starting with f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953 not found: ID does not exist" containerID="f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953"
Sep 16 15:03:41.697600 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.697533    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953"} err="failed to get container status \"f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953\": rpc error: code = NotFound desc = could not find container \"f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953\": container with ID starting with f3a17d28b8851c0b1e420d118ce4192da9a588468d0dafd3358370426434b953 not found: ID does not exist"
Sep 16 15:03:41.706459 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.706437    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"]
Sep 16 15:03:41.715046 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:41.715025    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n"]
Sep 16 15:03:42.088363 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:03:42.088326    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" path="/var/lib/kubelet/pods/36b16229-8e8f-4c73-b02f-5b3366e26cf2/volumes"
Sep 16 15:04:13.029060 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:13.029027    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"]
Sep 16 15:04:13.029601 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:13.029237    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy" containerID="cri-o://bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562" gracePeriod=30
Sep 16 15:04:14.518712 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:14.518677    2569 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 15:04:14.519075 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:14.518734    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 15:04:18.272662 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.272639    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 15:04:18.420373 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420299    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-token\") pod \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") "
Sep 16 15:04:18.420373 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420349    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-workload-certs\") pod \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") "
Sep 16 15:04:18.420583 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420400    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-credential-socket\") pod \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") "
Sep 16 15:04:18.420583 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420441    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-workload-socket\") pod \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") "
Sep 16 15:04:18.420583 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420472    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgr66\" (UniqueName: \"kubernetes.io/projected/4058afc9-8257-44ae-82e4-7f6544ae8a7f-kube-api-access-rgr66\") pod \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") "
Sep 16 15:04:18.420583 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420517    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-envoy\") pod \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") "
Sep 16 15:04:18.420583 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420555    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-data\") pod \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") "
Sep 16 15:04:18.420826 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420595    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istiod-ca-cert\") pod \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") "
Sep 16 15:04:18.420826 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420631    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-podinfo\") pod \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\" (UID: \"4058afc9-8257-44ae-82e4-7f6544ae8a7f\") "
Sep 16 15:04:18.420826 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420725    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4058afc9-8257-44ae-82e4-7f6544ae8a7f" (UID: "4058afc9-8257-44ae-82e4-7f6544ae8a7f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:04:18.420997 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420834    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4058afc9-8257-44ae-82e4-7f6544ae8a7f" (UID: "4058afc9-8257-44ae-82e4-7f6544ae8a7f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:04:18.420997 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420853    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-data" (OuterVolumeSpecName: "istio-data") pod "4058afc9-8257-44ae-82e4-7f6544ae8a7f" (UID: "4058afc9-8257-44ae-82e4-7f6544ae8a7f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:04:18.420997 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.420933    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4058afc9-8257-44ae-82e4-7f6544ae8a7f" (UID: "4058afc9-8257-44ae-82e4-7f6544ae8a7f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:04:18.421156 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.421052    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-credential-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:04:18.421156 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.421068    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-workload-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:04:18.421156 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.421080    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-data\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:04:18.421156 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.421122    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-workload-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:04:18.421359 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.421230    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4058afc9-8257-44ae-82e4-7f6544ae8a7f" (UID: "4058afc9-8257-44ae-82e4-7f6544ae8a7f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:04:18.422720 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.422695    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4058afc9-8257-44ae-82e4-7f6544ae8a7f" (UID: "4058afc9-8257-44ae-82e4-7f6544ae8a7f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:04:18.422823 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.422728    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4058afc9-8257-44ae-82e4-7f6544ae8a7f-kube-api-access-rgr66" (OuterVolumeSpecName: "kube-api-access-rgr66") pod "4058afc9-8257-44ae-82e4-7f6544ae8a7f" (UID: "4058afc9-8257-44ae-82e4-7f6544ae8a7f"). InnerVolumeSpecName "kube-api-access-rgr66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:04:18.422823 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.422806    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-token" (OuterVolumeSpecName: "istio-token") pod "4058afc9-8257-44ae-82e4-7f6544ae8a7f" (UID: "4058afc9-8257-44ae-82e4-7f6544ae8a7f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:04:18.422909 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.422880    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4058afc9-8257-44ae-82e4-7f6544ae8a7f" (UID: "4058afc9-8257-44ae-82e4-7f6544ae8a7f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 15:04:18.521701 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.521674    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-token\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:04:18.521701 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.521700    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgr66\" (UniqueName: \"kubernetes.io/projected/4058afc9-8257-44ae-82e4-7f6544ae8a7f-kube-api-access-rgr66\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:04:18.521837 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.521713    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-envoy\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:04:18.521837 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.521725    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istiod-ca-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:04:18.521837 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.521737    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4058afc9-8257-44ae-82e4-7f6544ae8a7f-istio-podinfo\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:04:18.904337 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.904301    2569 generic.go:356] "Generic (PLEG): container finished" podID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerID="bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562" exitCode=0
Sep 16 15:04:18.904458 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.904345    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"
Sep 16 15:04:18.904458 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.904362    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" event={"ID":"4058afc9-8257-44ae-82e4-7f6544ae8a7f","Type":"ContainerDied","Data":"bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562"}
Sep 16 15:04:18.904458 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.904417    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w" event={"ID":"4058afc9-8257-44ae-82e4-7f6544ae8a7f","Type":"ContainerDied","Data":"fd8c13432e29e2a1cc1227a6a7658ebeb6da4f218596c43b13d981bbd4c8fc9e"}
Sep 16 15:04:18.904458 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.904439    2569 scope.go:117] "RemoveContainer" containerID="bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562"
Sep 16 15:04:18.913706 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.913688    2569 scope.go:117] "RemoveContainer" containerID="d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea"
Sep 16 15:04:18.921751 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.921737    2569 scope.go:117] "RemoveContainer" containerID="bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562"
Sep 16 15:04:18.921982 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:04:18.921963    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562\": container with ID starting with bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562 not found: ID does not exist" containerID="bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562"
Sep 16 15:04:18.922047 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.921991    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562"} err="failed to get container status \"bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562\": rpc error: code = NotFound desc = could not find container \"bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562\": container with ID starting with bbcd768ac06e7d667368c1c6ae9979d5944bb5ac832afa967e42d0a46266f562 not found: ID does not exist"
Sep 16 15:04:18.922047 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.922007    2569 scope.go:117] "RemoveContainer" containerID="d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea"
Sep 16 15:04:18.922256 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:04:18.922240    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea\": container with ID starting with d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea not found: ID does not exist" containerID="d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea"
Sep 16 15:04:18.922297 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.922262    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea"} err="failed to get container status \"d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea\": rpc error: code = NotFound desc = could not find container \"d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea\": container with ID starting with d814cd124d793df0ec9371f4e873cdc3fbf60676ffe30bbc0247de2eee9805ea not found: ID does not exist"
Sep 16 15:04:18.929676 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.929648    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"]
Sep 16 15:04:18.936280 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:18.936261    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w"]
Sep 16 15:04:20.088096 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:20.088067    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" path="/var/lib/kubelet/pods/4058afc9-8257-44ae-82e4-7f6544ae8a7f/volumes"
Sep 16 15:04:37.032945 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.032913    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"]
Sep 16 15:04:37.033317 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033275    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ad9792-551a-46be-baa3-c925c83c53a4" containerName="maas-api"
Sep 16 15:04:37.033317 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033292    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ad9792-551a-46be-baa3-c925c83c53a4" containerName="maas-api"
Sep 16 15:04:37.033317 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033314    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033323    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033332    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3de88bc-20a4-4125-9fe9-0dbf761f4039" containerName="maas-api"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033340    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3de88bc-20a4-4125-9fe9-0dbf761f4039" containerName="maas-api"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033351    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033359    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033375    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033382    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033393    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4894ae12-d9a5-49fd-b705-875e97a9c416" containerName="maas-api"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033401    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4894ae12-d9a5-49fd-b705-875e97a9c416" containerName="maas-api"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033413    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033421    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b749f7-69c5-4e09-b284-0837723989a4" containerName="istio-proxy"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033430    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033437    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy"
Sep 16 15:04:37.033444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033452    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef6dc77-88a6-4b78-8006-2bd82b0369ff" containerName="main"
Sep 16 15:04:37.033985 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033459    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef6dc77-88a6-4b78-8006-2bd82b0369ff" containerName="main"
Sep 16 15:04:37.033985 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033582    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy"
Sep 16 15:04:37.033985 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033591    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy"
Sep 16 15:04:37.033985 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033598    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3de88bc-20a4-4125-9fe9-0dbf761f4039" containerName="maas-api"
Sep 16 15:04:37.033985 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033610    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4894ae12-d9a5-49fd-b705-875e97a9c416" containerName="maas-api"
Sep 16 15:04:37.033985 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033618    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy"
Sep 16 15:04:37.033985 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033625    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy"
Sep 16 15:04:37.033985 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033630    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ef6dc77-88a6-4b78-8006-2bd82b0369ff" containerName="main"
Sep 16 15:04:37.033985 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033639    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4ad9792-551a-46be-baa3-c925c83c53a4" containerName="maas-api"
Sep 16 15:04:37.033985 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033644    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy"
Sep 16 15:04:37.033985 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.033649    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b16229-8e8f-4c73-b02f-5b3366e26cf2" containerName="istio-proxy"
Sep 16 15:04:37.036768 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.036750    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.041265 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.041240    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-cadcf4\"/\"openshift-service-ca.crt\""
Sep 16 15:04:37.041385 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.041245    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-cadcf4\"/\"default-dockercfg-r6t6g\""
Sep 16 15:04:37.041385 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.041245    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-cadcf4\"/\"kube-root-ca.crt\""
Sep 16 15:04:37.041385 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.041288    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-cadcf4\"/\"sub-test-model-cadcf4-kserve-self-signed-certs\""
Sep 16 15:04:37.052197 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.052169    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"]
Sep 16 15:04:37.072448 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.072415    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-dshm\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.072575 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.072468    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-tmp-dir\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.072638 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.072620    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-model-cache\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.072697 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.072684    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc15d95b-dbd7-4eac-95d5-96432372325a-tls-certs\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.072741 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.072715    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrrrs\" (UniqueName: \"kubernetes.io/projected/bc15d95b-dbd7-4eac-95d5-96432372325a-kube-api-access-rrrrs\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.072825 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.072800    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-home\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.173208 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.173186    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-home\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.173299 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.173222    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-dshm\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.173299 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.173242    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-tmp-dir\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.173299 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.173279    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-model-cache\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.173443 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.173305    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc15d95b-dbd7-4eac-95d5-96432372325a-tls-certs\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.173443 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.173328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrrrs\" (UniqueName: \"kubernetes.io/projected/bc15d95b-dbd7-4eac-95d5-96432372325a-kube-api-access-rrrrs\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.173637 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.173615    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-home\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.173708 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.173651    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-tmp-dir\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.173756 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.173733    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-model-cache\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.175481 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.175457    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-dshm\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.175734 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.175719    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc15d95b-dbd7-4eac-95d5-96432372325a-tls-certs\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.185292 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.185272    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrrrs\" (UniqueName: \"kubernetes.io/projected/bc15d95b-dbd7-4eac-95d5-96432372325a-kube-api-access-rrrrs\") pod \"sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") " pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.345734 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.345655    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:37.654539 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:37.654516    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"]
Sep 16 15:04:37.656202 ip-10-0-132-120 kubenswrapper[2569]: W0916 15:04:37.656176    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc15d95b_dbd7_4eac_95d5_96432372325a.slice/crio-4773d6ec6fb1200fb17b358b3d1c0bc57cb92cd64bad39cec88e9ffe1ec96c72 WatchSource:0}: Error finding container 4773d6ec6fb1200fb17b358b3d1c0bc57cb92cd64bad39cec88e9ffe1ec96c72: Status 404 returned error can't find the container with id 4773d6ec6fb1200fb17b358b3d1c0bc57cb92cd64bad39cec88e9ffe1ec96c72
Sep 16 15:04:38.009198 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:38.009170    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k" event={"ID":"bc15d95b-dbd7-4eac-95d5-96432372325a","Type":"ContainerStarted","Data":"3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6"}
Sep 16 15:04:38.009330 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:38.009210    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k" event={"ID":"bc15d95b-dbd7-4eac-95d5-96432372325a","Type":"ContainerStarted","Data":"4773d6ec6fb1200fb17b358b3d1c0bc57cb92cd64bad39cec88e9ffe1ec96c72"}
Sep 16 15:04:47.346803 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:47.346770    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:47.346803 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:47.346811    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:47.358429 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:47.358400    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:04:47.380479 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:47.380432    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k" podStartSLOduration=10.380417527 podStartE2EDuration="10.380417527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:04:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:04:38.045845782 +0000 UTC m=+1752.397127490" watchObservedRunningTime="2026-09-16 15:04:47.380417527 +0000 UTC m=+1761.731699266"
Sep 16 15:04:48.076921 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:04:48.076890    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:05:14.600444 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:14.600408    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"]
Sep 16 15:05:26.221762 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:26.221736    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 15:05:26.227969 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:26.227949    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 15:05:29.618812 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.618738    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k" podUID="bc15d95b-dbd7-4eac-95d5-96432372325a" containerName="main" containerID="cri-o://3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6" gracePeriod=45
Sep 16 15:05:29.861346 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.861314    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:05:29.921601 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.921481    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-home\") pod \"bc15d95b-dbd7-4eac-95d5-96432372325a\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") "
Sep 16 15:05:29.921601 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.921576    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-model-cache\") pod \"bc15d95b-dbd7-4eac-95d5-96432372325a\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") "
Sep 16 15:05:29.921797 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.921671    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-tmp-dir\") pod \"bc15d95b-dbd7-4eac-95d5-96432372325a\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") "
Sep 16 15:05:29.921797 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.921690    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-home" (OuterVolumeSpecName: "home") pod "bc15d95b-dbd7-4eac-95d5-96432372325a" (UID: "bc15d95b-dbd7-4eac-95d5-96432372325a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:05:29.921797 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.921717    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-dshm\") pod \"bc15d95b-dbd7-4eac-95d5-96432372325a\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") "
Sep 16 15:05:29.921797 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.921750    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc15d95b-dbd7-4eac-95d5-96432372325a-tls-certs\") pod \"bc15d95b-dbd7-4eac-95d5-96432372325a\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") "
Sep 16 15:05:29.921797 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.921792    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrrrs\" (UniqueName: \"kubernetes.io/projected/bc15d95b-dbd7-4eac-95d5-96432372325a-kube-api-access-rrrrs\") pod \"bc15d95b-dbd7-4eac-95d5-96432372325a\" (UID: \"bc15d95b-dbd7-4eac-95d5-96432372325a\") "
Sep 16 15:05:29.921797 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.921792    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-model-cache" (OuterVolumeSpecName: "model-cache") pod "bc15d95b-dbd7-4eac-95d5-96432372325a" (UID: "bc15d95b-dbd7-4eac-95d5-96432372325a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:05:29.922101 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.921948    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bc15d95b-dbd7-4eac-95d5-96432372325a" (UID: "bc15d95b-dbd7-4eac-95d5-96432372325a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:05:29.922101 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.922081    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-tmp-dir\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:05:29.922101 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.922099    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-home\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:05:29.922217 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.922112    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-model-cache\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:05:29.924007 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.923977    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc15d95b-dbd7-4eac-95d5-96432372325a-kube-api-access-rrrrs" (OuterVolumeSpecName: "kube-api-access-rrrrs") pod "bc15d95b-dbd7-4eac-95d5-96432372325a" (UID: "bc15d95b-dbd7-4eac-95d5-96432372325a"). InnerVolumeSpecName "kube-api-access-rrrrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:05:29.924007 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.924000    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-dshm" (OuterVolumeSpecName: "dshm") pod "bc15d95b-dbd7-4eac-95d5-96432372325a" (UID: "bc15d95b-dbd7-4eac-95d5-96432372325a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:05:29.924170 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:29.924007    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc15d95b-dbd7-4eac-95d5-96432372325a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bc15d95b-dbd7-4eac-95d5-96432372325a" (UID: "bc15d95b-dbd7-4eac-95d5-96432372325a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:05:30.022931 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:30.022900    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc15d95b-dbd7-4eac-95d5-96432372325a-dshm\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:05:30.022931 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:30.022927    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc15d95b-dbd7-4eac-95d5-96432372325a-tls-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:05:30.022931 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:30.022938    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrrrs\" (UniqueName: \"kubernetes.io/projected/bc15d95b-dbd7-4eac-95d5-96432372325a-kube-api-access-rrrrs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:05:30.296188 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:30.296151    2569 generic.go:356] "Generic (PLEG): container finished" podID="bc15d95b-dbd7-4eac-95d5-96432372325a" containerID="3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6" exitCode=0
Sep 16 15:05:30.296188 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:30.296196    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"
Sep 16 15:05:30.296414 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:30.296241    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k" event={"ID":"bc15d95b-dbd7-4eac-95d5-96432372325a","Type":"ContainerDied","Data":"3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6"}
Sep 16 15:05:30.296414 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:30.296285    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k" event={"ID":"bc15d95b-dbd7-4eac-95d5-96432372325a","Type":"ContainerDied","Data":"4773d6ec6fb1200fb17b358b3d1c0bc57cb92cd64bad39cec88e9ffe1ec96c72"}
Sep 16 15:05:30.296414 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:30.296302    2569 scope.go:117] "RemoveContainer" containerID="3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6"
Sep 16 15:05:30.307200 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:30.307180    2569 scope.go:117] "RemoveContainer" containerID="3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6"
Sep 16 15:05:30.307483 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:05:30.307460    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6\": container with ID starting with 3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6 not found: ID does not exist" containerID="3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6"
Sep 16 15:05:30.307542 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:30.307509    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6"} err="failed to get container status \"3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6\": rpc error: code = NotFound desc = could not find container \"3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6\": container with ID starting with 3253561fabe32b68bbf0adc74add3ee1ed015bead93314d8c54a11d7ed1140a6 not found: ID does not exist"
Sep 16 15:05:30.315549 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:30.315521    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"]
Sep 16 15:05:30.317955 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:30.317930    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-cadcf4/sub-test-model-cadcf4-kserve-7b5b6cb4bf-bhr6k"]
Sep 16 15:05:32.088605 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:05:32.088572    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc15d95b-dbd7-4eac-95d5-96432372325a" path="/var/lib/kubelet/pods/bc15d95b-dbd7-4eac-95d5-96432372325a/volumes"
Sep 16 15:07:09.380431 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.380398    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"]
Sep 16 15:07:09.381012 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.380991    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy"
Sep 16 15:07:09.381098 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.381015    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="234d76d0-12a4-4050-b591-f43afea59d0a" containerName="istio-proxy"
Sep 16 15:07:09.381098 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.381035    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy"
Sep 16 15:07:09.381098 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.381043    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4058afc9-8257-44ae-82e4-7f6544ae8a7f" containerName="istio-proxy"
Sep 16 15:07:09.381098 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.381055    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc15d95b-dbd7-4eac-95d5-96432372325a" containerName="main"
Sep 16 15:07:09.381098 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.381064    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc15d95b-dbd7-4eac-95d5-96432372325a" containerName="main"
Sep 16 15:07:09.381339 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.381177    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc15d95b-dbd7-4eac-95d5-96432372325a" containerName="main"
Sep 16 15:07:09.384302 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.384280    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.386626 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.386600    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-438a9b-openshift-default-dockercfg-4wnxv\""
Sep 16 15:07:09.398410 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.398388    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"]
Sep 16 15:07:09.516177 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.516139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-istio-data\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.516345 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.516196    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-workload-certs\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.516345 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.516241    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/982919b7-f81f-4831-a6f3-b81004280842-istio-token\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.516345 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.516271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-credential-socket\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.516345 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.516287    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/982919b7-f81f-4831-a6f3-b81004280842-istiod-ca-cert\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.516345 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.516307    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/982919b7-f81f-4831-a6f3-b81004280842-istio-podinfo\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.516345 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.516344    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-istio-envoy\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.516634 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.516362    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z54p5\" (UniqueName: \"kubernetes.io/projected/982919b7-f81f-4831-a6f3-b81004280842-kube-api-access-z54p5\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.516634 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.516383    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-workload-socket\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.617353 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.617321    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-credential-socket\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.617521 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.617355    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/982919b7-f81f-4831-a6f3-b81004280842-istiod-ca-cert\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.617521 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.617383    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/982919b7-f81f-4831-a6f3-b81004280842-istio-podinfo\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.617521 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.617440    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-istio-envoy\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.617521 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.617514    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z54p5\" (UniqueName: \"kubernetes.io/projected/982919b7-f81f-4831-a6f3-b81004280842-kube-api-access-z54p5\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.617750 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.617550    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-workload-socket\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.617750 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.617605    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-istio-data\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.617750 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.617668    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-workload-certs\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.617750 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.617707    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/982919b7-f81f-4831-a6f3-b81004280842-istio-token\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.617947 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.617782    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-credential-socket\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.617985 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.617939    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-istio-data\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.618081 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.618061    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-workload-certs\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.618178 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.618156    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-workload-socket\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.618215 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.618196    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/982919b7-f81f-4831-a6f3-b81004280842-istiod-ca-cert\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.619787 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.619764    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-istio-envoy\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.619896 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.619855    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/982919b7-f81f-4831-a6f3-b81004280842-istio-podinfo\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.627711 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.627692    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/982919b7-f81f-4831-a6f3-b81004280842-istio-token\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.627824 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.627802    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z54p5\" (UniqueName: \"kubernetes.io/projected/982919b7-f81f-4831-a6f3-b81004280842-kube-api-access-z54p5\") pod \"e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") " pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.694811 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.694758    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:09.982954 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.982929    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"]
Sep 16 15:07:09.984480 ip-10-0-132-120 kubenswrapper[2569]: W0916 15:07:09.984451    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982919b7_f81f_4831_a6f3_b81004280842.slice/crio-98a3254255aa90839a476ba22daf17400b525157d8725de2629b772ca45c2dc0 WatchSource:0}: Error finding container 98a3254255aa90839a476ba22daf17400b525157d8725de2629b772ca45c2dc0: Status 404 returned error can't find the container with id 98a3254255aa90839a476ba22daf17400b525157d8725de2629b772ca45c2dc0
Sep 16 15:07:09.986824 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.986785    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 15:07:09.986911 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.986871    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 15:07:09.986950 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:09.986916    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 15:07:10.850149 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:10.850111    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" event={"ID":"982919b7-f81f-4831-a6f3-b81004280842","Type":"ContainerStarted","Data":"13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0"}
Sep 16 15:07:10.850533 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:10.850169    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" event={"ID":"982919b7-f81f-4831-a6f3-b81004280842","Type":"ContainerStarted","Data":"98a3254255aa90839a476ba22daf17400b525157d8725de2629b772ca45c2dc0"}
Sep 16 15:07:10.882158 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:10.882111    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" podStartSLOduration=1.882096125 podStartE2EDuration="1.882096125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:07:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:07:10.878329474 +0000 UTC m=+1905.229611181" watchObservedRunningTime="2026-09-16 15:07:10.882096125 +0000 UTC m=+1905.233377832"
Sep 16 15:07:11.695929 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:11.695896    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:11.700346 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:11.700321    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:11.856202 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:11.856175    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:11.856979 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:11.856958    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:15.238373 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.238343    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"]
Sep 16 15:07:15.241872 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.241851    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.244078 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.244052    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-438a9b-serving-cert\""
Sep 16 15:07:15.253600 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.253565    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"]
Sep 16 15:07:15.374499 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.374463    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfjbs\" (UniqueName: \"kubernetes.io/projected/726e9774-af2a-407e-9bf2-9c0d97f98350-kube-api-access-hfjbs\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.374670 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.374536    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/726e9774-af2a-407e-9bf2-9c0d97f98350-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.374670 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.374565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-metrics-certs\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.374670 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.374646    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-maas-api-tls\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.475554 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.475521    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjbs\" (UniqueName: \"kubernetes.io/projected/726e9774-af2a-407e-9bf2-9c0d97f98350-kube-api-access-hfjbs\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.475554 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.475556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/726e9774-af2a-407e-9bf2-9c0d97f98350-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.475756 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.475577    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-metrics-certs\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.475756 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.475627    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-maas-api-tls\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.475756 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:07:15.475731    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-serving-cert: secret "maas-api-e2e-ipp-b-438a9b-serving-cert" not found
Sep 16 15:07:15.475858 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:07:15.475797    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-maas-api-tls podName:726e9774-af2a-407e-9bf2-9c0d97f98350 nodeName:}" failed. No retries permitted until 2026-09-16 15:07:15.97577809 +0000 UTC m=+1910.327059798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-maas-api-tls") pod "maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn" (UID: "726e9774-af2a-407e-9bf2-9c0d97f98350") : secret "maas-api-e2e-ipp-b-438a9b-serving-cert" not found
Sep 16 15:07:15.476278 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.476257    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/726e9774-af2a-407e-9bf2-9c0d97f98350-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.478096 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.478070    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-metrics-certs\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.486164 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.486144    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfjbs\" (UniqueName: \"kubernetes.io/projected/726e9774-af2a-407e-9bf2-9c0d97f98350-kube-api-access-hfjbs\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.980005 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.979968    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-maas-api-tls\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:15.982308 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:15.982283    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-maas-api-tls\") pod \"maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:16.153042 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:16.152998    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:16.426309 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:16.426278    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"]
Sep 16 15:07:16.427347 ip-10-0-132-120 kubenswrapper[2569]: W0916 15:07:16.427317    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726e9774_af2a_407e_9bf2_9c0d97f98350.slice/crio-1091ef97e5db17770d67fd075d31e2793f4dda32d0a77a8b02b2af42ebef72f9 WatchSource:0}: Error finding container 1091ef97e5db17770d67fd075d31e2793f4dda32d0a77a8b02b2af42ebef72f9: Status 404 returned error can't find the container with id 1091ef97e5db17770d67fd075d31e2793f4dda32d0a77a8b02b2af42ebef72f9
Sep 16 15:07:16.428567 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:16.428548    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 15:07:16.888306 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:16.888269    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn" event={"ID":"726e9774-af2a-407e-9bf2-9c0d97f98350","Type":"ContainerStarted","Data":"d786811223a60fdb51aaaec8af1b3c78115e0a0ce7c94d9419c0df5a58012321"}
Sep 16 15:07:16.888466 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:16.888369    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn" event={"ID":"726e9774-af2a-407e-9bf2-9c0d97f98350","Type":"ContainerStarted","Data":"1091ef97e5db17770d67fd075d31e2793f4dda32d0a77a8b02b2af42ebef72f9"}
Sep 16 15:07:16.888466 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:16.888403    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:16.905486 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:16.905442    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn" podStartSLOduration=1.558195971 podStartE2EDuration="1.905427519s" totalImagesPullingTime="347.231548ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:07:16.903595397 +0000 UTC m=+1911.254877117" watchObservedRunningTime="2026-09-16 15:07:16.905427519 +0000 UTC m=+1911.256709226"
Sep 16 15:07:22.899942 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:22.899914    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:07:27.897666 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:27.897610    2569 patch_prober.go:28] interesting pod/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 15:07:27.898085 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:27.897677    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 15:07:29.964469 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:29.964391    2569 generic.go:356] "Generic (PLEG): container finished" podID="982919b7-f81f-4831-a6f3-b81004280842" containerID="13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0" exitCode=0
Sep 16 15:07:29.964469 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:29.964458    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" event={"ID":"982919b7-f81f-4831-a6f3-b81004280842","Type":"ContainerDied","Data":"13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0"}
Sep 16 15:07:29.964876 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:29.964830    2569 scope.go:117] "RemoveContainer" containerID="13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0"
Sep 16 15:07:29.965831 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:29.965806    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 15:07:29.965891 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:29.965878    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 15:07:29.965930 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:29.965919    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 15:07:30.972448 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:30.972418    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" event={"ID":"982919b7-f81f-4831-a6f3-b81004280842","Type":"ContainerStarted","Data":"e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617"}
Sep 16 15:07:31.695094 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:31.695058    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:31.695270 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:31.695220    2569 patch_prober.go:28] interesting pod/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 15:07:31.695315 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:31.695276    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 15:07:32.695414 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:32.695379    2569 patch_prober.go:28] interesting pod/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 15:07:32.695826 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:32.695432    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 15:07:33.695799 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:33.695760    2569 patch_prober.go:28] interesting pod/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 15:07:33.696283 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:33.695852    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 15:07:34.695483 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:34.695443    2569 patch_prober.go:28] interesting pod/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 15:07:34.695694 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:34.695541    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 15:07:35.696051 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:35.696010    2569 patch_prober.go:28] interesting pod/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 15:07:35.696537 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:35.696062    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 15:07:36.699205 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:36.699172    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:36.699612 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:36.699518    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:36.700157 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:36.700140    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:07:50.121113 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.121078    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"]
Sep 16 15:07:50.124963 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.124939    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.128312 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.128288    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-91f4ab\"/\"openshift-service-ca.crt\""
Sep 16 15:07:50.128312 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.128297    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-91f4ab\"/\"default-dockercfg-4zts7\""
Sep 16 15:07:50.128528 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.128301    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-91f4ab\"/\"kube-root-ca.crt\""
Sep 16 15:07:50.128528 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.128296    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-91f4ab\"/\"ipp-route-91f4ab-kserve-self-signed-certs\""
Sep 16 15:07:50.135641 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.135614    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"]
Sep 16 15:07:50.198453 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.198430    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-model-cache\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.198607 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.198470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjf2q\" (UniqueName: \"kubernetes.io/projected/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-kube-api-access-zjf2q\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.198607 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.198520    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-home\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.198692 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.198676    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-tls-certs\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.198728 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.198717    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-tmp-dir\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.198795 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.198780    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-dshm\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.299857 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.299825    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-home\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.300034 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.300005    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-tls-certs\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.300090 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.300074    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-tmp-dir\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.300135 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.300111    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-dshm\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.300215 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.300200    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-model-cache\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.300273 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.300258    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjf2q\" (UniqueName: \"kubernetes.io/projected/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-kube-api-access-zjf2q\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.300328 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.300253    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-home\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.300515 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.300477    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-tmp-dir\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.301011 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.300953    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-model-cache\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.303301 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.303279    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-dshm\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.304051 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.303984    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-tls-certs\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.316866 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.316839    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjf2q\" (UniqueName: \"kubernetes.io/projected/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-kube-api-access-zjf2q\") pod \"ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") " pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.434477 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.434420    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:07:50.708303 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:50.708273    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"]
Sep 16 15:07:50.709103 ip-10-0-132-120 kubenswrapper[2569]: W0916 15:07:50.709079    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf7f7f6e_bfc8_49b1_b36c_3f4f789724a9.slice/crio-baacbb19814481762e5b4e6dbdfde46b754caa70db6cee74b1a65d6b917caf8f WatchSource:0}: Error finding container baacbb19814481762e5b4e6dbdfde46b754caa70db6cee74b1a65d6b917caf8f: Status 404 returned error can't find the container with id baacbb19814481762e5b4e6dbdfde46b754caa70db6cee74b1a65d6b917caf8f
Sep 16 15:07:51.092555 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:51.092520    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9" event={"ID":"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9","Type":"ContainerStarted","Data":"04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149"}
Sep 16 15:07:51.092555 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:07:51.092557    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9" event={"ID":"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9","Type":"ContainerStarted","Data":"baacbb19814481762e5b4e6dbdfde46b754caa70db6cee74b1a65d6b917caf8f"}
Sep 16 15:08:00.434818 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:08:00.434782    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:08:00.435248 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:08:00.434841    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:08:00.446761 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:08:00.446733    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:08:00.465280 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:08:00.465238    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9" podStartSLOduration=10.465224763 podStartE2EDuration="10.465224763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:07:51.122113602 +0000 UTC m=+1945.473395310" watchObservedRunningTime="2026-09-16 15:08:00.465224763 +0000 UTC m=+1954.816506488"
Sep 16 15:08:01.156669 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:08:01.156642    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:09:33.202331 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:33.202293    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"]
Sep 16 15:09:48.221742 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.221708    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9" podUID="df7f7f6e-bfc8-49b1-b36c-3f4f789724a9" containerName="main" containerID="cri-o://04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149" gracePeriod=45
Sep 16 15:09:48.459463 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.459439    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:09:48.553047 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.553021    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-tmp-dir\") pod \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") "
Sep 16 15:09:48.553232 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.553071    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjf2q\" (UniqueName: \"kubernetes.io/projected/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-kube-api-access-zjf2q\") pod \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") "
Sep 16 15:09:48.553232 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.553123    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-home\") pod \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") "
Sep 16 15:09:48.553232 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.553168    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-tls-certs\") pod \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") "
Sep 16 15:09:48.553232 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.553185    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-dshm\") pod \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") "
Sep 16 15:09:48.553232 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.553216    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-model-cache\") pod \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\" (UID: \"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9\") "
Sep 16 15:09:48.553519 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.553289    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "df7f7f6e-bfc8-49b1-b36c-3f4f789724a9" (UID: "df7f7f6e-bfc8-49b1-b36c-3f4f789724a9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:09:48.553519 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.553401    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-home" (OuterVolumeSpecName: "home") pod "df7f7f6e-bfc8-49b1-b36c-3f4f789724a9" (UID: "df7f7f6e-bfc8-49b1-b36c-3f4f789724a9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:09:48.553638 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.553581    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-home\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:09:48.553638 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.553598    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-tmp-dir\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:09:48.553638 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.553611    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-model-cache" (OuterVolumeSpecName: "model-cache") pod "df7f7f6e-bfc8-49b1-b36c-3f4f789724a9" (UID: "df7f7f6e-bfc8-49b1-b36c-3f4f789724a9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:09:48.555332 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.555305    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-dshm" (OuterVolumeSpecName: "dshm") pod "df7f7f6e-bfc8-49b1-b36c-3f4f789724a9" (UID: "df7f7f6e-bfc8-49b1-b36c-3f4f789724a9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:09:48.555332 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.555311    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "df7f7f6e-bfc8-49b1-b36c-3f4f789724a9" (UID: "df7f7f6e-bfc8-49b1-b36c-3f4f789724a9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:09:48.555529 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.555431    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-kube-api-access-zjf2q" (OuterVolumeSpecName: "kube-api-access-zjf2q") pod "df7f7f6e-bfc8-49b1-b36c-3f4f789724a9" (UID: "df7f7f6e-bfc8-49b1-b36c-3f4f789724a9"). InnerVolumeSpecName "kube-api-access-zjf2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:09:48.654212 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.654185    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-tls-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:09:48.654212 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.654212    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-dshm\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:09:48.654378 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.654225    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-model-cache\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:09:48.654378 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.654234    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjf2q\" (UniqueName: \"kubernetes.io/projected/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9-kube-api-access-zjf2q\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:09:48.740354 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.740327    2569 generic.go:356] "Generic (PLEG): container finished" podID="df7f7f6e-bfc8-49b1-b36c-3f4f789724a9" containerID="04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149" exitCode=0
Sep 16 15:09:48.740533 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.740381    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"
Sep 16 15:09:48.740533 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.740388    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9" event={"ID":"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9","Type":"ContainerDied","Data":"04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149"}
Sep 16 15:09:48.740533 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.740515    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9" event={"ID":"df7f7f6e-bfc8-49b1-b36c-3f4f789724a9","Type":"ContainerDied","Data":"baacbb19814481762e5b4e6dbdfde46b754caa70db6cee74b1a65d6b917caf8f"}
Sep 16 15:09:48.740533 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.740533    2569 scope.go:117] "RemoveContainer" containerID="04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149"
Sep 16 15:09:48.749693 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.749675    2569 scope.go:117] "RemoveContainer" containerID="04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149"
Sep 16 15:09:48.749930 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:09:48.749910    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149\": container with ID starting with 04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149 not found: ID does not exist" containerID="04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149"
Sep 16 15:09:48.749995 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.749942    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149"} err="failed to get container status \"04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149\": rpc error: code = NotFound desc = could not find container \"04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149\": container with ID starting with 04690ab5906f9be9eea37dfd1142022dfd1566be49e557ace124a01e2b204149 not found: ID does not exist"
Sep 16 15:09:48.772926 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.772901    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"]
Sep 16 15:09:48.779057 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:48.779036    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-91f4ab/ipp-route-91f4ab-kserve-5bbdcc4cc5-jf2j9"]
Sep 16 15:09:50.088560 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:09:50.088526    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df7f7f6e-bfc8-49b1-b36c-3f4f789724a9" path="/var/lib/kubelet/pods/df7f7f6e-bfc8-49b1-b36c-3f4f789724a9/volumes"
Sep 16 15:10:26.262752 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:26.262724    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 15:10:26.268031 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:26.268011    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 15:10:28.721304 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:28.721268    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"]
Sep 16 15:10:28.721779 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:28.721535    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn" podUID="726e9774-af2a-407e-9bf2-9c0d97f98350" containerName="maas-api" containerID="cri-o://d786811223a60fdb51aaaec8af1b3c78115e0a0ce7c94d9419c0df5a58012321" gracePeriod=30
Sep 16 15:10:28.965365 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:28.965332    2569 generic.go:356] "Generic (PLEG): container finished" podID="726e9774-af2a-407e-9bf2-9c0d97f98350" containerID="d786811223a60fdb51aaaec8af1b3c78115e0a0ce7c94d9419c0df5a58012321" exitCode=0
Sep 16 15:10:28.965503 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:28.965374    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn" event={"ID":"726e9774-af2a-407e-9bf2-9c0d97f98350","Type":"ContainerDied","Data":"d786811223a60fdb51aaaec8af1b3c78115e0a0ce7c94d9419c0df5a58012321"}
Sep 16 15:10:28.965503 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:28.965439    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn" event={"ID":"726e9774-af2a-407e-9bf2-9c0d97f98350","Type":"ContainerDied","Data":"1091ef97e5db17770d67fd075d31e2793f4dda32d0a77a8b02b2af42ebef72f9"}
Sep 16 15:10:28.965503 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:28.965461    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1091ef97e5db17770d67fd075d31e2793f4dda32d0a77a8b02b2af42ebef72f9"
Sep 16 15:10:28.969768 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:28.969748    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:10:29.100362 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.100328    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/726e9774-af2a-407e-9bf2-9c0d97f98350-openshift-service-ca\") pod \"726e9774-af2a-407e-9bf2-9c0d97f98350\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") "
Sep 16 15:10:29.100362 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.100362    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfjbs\" (UniqueName: \"kubernetes.io/projected/726e9774-af2a-407e-9bf2-9c0d97f98350-kube-api-access-hfjbs\") pod \"726e9774-af2a-407e-9bf2-9c0d97f98350\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") "
Sep 16 15:10:29.100616 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.100471    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-maas-api-tls\") pod \"726e9774-af2a-407e-9bf2-9c0d97f98350\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") "
Sep 16 15:10:29.100616 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.100544    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-metrics-certs\") pod \"726e9774-af2a-407e-9bf2-9c0d97f98350\" (UID: \"726e9774-af2a-407e-9bf2-9c0d97f98350\") "
Sep 16 15:10:29.100771 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.100752    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/726e9774-af2a-407e-9bf2-9c0d97f98350-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "726e9774-af2a-407e-9bf2-9c0d97f98350" (UID: "726e9774-af2a-407e-9bf2-9c0d97f98350"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:10:29.100899 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.100881    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/726e9774-af2a-407e-9bf2-9c0d97f98350-openshift-service-ca\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:29.102485 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.102441    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/726e9774-af2a-407e-9bf2-9c0d97f98350-kube-api-access-hfjbs" (OuterVolumeSpecName: "kube-api-access-hfjbs") pod "726e9774-af2a-407e-9bf2-9c0d97f98350" (UID: "726e9774-af2a-407e-9bf2-9c0d97f98350"). InnerVolumeSpecName "kube-api-access-hfjbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:10:29.102634 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.102564    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "726e9774-af2a-407e-9bf2-9c0d97f98350" (UID: "726e9774-af2a-407e-9bf2-9c0d97f98350"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:10:29.102634 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.102599    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "726e9774-af2a-407e-9bf2-9c0d97f98350" (UID: "726e9774-af2a-407e-9bf2-9c0d97f98350"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:10:29.202401 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.202367    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-metrics-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:29.202401 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.202397    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfjbs\" (UniqueName: \"kubernetes.io/projected/726e9774-af2a-407e-9bf2-9c0d97f98350-kube-api-access-hfjbs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:29.202401 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.202407    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/726e9774-af2a-407e-9bf2-9c0d97f98350-maas-api-tls\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:29.971165 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.971134    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"
Sep 16 15:10:29.998552 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:29.998525    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"]
Sep 16 15:10:30.004137 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:30.004114    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-438a9b-6d67d6f546-sqptn"]
Sep 16 15:10:30.088438 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:30.088408    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="726e9774-af2a-407e-9bf2-9c0d97f98350" path="/var/lib/kubelet/pods/726e9774-af2a-407e-9bf2-9c0d97f98350/volumes"
Sep 16 15:10:37.136018 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:37.135979    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"]
Sep 16 15:10:37.136455 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:37.136200    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy" containerID="cri-o://e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617" gracePeriod=30
Sep 16 15:10:42.380586 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.380555    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:10:42.518218 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.518189    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-workload-certs\") pod \"982919b7-f81f-4831-a6f3-b81004280842\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") "
Sep 16 15:10:42.518365 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.518233    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z54p5\" (UniqueName: \"kubernetes.io/projected/982919b7-f81f-4831-a6f3-b81004280842-kube-api-access-z54p5\") pod \"982919b7-f81f-4831-a6f3-b81004280842\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") "
Sep 16 15:10:42.518365 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.518257    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/982919b7-f81f-4831-a6f3-b81004280842-istio-podinfo\") pod \"982919b7-f81f-4831-a6f3-b81004280842\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") "
Sep 16 15:10:42.518365 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.518283    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-istio-envoy\") pod \"982919b7-f81f-4831-a6f3-b81004280842\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") "
Sep 16 15:10:42.518365 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.518321    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/982919b7-f81f-4831-a6f3-b81004280842-istio-token\") pod \"982919b7-f81f-4831-a6f3-b81004280842\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") "
Sep 16 15:10:42.518365 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.518357    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-istio-data\") pod \"982919b7-f81f-4831-a6f3-b81004280842\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") "
Sep 16 15:10:42.518649 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.518462    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "982919b7-f81f-4831-a6f3-b81004280842" (UID: "982919b7-f81f-4831-a6f3-b81004280842"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:10:42.518649 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.518516    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-workload-socket\") pod \"982919b7-f81f-4831-a6f3-b81004280842\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") "
Sep 16 15:10:42.518649 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.518612    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-credential-socket\") pod \"982919b7-f81f-4831-a6f3-b81004280842\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") "
Sep 16 15:10:42.518649 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.518647    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/982919b7-f81f-4831-a6f3-b81004280842-istiod-ca-cert\") pod \"982919b7-f81f-4831-a6f3-b81004280842\" (UID: \"982919b7-f81f-4831-a6f3-b81004280842\") "
Sep 16 15:10:42.518860 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.518775    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "982919b7-f81f-4831-a6f3-b81004280842" (UID: "982919b7-f81f-4831-a6f3-b81004280842"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:10:42.518860 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.518791    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-istio-data" (OuterVolumeSpecName: "istio-data") pod "982919b7-f81f-4831-a6f3-b81004280842" (UID: "982919b7-f81f-4831-a6f3-b81004280842"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:10:42.519038 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.519000    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "982919b7-f81f-4831-a6f3-b81004280842" (UID: "982919b7-f81f-4831-a6f3-b81004280842"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:10:42.519038 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.519009    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-istio-data\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:42.519038 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.519030    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-workload-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:42.519171 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.519046    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-workload-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:42.519171 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.519083    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/982919b7-f81f-4831-a6f3-b81004280842-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "982919b7-f81f-4831-a6f3-b81004280842" (UID: "982919b7-f81f-4831-a6f3-b81004280842"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:10:42.520543 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.520517    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "982919b7-f81f-4831-a6f3-b81004280842" (UID: "982919b7-f81f-4831-a6f3-b81004280842"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:10:42.520623 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.520553    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/982919b7-f81f-4831-a6f3-b81004280842-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "982919b7-f81f-4831-a6f3-b81004280842" (UID: "982919b7-f81f-4831-a6f3-b81004280842"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 15:10:42.520826 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.520810    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/982919b7-f81f-4831-a6f3-b81004280842-kube-api-access-z54p5" (OuterVolumeSpecName: "kube-api-access-z54p5") pod "982919b7-f81f-4831-a6f3-b81004280842" (UID: "982919b7-f81f-4831-a6f3-b81004280842"). InnerVolumeSpecName "kube-api-access-z54p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:10:42.520871 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.520837    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/982919b7-f81f-4831-a6f3-b81004280842-istio-token" (OuterVolumeSpecName: "istio-token") pod "982919b7-f81f-4831-a6f3-b81004280842" (UID: "982919b7-f81f-4831-a6f3-b81004280842"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:10:42.619808 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.619780    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z54p5\" (UniqueName: \"kubernetes.io/projected/982919b7-f81f-4831-a6f3-b81004280842-kube-api-access-z54p5\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:42.619808 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.619805    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/982919b7-f81f-4831-a6f3-b81004280842-istio-podinfo\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:42.619946 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.619818    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-istio-envoy\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:42.619946 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.619830    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/982919b7-f81f-4831-a6f3-b81004280842-istio-token\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:42.619946 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.619841    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/982919b7-f81f-4831-a6f3-b81004280842-credential-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:42.619946 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:42.619852    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/982919b7-f81f-4831-a6f3-b81004280842-istiod-ca-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:43.045118 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:43.045089    2569 generic.go:356] "Generic (PLEG): container finished" podID="982919b7-f81f-4831-a6f3-b81004280842" containerID="e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617" exitCode=0
Sep 16 15:10:43.045229 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:43.045129    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"
Sep 16 15:10:43.045229 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:43.045126    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" event={"ID":"982919b7-f81f-4831-a6f3-b81004280842","Type":"ContainerDied","Data":"e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617"}
Sep 16 15:10:43.045317 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:43.045259    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx" event={"ID":"982919b7-f81f-4831-a6f3-b81004280842","Type":"ContainerDied","Data":"98a3254255aa90839a476ba22daf17400b525157d8725de2629b772ca45c2dc0"}
Sep 16 15:10:43.045317 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:43.045296    2569 scope.go:117] "RemoveContainer" containerID="e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617"
Sep 16 15:10:43.057312 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:43.057297    2569 scope.go:117] "RemoveContainer" containerID="13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0"
Sep 16 15:10:43.066205 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:43.066185    2569 scope.go:117] "RemoveContainer" containerID="e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617"
Sep 16 15:10:43.066463 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:10:43.066444    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617\": container with ID starting with e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617 not found: ID does not exist" containerID="e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617"
Sep 16 15:10:43.066577 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:43.066471    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617"} err="failed to get container status \"e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617\": rpc error: code = NotFound desc = could not find container \"e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617\": container with ID starting with e1454512677a3b773b846072d9379406bdcc94e76217ba7d8c16e0aacb9b0617 not found: ID does not exist"
Sep 16 15:10:43.066627 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:43.066580    2569 scope.go:117] "RemoveContainer" containerID="13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0"
Sep 16 15:10:43.066827 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:10:43.066810    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0\": container with ID starting with 13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0 not found: ID does not exist" containerID="13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0"
Sep 16 15:10:43.066880 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:43.066831    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0"} err="failed to get container status \"13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0\": rpc error: code = NotFound desc = could not find container \"13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0\": container with ID starting with 13768e101561eb55e93518eb792299d3b444d4049293f8ca135ffd29338f7db0 not found: ID does not exist"
Sep 16 15:10:43.076056 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:43.076035    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"]
Sep 16 15:10:43.080131 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:43.080110    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx"]
Sep 16 15:10:43.082340 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:10:43.082322    2569 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982919b7_f81f_4831_a6f3_b81004280842.slice\": RecentStats: unable to find data in memory cache]"
Sep 16 15:10:44.087050 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:44.087020    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="982919b7-f81f-4831-a6f3-b81004280842" path="/var/lib/kubelet/pods/982919b7-f81f-4831-a6f3-b81004280842/volumes"
Sep 16 15:10:48.020720 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.020686    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"]
Sep 16 15:10:48.021072 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.020891    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t" podUID="42f2a440-babf-4ec5-8ca6-1859f5895554" containerName="maas-api" containerID="cri-o://d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca" gracePeriod=30
Sep 16 15:10:48.269937 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.269909    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 15:10:48.367515 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.367415    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trlv4\" (UniqueName: \"kubernetes.io/projected/42f2a440-babf-4ec5-8ca6-1859f5895554-kube-api-access-trlv4\") pod \"42f2a440-babf-4ec5-8ca6-1859f5895554\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") "
Sep 16 15:10:48.367515 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.367451    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42f2a440-babf-4ec5-8ca6-1859f5895554-maas-api-tls\") pod \"42f2a440-babf-4ec5-8ca6-1859f5895554\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") "
Sep 16 15:10:48.367515 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.367480    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f2a440-babf-4ec5-8ca6-1859f5895554-metrics-certs\") pod \"42f2a440-babf-4ec5-8ca6-1859f5895554\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") "
Sep 16 15:10:48.367778 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.367536    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42f2a440-babf-4ec5-8ca6-1859f5895554-openshift-service-ca\") pod \"42f2a440-babf-4ec5-8ca6-1859f5895554\" (UID: \"42f2a440-babf-4ec5-8ca6-1859f5895554\") "
Sep 16 15:10:48.368107 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.367974    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42f2a440-babf-4ec5-8ca6-1859f5895554-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "42f2a440-babf-4ec5-8ca6-1859f5895554" (UID: "42f2a440-babf-4ec5-8ca6-1859f5895554"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:10:48.369991 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.369965    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42f2a440-babf-4ec5-8ca6-1859f5895554-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "42f2a440-babf-4ec5-8ca6-1859f5895554" (UID: "42f2a440-babf-4ec5-8ca6-1859f5895554"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:10:48.369991 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.369977    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42f2a440-babf-4ec5-8ca6-1859f5895554-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "42f2a440-babf-4ec5-8ca6-1859f5895554" (UID: "42f2a440-babf-4ec5-8ca6-1859f5895554"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:10:48.370160 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.370058    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42f2a440-babf-4ec5-8ca6-1859f5895554-kube-api-access-trlv4" (OuterVolumeSpecName: "kube-api-access-trlv4") pod "42f2a440-babf-4ec5-8ca6-1859f5895554" (UID: "42f2a440-babf-4ec5-8ca6-1859f5895554"). InnerVolumeSpecName "kube-api-access-trlv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:10:48.468936 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.468903    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trlv4\" (UniqueName: \"kubernetes.io/projected/42f2a440-babf-4ec5-8ca6-1859f5895554-kube-api-access-trlv4\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:48.468936 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.468931    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42f2a440-babf-4ec5-8ca6-1859f5895554-maas-api-tls\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:48.468936 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.468940    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42f2a440-babf-4ec5-8ca6-1859f5895554-metrics-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:48.469157 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:48.468948    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42f2a440-babf-4ec5-8ca6-1859f5895554-openshift-service-ca\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:10:49.079823 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:49.079792    2569 generic.go:356] "Generic (PLEG): container finished" podID="42f2a440-babf-4ec5-8ca6-1859f5895554" containerID="d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca" exitCode=0
Sep 16 15:10:49.080210 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:49.079834    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"
Sep 16 15:10:49.080210 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:49.079869    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t" event={"ID":"42f2a440-babf-4ec5-8ca6-1859f5895554","Type":"ContainerDied","Data":"d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca"}
Sep 16 15:10:49.080210 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:49.079925    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t" event={"ID":"42f2a440-babf-4ec5-8ca6-1859f5895554","Type":"ContainerDied","Data":"58ff7b01d5ddf62b3d833d7624809fb9e5a3fa44577129f5c7bb7c6dbb081682"}
Sep 16 15:10:49.080210 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:49.079947    2569 scope.go:117] "RemoveContainer" containerID="d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca"
Sep 16 15:10:49.089854 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:49.089838    2569 scope.go:117] "RemoveContainer" containerID="d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca"
Sep 16 15:10:49.090106 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:10:49.090089    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca\": container with ID starting with d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca not found: ID does not exist" containerID="d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca"
Sep 16 15:10:49.090142 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:49.090117    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca"} err="failed to get container status \"d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca\": rpc error: code = NotFound desc = could not find container \"d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca\": container with ID starting with d477bb58790e1551951cd8b98c2cb9138fda9b3e03973612a1486699cbef1cca not found: ID does not exist"
Sep 16 15:10:49.102404 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:49.102381    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"]
Sep 16 15:10:49.106362 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:49.106342    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d28bd5-d976d844-pj76t"]
Sep 16 15:10:50.087365 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:50.087324    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42f2a440-babf-4ec5-8ca6-1859f5895554" path="/var/lib/kubelet/pods/42f2a440-babf-4ec5-8ca6-1859f5895554/volumes"
Sep 16 15:10:55.353121 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:55.353089    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"]
Sep 16 15:10:55.353589 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:55.353359    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy" containerID="cri-o://cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066" gracePeriod=30
Sep 16 15:10:56.740055 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:56.740018    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 15:10:56.740446 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:10:56.740079    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 15:11:00.611414 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.611390    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 15:11:00.665687 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.665631    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-workload-socket\") pod \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") "
Sep 16 15:11:00.665687 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.665669    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-token\") pod \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") "
Sep 16 15:11:00.665846 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.665689    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-credential-socket\") pod \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") "
Sep 16 15:11:00.665846 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.665719    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istiod-ca-cert\") pod \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") "
Sep 16 15:11:00.665846 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.665760    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf4t7\" (UniqueName: \"kubernetes.io/projected/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-kube-api-access-gf4t7\") pod \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") "
Sep 16 15:11:00.665846 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.665785    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-data\") pod \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") "
Sep 16 15:11:00.665846 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.665819    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-workload-certs\") pod \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") "
Sep 16 15:11:00.666107 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.665856    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-podinfo\") pod \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") "
Sep 16 15:11:00.666107 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.665880    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" (UID: "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:11:00.666107 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.665895    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-envoy\") pod \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\" (UID: \"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4\") "
Sep 16 15:11:00.666107 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.665961    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" (UID: "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:11:00.666318 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.666113    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" (UID: "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:11:00.666318 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.666132    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" (UID: "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:11:00.666318 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.666191    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" (UID: "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:11:00.666472 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.666327    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-workload-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:00.666472 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.666344    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-workload-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:00.666472 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.666353    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-credential-socket\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:00.666472 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.666362    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istiod-ca-cert\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:00.666472 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.666370    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-data\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:00.667832 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.667812    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" (UID: "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:11:00.667960 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.667943    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-kube-api-access-gf4t7" (OuterVolumeSpecName: "kube-api-access-gf4t7") pod "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" (UID: "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4"). InnerVolumeSpecName "kube-api-access-gf4t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:11:00.668294 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.668262    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" (UID: "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 15:11:00.668294 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.668268    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" (UID: "e2c6b494-3987-40cd-a1e5-61aa33a9e1d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:11:00.767482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.767461    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-envoy\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:00.767482 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.767480    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-token\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:00.767620 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.767508    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf4t7\" (UniqueName: \"kubernetes.io/projected/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-kube-api-access-gf4t7\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:00.767620 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:00.767522    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4-istio-podinfo\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:01.143643 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:01.143613    2569 generic.go:356] "Generic (PLEG): container finished" podID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerID="cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066" exitCode=0
Sep 16 15:11:01.143769 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:01.143653    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"
Sep 16 15:11:01.143769 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:01.143699    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" event={"ID":"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4","Type":"ContainerDied","Data":"cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066"}
Sep 16 15:11:01.143769 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:01.143751    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv" event={"ID":"e2c6b494-3987-40cd-a1e5-61aa33a9e1d4","Type":"ContainerDied","Data":"72cfbd8b23220362fb1f45b7f0fb89f18f0e9ff74b28e5150fb60cb4620ffc85"}
Sep 16 15:11:01.143875 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:01.143777    2569 scope.go:117] "RemoveContainer" containerID="cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066"
Sep 16 15:11:01.152957 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:01.152942    2569 scope.go:117] "RemoveContainer" containerID="482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e"
Sep 16 15:11:01.160726 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:01.160710    2569 scope.go:117] "RemoveContainer" containerID="cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066"
Sep 16 15:11:01.160979 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:11:01.160960    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066\": container with ID starting with cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066 not found: ID does not exist" containerID="cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066"
Sep 16 15:11:01.161048 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:01.160986    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066"} err="failed to get container status \"cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066\": rpc error: code = NotFound desc = could not find container \"cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066\": container with ID starting with cf554499159d84862f7995eb52be8d39139291e3b28320397cd99adb8c400066 not found: ID does not exist"
Sep 16 15:11:01.161048 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:01.161003    2569 scope.go:117] "RemoveContainer" containerID="482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e"
Sep 16 15:11:01.161264 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:11:01.161243    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e\": container with ID starting with 482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e not found: ID does not exist" containerID="482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e"
Sep 16 15:11:01.161354 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:01.161268    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e"} err="failed to get container status \"482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e\": rpc error: code = NotFound desc = could not find container \"482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e\": container with ID starting with 482af556d695b555bf4cf6c45fd8e069a4fb9372b3bf48ead7ecace8490f1d4e not found: ID does not exist"
Sep 16 15:11:01.165395 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:01.165374    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"]
Sep 16 15:11:01.172261 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:01.172241    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv"]
Sep 16 15:11:02.087636 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:02.087602    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" path="/var/lib/kubelet/pods/e2c6b494-3987-40cd-a1e5-61aa33a9e1d4/volumes"
Sep 16 15:11:06.237417 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.237384    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"]
Sep 16 15:11:06.237889 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.237644    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6" podUID="b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a" containerName="maas-api" containerID="cri-o://b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d" gracePeriod=30
Sep 16 15:11:06.275434 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.275188    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq"]
Sep 16 15:11:06.277624 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.277597    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-cadcf4-29826180-bbzpq"]
Sep 16 15:11:06.479891 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.479863    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 15:11:06.613802 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.613771    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-openshift-service-ca\") pod \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") "
Sep 16 15:11:06.614004 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.613864    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-maas-api-tls\") pod \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") "
Sep 16 15:11:06.614004 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.613961    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-metrics-certs\") pod \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") "
Sep 16 15:11:06.614127 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.614042    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsh69\" (UniqueName: \"kubernetes.io/projected/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-kube-api-access-bsh69\") pod \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\" (UID: \"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a\") "
Sep 16 15:11:06.614271 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.614236    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a" (UID: "b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:11:06.614484 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.614449    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-openshift-service-ca\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:06.616124 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.616101    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a" (UID: "b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:11:06.616227 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.616196    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a" (UID: "b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:11:06.616628 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.616603    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-kube-api-access-bsh69" (OuterVolumeSpecName: "kube-api-access-bsh69") pod "b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a" (UID: "b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a"). InnerVolumeSpecName "kube-api-access-bsh69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:11:06.714924 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.714894    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsh69\" (UniqueName: \"kubernetes.io/projected/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-kube-api-access-bsh69\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:06.714924 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.714923    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-maas-api-tls\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:06.715168 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:06.714935    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a-metrics-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:11:07.178415 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:07.178378    2569 generic.go:356] "Generic (PLEG): container finished" podID="b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a" containerID="b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d" exitCode=0
Sep 16 15:11:07.178607 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:07.178412    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6" event={"ID":"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a","Type":"ContainerDied","Data":"b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d"}
Sep 16 15:11:07.178607 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:07.178434    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"
Sep 16 15:11:07.178607 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:07.178476    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6" event={"ID":"b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a","Type":"ContainerDied","Data":"ebcfc1c8ca92896967c612ae19e89eb27122fc8e7fac568ba1dcf516e2b16930"}
Sep 16 15:11:07.178607 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:07.178532    2569 scope.go:117] "RemoveContainer" containerID="b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d"
Sep 16 15:11:07.187975 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:07.187955    2569 scope.go:117] "RemoveContainer" containerID="b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d"
Sep 16 15:11:07.188254 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:11:07.188236    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d\": container with ID starting with b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d not found: ID does not exist" containerID="b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d"
Sep 16 15:11:07.188303 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:07.188262    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d"} err="failed to get container status \"b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d\": rpc error: code = NotFound desc = could not find container \"b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d\": container with ID starting with b67c45e4982d15ea1d0258885b9da2137ec729b4b1dd0d9af3002bc2e387ac1d not found: ID does not exist"
Sep 16 15:11:07.202745 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:07.202717    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"]
Sep 16 15:11:07.209044 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:07.209024    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cadcf4-6cb7c8467f-cnbp6"]
Sep 16 15:11:08.089042 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:08.089008    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a" path="/var/lib/kubelet/pods/b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a/volumes"
Sep 16 15:11:08.089403 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:08.089296    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd4d4ed7-26cc-4006-9886-b18365fc25c1" path="/var/lib/kubelet/pods/fd4d4ed7-26cc-4006-9886-b18365fc25c1/volumes"
Sep 16 15:11:26.389849 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:11:26.389768    2569 scope.go:117] "RemoveContainer" containerID="ea9f20a147c663338bcb3ca19abc37e9e97187c3b31235a82cd855fe758f20fd"
Sep 16 15:13:26.435130 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:13:26.435098    2569 scope.go:117] "RemoveContainer" containerID="d786811223a60fdb51aaaec8af1b3c78115e0a0ce7c94d9419c0df5a58012321"
Sep 16 15:15:26.304572 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:26.304543    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 15:15:26.308715 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:26.308695    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trltk_4f8a7d0b-cdfe-4dee-a7c2-88d0e21070b6/ovn-acl-logging/0.log"
Sep 16 15:15:49.532360 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532286    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"]
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532648    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532660    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532670    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726e9774-af2a-407e-9bf2-9c0d97f98350" containerName="maas-api"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532676    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="726e9774-af2a-407e-9bf2-9c0d97f98350" containerName="maas-api"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532687    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532693    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532701    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532706    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532714    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42f2a440-babf-4ec5-8ca6-1859f5895554" containerName="maas-api"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532720    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f2a440-babf-4ec5-8ca6-1859f5895554" containerName="maas-api"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532728    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532734    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532744    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a" containerName="maas-api"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532750    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a" containerName="maas-api"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532758    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df7f7f6e-bfc8-49b1-b36c-3f4f789724a9" containerName="main"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532762    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="df7f7f6e-bfc8-49b1-b36c-3f4f789724a9" containerName="main"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532812    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532819    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="726e9774-af2a-407e-9bf2-9c0d97f98350" containerName="maas-api"
Sep 16 15:15:49.532819 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532824    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="42f2a440-babf-4ec5-8ca6-1859f5895554" containerName="maas-api"
Sep 16 15:15:49.533542 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532831    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy"
Sep 16 15:15:49.533542 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532835    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="df7f7f6e-bfc8-49b1-b36c-3f4f789724a9" containerName="main"
Sep 16 15:15:49.533542 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532840    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b208d4f3-7b40-48d0-8d1f-fc3a74a7e06a" containerName="maas-api"
Sep 16 15:15:49.533542 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.532847    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="982919b7-f81f-4831-a6f3-b81004280842" containerName="istio-proxy"
Sep 16 15:15:49.536062 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.536046    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.538716 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.538696    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-c60debce-kserve-self-signed-certs\""
Sep 16 15:15:49.550830 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.550806    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"]
Sep 16 15:15:49.702063 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.702026    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk2hb\" (UniqueName: \"kubernetes.io/projected/0ae75180-95ab-4d25-8759-ebdfbebdb99e-kube-api-access-kk2hb\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.702236 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.702084    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae75180-95ab-4d25-8759-ebdfbebdb99e-tls-certs\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.702236 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.702170    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-dshm\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.702341 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.702234    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-tmp-dir\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.702341 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.702264    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-model-cache\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.702341 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.702303    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-home\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.803741 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.803678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-dshm\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.803741 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.803734    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-tmp-dir\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.803932 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.803767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-model-cache\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.803932 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.803807    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-home\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.803932 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.803851    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk2hb\" (UniqueName: \"kubernetes.io/projected/0ae75180-95ab-4d25-8759-ebdfbebdb99e-kube-api-access-kk2hb\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.803932 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.803886    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae75180-95ab-4d25-8759-ebdfbebdb99e-tls-certs\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.804187 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.804166    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-model-cache\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.804257 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.804209    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-tmp-dir\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.804302 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.804267    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-home\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.806005 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.805981    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-dshm\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.806235 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.806219    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae75180-95ab-4d25-8759-ebdfbebdb99e-tls-certs\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.812506 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.812472    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk2hb\" (UniqueName: \"kubernetes.io/projected/0ae75180-95ab-4d25-8759-ebdfbebdb99e-kube-api-access-kk2hb\") pod \"e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") " pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:49.844508 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:49.844468    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:50.124885 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:50.124861    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"]
Sep 16 15:15:50.126189 ip-10-0-132-120 kubenswrapper[2569]: W0916 15:15:50.126162    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ae75180_95ab_4d25_8759_ebdfbebdb99e.slice/crio-3668a69b66678a669ebc57e92fb12e152cd72559ba05972f428b5bdccb1546fa WatchSource:0}: Error finding container 3668a69b66678a669ebc57e92fb12e152cd72559ba05972f428b5bdccb1546fa: Status 404 returned error can't find the container with id 3668a69b66678a669ebc57e92fb12e152cd72559ba05972f428b5bdccb1546fa
Sep 16 15:15:50.635508 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:50.635465    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c" event={"ID":"0ae75180-95ab-4d25-8759-ebdfbebdb99e","Type":"ContainerStarted","Data":"be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091"}
Sep 16 15:15:50.635886 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:50.635520    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c" event={"ID":"0ae75180-95ab-4d25-8759-ebdfbebdb99e","Type":"ContainerStarted","Data":"3668a69b66678a669ebc57e92fb12e152cd72559ba05972f428b5bdccb1546fa"}
Sep 16 15:15:50.659914 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:50.659870    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c" podStartSLOduration=1.659857184 podStartE2EDuration="1.659857184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:15:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:15:50.659614901 +0000 UTC m=+2425.010896610" watchObservedRunningTime="2026-09-16 15:15:50.659857184 +0000 UTC m=+2425.011138924"
Sep 16 15:15:59.845234 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:59.845195    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:59.845234 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:59.845244    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:15:59.857668 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:15:59.857643    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:16:00.697246 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:00.697215    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:16:27.332597 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:27.332554    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"]
Sep 16 15:16:42.354876 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.354818    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c" podUID="0ae75180-95ab-4d25-8759-ebdfbebdb99e" containerName="main" containerID="cri-o://be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091" gracePeriod=45
Sep 16 15:16:42.596906 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.596883    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:16:42.687740 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.687655    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-tmp-dir\") pod \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") "
Sep 16 15:16:42.687740 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.687709    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-dshm\") pod \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") "
Sep 16 15:16:42.687942 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.687767    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk2hb\" (UniqueName: \"kubernetes.io/projected/0ae75180-95ab-4d25-8759-ebdfbebdb99e-kube-api-access-kk2hb\") pod \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") "
Sep 16 15:16:42.687942 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.687816    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae75180-95ab-4d25-8759-ebdfbebdb99e-tls-certs\") pod \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") "
Sep 16 15:16:42.687942 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.687850    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-home\") pod \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") "
Sep 16 15:16:42.687942 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.687866    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-model-cache\") pod \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\" (UID: \"0ae75180-95ab-4d25-8759-ebdfbebdb99e\") "
Sep 16 15:16:42.687942 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.687915    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0ae75180-95ab-4d25-8759-ebdfbebdb99e" (UID: "0ae75180-95ab-4d25-8759-ebdfbebdb99e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:16:42.688212 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.688147    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-tmp-dir\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:16:42.688212 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.688170    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-home" (OuterVolumeSpecName: "home") pod "0ae75180-95ab-4d25-8759-ebdfbebdb99e" (UID: "0ae75180-95ab-4d25-8759-ebdfbebdb99e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:16:42.688212 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.688160    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-model-cache" (OuterVolumeSpecName: "model-cache") pod "0ae75180-95ab-4d25-8759-ebdfbebdb99e" (UID: "0ae75180-95ab-4d25-8759-ebdfbebdb99e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:16:42.689973 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.689947    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ae75180-95ab-4d25-8759-ebdfbebdb99e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0ae75180-95ab-4d25-8759-ebdfbebdb99e" (UID: "0ae75180-95ab-4d25-8759-ebdfbebdb99e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:16:42.690103 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.689951    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-dshm" (OuterVolumeSpecName: "dshm") pod "0ae75180-95ab-4d25-8759-ebdfbebdb99e" (UID: "0ae75180-95ab-4d25-8759-ebdfbebdb99e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:16:42.690103 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.690001    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ae75180-95ab-4d25-8759-ebdfbebdb99e-kube-api-access-kk2hb" (OuterVolumeSpecName: "kube-api-access-kk2hb") pod "0ae75180-95ab-4d25-8759-ebdfbebdb99e" (UID: "0ae75180-95ab-4d25-8759-ebdfbebdb99e"). InnerVolumeSpecName "kube-api-access-kk2hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:16:42.788632 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.788603    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk2hb\" (UniqueName: \"kubernetes.io/projected/0ae75180-95ab-4d25-8759-ebdfbebdb99e-kube-api-access-kk2hb\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:16:42.788632 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.788631    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae75180-95ab-4d25-8759-ebdfbebdb99e-tls-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:16:42.788632 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.788642    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-home\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:16:42.788840 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.788650    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-model-cache\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:16:42.788840 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.788657    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae75180-95ab-4d25-8759-ebdfbebdb99e-dshm\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:16:42.912671 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.912637    2569 generic.go:356] "Generic (PLEG): container finished" podID="0ae75180-95ab-4d25-8759-ebdfbebdb99e" containerID="be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091" exitCode=0
Sep 16 15:16:42.912833 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.912681    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"
Sep 16 15:16:42.912833 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.912720    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c" event={"ID":"0ae75180-95ab-4d25-8759-ebdfbebdb99e","Type":"ContainerDied","Data":"be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091"}
Sep 16 15:16:42.912833 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.912766    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c" event={"ID":"0ae75180-95ab-4d25-8759-ebdfbebdb99e","Type":"ContainerDied","Data":"3668a69b66678a669ebc57e92fb12e152cd72559ba05972f428b5bdccb1546fa"}
Sep 16 15:16:42.912833 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.912788    2569 scope.go:117] "RemoveContainer" containerID="be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091"
Sep 16 15:16:42.922425 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.922409    2569 scope.go:117] "RemoveContainer" containerID="be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091"
Sep 16 15:16:42.922707 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:16:42.922690    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091\": container with ID starting with be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091 not found: ID does not exist" containerID="be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091"
Sep 16 15:16:42.922781 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.922714    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091"} err="failed to get container status \"be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091\": rpc error: code = NotFound desc = could not find container \"be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091\": container with ID starting with be21656da8a9f5d51330585f3baa037f3e69a559a0dc467c92057a0bc9554091 not found: ID does not exist"
Sep 16 15:16:42.945110 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.945042    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"]
Sep 16 15:16:42.962543 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:42.962513    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-c60debce-kserve-688954b4ff-b9g6c"]
Sep 16 15:16:44.087204 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:44.087165    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ae75180-95ab-4d25-8759-ebdfbebdb99e" path="/var/lib/kubelet/pods/0ae75180-95ab-4d25-8759-ebdfbebdb99e/volumes"
Sep 16 15:16:46.324676 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.324645    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"]
Sep 16 15:16:46.325040 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.325008    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae75180-95ab-4d25-8759-ebdfbebdb99e" containerName="main"
Sep 16 15:16:46.325040 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.325021    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae75180-95ab-4d25-8759-ebdfbebdb99e" containerName="main"
Sep 16 15:16:46.325109 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.325073    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae75180-95ab-4d25-8759-ebdfbebdb99e" containerName="main"
Sep 16 15:16:46.325109 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.325083    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2c6b494-3987-40cd-a1e5-61aa33a9e1d4" containerName="istio-proxy"
Sep 16 15:16:46.329290 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.329272    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.343158 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.343132    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"]
Sep 16 15:16:46.421409 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.421383    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c868fce-ee7b-427c-b3fe-eab416b096e9-openshift-service-ca\") pod \"maas-api-5449d58978-cg7h8\" (UID: \"5c868fce-ee7b-427c-b3fe-eab416b096e9\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.421599 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.421433    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c868fce-ee7b-427c-b3fe-eab416b096e9-metrics-certs\") pod \"maas-api-5449d58978-cg7h8\" (UID: \"5c868fce-ee7b-427c-b3fe-eab416b096e9\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.421599 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.421457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c868fce-ee7b-427c-b3fe-eab416b096e9-maas-api-tls\") pod \"maas-api-5449d58978-cg7h8\" (UID: \"5c868fce-ee7b-427c-b3fe-eab416b096e9\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.421694 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.421593    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5npgv\" (UniqueName: \"kubernetes.io/projected/5c868fce-ee7b-427c-b3fe-eab416b096e9-kube-api-access-5npgv\") pod \"maas-api-5449d58978-cg7h8\" (UID: \"5c868fce-ee7b-427c-b3fe-eab416b096e9\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.522234 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.522198    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5npgv\" (UniqueName: \"kubernetes.io/projected/5c868fce-ee7b-427c-b3fe-eab416b096e9-kube-api-access-5npgv\") pod \"maas-api-5449d58978-cg7h8\" (UID: \"5c868fce-ee7b-427c-b3fe-eab416b096e9\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.522381 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.522252    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c868fce-ee7b-427c-b3fe-eab416b096e9-openshift-service-ca\") pod \"maas-api-5449d58978-cg7h8\" (UID: \"5c868fce-ee7b-427c-b3fe-eab416b096e9\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.522381 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.522285    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c868fce-ee7b-427c-b3fe-eab416b096e9-metrics-certs\") pod \"maas-api-5449d58978-cg7h8\" (UID: \"5c868fce-ee7b-427c-b3fe-eab416b096e9\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.522381 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.522305    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c868fce-ee7b-427c-b3fe-eab416b096e9-maas-api-tls\") pod \"maas-api-5449d58978-cg7h8\" (UID: \"5c868fce-ee7b-427c-b3fe-eab416b096e9\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.522942 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.522916    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c868fce-ee7b-427c-b3fe-eab416b096e9-openshift-service-ca\") pod \"maas-api-5449d58978-cg7h8\" (UID: \"5c868fce-ee7b-427c-b3fe-eab416b096e9\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.524703 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.524683    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c868fce-ee7b-427c-b3fe-eab416b096e9-metrics-certs\") pod \"maas-api-5449d58978-cg7h8\" (UID: \"5c868fce-ee7b-427c-b3fe-eab416b096e9\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.524777 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.524721    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c868fce-ee7b-427c-b3fe-eab416b096e9-maas-api-tls\") pod \"maas-api-5449d58978-cg7h8\" (UID: \"5c868fce-ee7b-427c-b3fe-eab416b096e9\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.530016 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.529989    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5npgv\" (UniqueName: \"kubernetes.io/projected/5c868fce-ee7b-427c-b3fe-eab416b096e9-kube-api-access-5npgv\") pod \"maas-api-5449d58978-cg7h8\" (UID: \"5c868fce-ee7b-427c-b3fe-eab416b096e9\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.640152 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.640043    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:46.930430 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.930393    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"]
Sep 16 15:16:46.932641 ip-10-0-132-120 kubenswrapper[2569]: W0916 15:16:46.932606    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c868fce_ee7b_427c_b3fe_eab416b096e9.slice/crio-becaddf6e5e520090eddb8c1d9c1078417cdbb9857a5b7e72a9c465e9d711358 WatchSource:0}: Error finding container becaddf6e5e520090eddb8c1d9c1078417cdbb9857a5b7e72a9c465e9d711358: Status 404 returned error can't find the container with id becaddf6e5e520090eddb8c1d9c1078417cdbb9857a5b7e72a9c465e9d711358
Sep 16 15:16:46.934174 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:46.934151    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 15:16:47.944792 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:47.944755    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8" event={"ID":"5c868fce-ee7b-427c-b3fe-eab416b096e9","Type":"ContainerStarted","Data":"41e4d1fd6beb7ecfe0a09af42f045ce653603bcef40f476d064cb0b11e85d520"}
Sep 16 15:16:47.945174 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:47.944807    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8" event={"ID":"5c868fce-ee7b-427c-b3fe-eab416b096e9","Type":"ContainerStarted","Data":"becaddf6e5e520090eddb8c1d9c1078417cdbb9857a5b7e72a9c465e9d711358"}
Sep 16 15:16:47.945174 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:47.944837    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:47.966803 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:47.966757    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8" podStartSLOduration=1.5699548490000002 podStartE2EDuration="1.966742742s" totalImagesPullingTime="396.787893ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:16:47.964890927 +0000 UTC m=+2482.316172636" watchObservedRunningTime="2026-09-16 15:16:47.966742742 +0000 UTC m=+2482.318024451"
Sep 16 15:16:53.954857 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:53.954828    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5449d58978-cg7h8"
Sep 16 15:16:54.003820 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:54.003782    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"]
Sep 16 15:16:54.004057 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:54.004012    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q" podUID="61808775-bacb-4c48-8ca0-31306ce2141c" containerName="maas-api" containerID="cri-o://6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9" gracePeriod=30
Sep 16 15:16:54.106805 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:54.106770    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q" podUID="61808775-bacb-4c48-8ca0-31306ce2141c" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.37:8443/health\": dial tcp 10.134.0.37:8443: connect: connection refused"
Sep 16 15:16:55.244066 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.244045    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 15:16:55.299031 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.298970    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-maas-api-tls\") pod \"61808775-bacb-4c48-8ca0-31306ce2141c\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") "
Sep 16 15:16:55.299031 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.298998    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-metrics-certs\") pod \"61808775-bacb-4c48-8ca0-31306ce2141c\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") "
Sep 16 15:16:55.299031 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.299019    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61808775-bacb-4c48-8ca0-31306ce2141c-openshift-service-ca\") pod \"61808775-bacb-4c48-8ca0-31306ce2141c\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") "
Sep 16 15:16:55.299212 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.299040    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9rgt\" (UniqueName: \"kubernetes.io/projected/61808775-bacb-4c48-8ca0-31306ce2141c-kube-api-access-j9rgt\") pod \"61808775-bacb-4c48-8ca0-31306ce2141c\" (UID: \"61808775-bacb-4c48-8ca0-31306ce2141c\") "
Sep 16 15:16:55.299410 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.299376    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61808775-bacb-4c48-8ca0-31306ce2141c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "61808775-bacb-4c48-8ca0-31306ce2141c" (UID: "61808775-bacb-4c48-8ca0-31306ce2141c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:16:55.301012 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.300990    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "61808775-bacb-4c48-8ca0-31306ce2141c" (UID: "61808775-bacb-4c48-8ca0-31306ce2141c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:16:55.301107 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.301027    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61808775-bacb-4c48-8ca0-31306ce2141c-kube-api-access-j9rgt" (OuterVolumeSpecName: "kube-api-access-j9rgt") pod "61808775-bacb-4c48-8ca0-31306ce2141c" (UID: "61808775-bacb-4c48-8ca0-31306ce2141c"). InnerVolumeSpecName "kube-api-access-j9rgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:16:55.301107 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.301091    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "61808775-bacb-4c48-8ca0-31306ce2141c" (UID: "61808775-bacb-4c48-8ca0-31306ce2141c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:16:55.400244 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.400214    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-maas-api-tls\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:16:55.400244 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.400239    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61808775-bacb-4c48-8ca0-31306ce2141c-metrics-certs\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:16:55.400384 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.400253    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61808775-bacb-4c48-8ca0-31306ce2141c-openshift-service-ca\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:16:55.400384 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.400266    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9rgt\" (UniqueName: \"kubernetes.io/projected/61808775-bacb-4c48-8ca0-31306ce2141c-kube-api-access-j9rgt\") on node \"ip-10-0-132-120.ec2.internal\" DevicePath \"\""
Sep 16 15:16:55.989937 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.989901    2569 generic.go:356] "Generic (PLEG): container finished" podID="61808775-bacb-4c48-8ca0-31306ce2141c" containerID="6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9" exitCode=0
Sep 16 15:16:55.990112 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.989948    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"
Sep 16 15:16:55.990112 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.989947    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q" event={"ID":"61808775-bacb-4c48-8ca0-31306ce2141c","Type":"ContainerDied","Data":"6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9"}
Sep 16 15:16:55.990112 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.990087    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q" event={"ID":"61808775-bacb-4c48-8ca0-31306ce2141c","Type":"ContainerDied","Data":"599e058555256424fa5cd5fd9fda61cfa3ed85bf0a2f828446db7e1132a1cd29"}
Sep 16 15:16:55.990288 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:55.990125    2569 scope.go:117] "RemoveContainer" containerID="6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9"
Sep 16 15:16:56.002703 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:56.002683    2569 scope.go:117] "RemoveContainer" containerID="6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9"
Sep 16 15:16:56.002988 ip-10-0-132-120 kubenswrapper[2569]: E0916 15:16:56.002965    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9\": container with ID starting with 6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9 not found: ID does not exist" containerID="6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9"
Sep 16 15:16:56.003060 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:56.003001    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9"} err="failed to get container status \"6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9\": rpc error: code = NotFound desc = could not find container \"6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9\": container with ID starting with 6ea4a5eeefc366012775e9b666b01a99561f44de446fae796532f40bfa5c05c9 not found: ID does not exist"
Sep 16 15:16:56.015555 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:56.015530    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"]
Sep 16 15:16:56.020534 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:56.020512    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5665c7f4f4-9df6q"]
Sep 16 15:16:56.087781 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:16:56.087758    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61808775-bacb-4c48-8ca0-31306ce2141c" path="/var/lib/kubelet/pods/61808775-bacb-4c48-8ca0-31306ce2141c/volumes"
Sep 16 15:17:22.803987 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:22.803908    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tp47q_0b84ec0b-762a-4351-954c-d7875337701d/server/0.log"
Sep 16 15:17:22.917190 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:22.917163    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2n9lt_cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0/manager/0.log"
Sep 16 15:17:23.146095 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:23.146012    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846667779d-7crp2_571b5765-d419-4fd2-a609-8017f2bca42d/copy-manifests/0.log"
Sep 16 15:17:23.153679 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:23.153651    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846667779d-7crp2_571b5765-d419-4fd2-a609-8017f2bca42d/manager/0.log"
Sep 16 15:17:23.615529 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:23.615484    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5449d58978-cg7h8_5c868fce-ee7b-427c-b3fe-eab416b096e9/maas-api/0.log"
Sep 16 15:17:25.897172 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:25.897143    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759_d942c5a5-1a0e-402a-9c6b-84cdb9584082/istio-proxy/0.log"
Sep 16 15:17:26.017700 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:26.017672    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-v962d_b01f60cc-9a21-408a-a667-f3e06f65fd70/discovery/0.log"
Sep 16 15:17:26.347946 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:26.347918    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s4dvn_c23e957f-3cd1-488e-8180-cc79722a6969/istio-proxy/1.log"
Sep 16 15:17:27.257990 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:27.257962    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-6d9t5_a82bf5b8-1853-42c2-9f61-bad01c1ab88f/main/0.log"
Sep 16 15:17:27.477439 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:27.477410    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6ccj9_1668dd31-37ca-451a-b45f-74322aa0fa17/main/0.log"
Sep 16 15:17:36.261078 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:36.261046    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5vnp2_4082bab8-63bc-4409-82a6-7252cfa0c27e/global-pull-secret-syncer/0.log"
Sep 16 15:17:36.452714 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:36.452682    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h2ffq_6afe989a-88b5-4b2d-afae-72c949abfbc2/konnectivity-agent/0.log"
Sep 16 15:17:36.531383 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:36.531304    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-120.ec2.internal_6259ee5272bc846d91ed86974cef52f5/haproxy/0.log"
Sep 16 15:17:43.087095 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:43.087063    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8jks4_1fbd2fee-ab0a-411c-bfc5-90e0e5095b98/kube-state-metrics/0.log"
Sep 16 15:17:43.118883 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:43.118858    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8jks4_1fbd2fee-ab0a-411c-bfc5-90e0e5095b98/kube-rbac-proxy-main/0.log"
Sep 16 15:17:43.145860 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:43.145843    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8jks4_1fbd2fee-ab0a-411c-bfc5-90e0e5095b98/kube-rbac-proxy-self/0.log"
Sep 16 15:17:43.209284 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:43.209263    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-g9l22_be4f5aaf-3db9-4aa1-8816-5582584733e6/monitoring-plugin/0.log"
Sep 16 15:17:43.359663 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:43.359578    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5zn4w_76a76f0e-65e1-40e0-a891-dcb2b4c3ca17/node-exporter/0.log"
Sep 16 15:17:43.408890 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:43.408868    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5zn4w_76a76f0e-65e1-40e0-a891-dcb2b4c3ca17/kube-rbac-proxy/0.log"
Sep 16 15:17:43.437699 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:43.437677    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5zn4w_76a76f0e-65e1-40e0-a891-dcb2b4c3ca17/init-textfile/0.log"
Sep 16 15:17:43.570383 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:43.570359    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-wgh9n_d9066b8f-e848-43a7-880a-2b900858484e/kube-rbac-proxy-main/0.log"
Sep 16 15:17:43.598305 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:43.598284    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-wgh9n_d9066b8f-e848-43a7-880a-2b900858484e/kube-rbac-proxy-self/0.log"
Sep 16 15:17:43.625466 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:43.625409    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-wgh9n_d9066b8f-e848-43a7-880a-2b900858484e/openshift-state-metrics/0.log"
Sep 16 15:17:44.019584 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:44.019559    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dff78d8db-ckh2l_58f7f3cb-5205-4454-81b8-5b03042513b4/telemeter-client/0.log"
Sep 16 15:17:44.045448 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:44.045424    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dff78d8db-ckh2l_58f7f3cb-5205-4454-81b8-5b03042513b4/reload/0.log"
Sep 16 15:17:44.070996 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:44.070972    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dff78d8db-ckh2l_58f7f3cb-5205-4454-81b8-5b03042513b4/kube-rbac-proxy/0.log"
Sep 16 15:17:44.111590 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:44.111571    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bdbb9f644-8z7xf_91312d23-33c1-41e2-8779-56df58e024a3/thanos-query/0.log"
Sep 16 15:17:44.141615 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:44.141596    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bdbb9f644-8z7xf_91312d23-33c1-41e2-8779-56df58e024a3/kube-rbac-proxy-web/0.log"
Sep 16 15:17:44.173420 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:44.173395    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bdbb9f644-8z7xf_91312d23-33c1-41e2-8779-56df58e024a3/kube-rbac-proxy/0.log"
Sep 16 15:17:44.212993 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:44.212971    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bdbb9f644-8z7xf_91312d23-33c1-41e2-8779-56df58e024a3/prom-label-proxy/0.log"
Sep 16 15:17:44.235975 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:44.235958    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bdbb9f644-8z7xf_91312d23-33c1-41e2-8779-56df58e024a3/kube-rbac-proxy-rules/0.log"
Sep 16 15:17:44.261258 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:44.261240    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bdbb9f644-8z7xf_91312d23-33c1-41e2-8779-56df58e024a3/kube-rbac-proxy-metrics/0.log"
Sep 16 15:17:46.357082 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.357049    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"]
Sep 16 15:17:46.357606 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.357543    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61808775-bacb-4c48-8ca0-31306ce2141c" containerName="maas-api"
Sep 16 15:17:46.357606 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.357560    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="61808775-bacb-4c48-8ca0-31306ce2141c" containerName="maas-api"
Sep 16 15:17:46.357707 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.357642    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="61808775-bacb-4c48-8ca0-31306ce2141c" containerName="maas-api"
Sep 16 15:17:46.360686 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.360669    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.364212 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.364188    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m9cp\"/\"openshift-service-ca.crt\""
Sep 16 15:17:46.364358 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.364219    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7m9cp\"/\"default-dockercfg-kx9vz\""
Sep 16 15:17:46.364602 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.364585    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m9cp\"/\"kube-root-ca.crt\""
Sep 16 15:17:46.379126 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.379100    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"]
Sep 16 15:17:46.442224 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.442189    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8128fd34-9a0f-435e-82c6-c52c41f03399-lib-modules\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.442224 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.442229    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8128fd34-9a0f-435e-82c6-c52c41f03399-sys\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.442455 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.442258    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8128fd34-9a0f-435e-82c6-c52c41f03399-podres\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.442455 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.442345    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8128fd34-9a0f-435e-82c6-c52c41f03399-proc\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.442455 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.442434    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qz8x\" (UniqueName: \"kubernetes.io/projected/8128fd34-9a0f-435e-82c6-c52c41f03399-kube-api-access-4qz8x\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.543320 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.543280    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8128fd34-9a0f-435e-82c6-c52c41f03399-sys\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.543532 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.543349    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8128fd34-9a0f-435e-82c6-c52c41f03399-podres\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.543532 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.543401    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8128fd34-9a0f-435e-82c6-c52c41f03399-sys\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.543532 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.543407    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8128fd34-9a0f-435e-82c6-c52c41f03399-proc\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.543532 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.543462    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8128fd34-9a0f-435e-82c6-c52c41f03399-proc\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.543532 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.543514    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8128fd34-9a0f-435e-82c6-c52c41f03399-podres\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.543803 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.543537    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qz8x\" (UniqueName: \"kubernetes.io/projected/8128fd34-9a0f-435e-82c6-c52c41f03399-kube-api-access-4qz8x\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.543803 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.543567    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8128fd34-9a0f-435e-82c6-c52c41f03399-lib-modules\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.543803 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.543702    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8128fd34-9a0f-435e-82c6-c52c41f03399-lib-modules\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.551415 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.551393    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qz8x\" (UniqueName: \"kubernetes.io/projected/8128fd34-9a0f-435e-82c6-c52c41f03399-kube-api-access-4qz8x\") pod \"perf-node-gather-daemonset-4v8ps\" (UID: \"8128fd34-9a0f-435e-82c6-c52c41f03399\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.670291 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.670209    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:46.745360 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.745337    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-558b9bb586-jqxcg_5c03a80a-0ee4-4818-9ce2-df6aac89f5df/console/0.log"
Sep 16 15:17:46.942800 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:46.942775    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"]
Sep 16 15:17:46.945567 ip-10-0-132-120 kubenswrapper[2569]: W0916 15:17:46.945541    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8128fd34_9a0f_435e_82c6_c52c41f03399.slice/crio-96454af44d2496929c39f6215b908bc1b18aa9bc7928d9832139c1978f3debca WatchSource:0}: Error finding container 96454af44d2496929c39f6215b908bc1b18aa9bc7928d9832139c1978f3debca: Status 404 returned error can't find the container with id 96454af44d2496929c39f6215b908bc1b18aa9bc7928d9832139c1978f3debca
Sep 16 15:17:47.273795 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:47.273763    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps" event={"ID":"8128fd34-9a0f-435e-82c6-c52c41f03399","Type":"ContainerStarted","Data":"3e127e704d70fc1953fc14957ebdc21847410d16ff7ad557d04ef59a669cb507"}
Sep 16 15:17:47.273980 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:47.273812    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps" event={"ID":"8128fd34-9a0f-435e-82c6-c52c41f03399","Type":"ContainerStarted","Data":"96454af44d2496929c39f6215b908bc1b18aa9bc7928d9832139c1978f3debca"}
Sep 16 15:17:47.273980 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:47.273865    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:47.294280 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:47.294235    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps" podStartSLOduration=1.294221732 podStartE2EDuration="1.294221732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:17:47.292243626 +0000 UTC m=+2541.643525334" watchObservedRunningTime="2026-09-16 15:17:47.294221732 +0000 UTC m=+2541.645503440"
Sep 16 15:17:48.520330 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:48.520303    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kqp8w_e3880abc-8efe-4e1f-a02f-ba7ca90ced99/dns/0.log"
Sep 16 15:17:48.556829 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:48.556788    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kqp8w_e3880abc-8efe-4e1f-a02f-ba7ca90ced99/kube-rbac-proxy/0.log"
Sep 16 15:17:48.814638 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:48.814561    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j4ngp_b463d21f-f69e-41ed-b884-321fe2df59df/dns-node-resolver/0.log"
Sep 16 15:17:49.385618 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:49.385585    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6549888cd5-7z96d_3fd81b2c-f0b8-4af9-9302-822a7233b6b6/registry/0.log"
Sep 16 15:17:49.407704 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:49.407669    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q29pw_63e35c5c-3c44-41d6-bf8d-d4d12f854062/node-ca/0.log"
Sep 16 15:17:50.409721 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:50.409687    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759_d942c5a5-1a0e-402a-9c6b-84cdb9584082/istio-proxy/0.log"
Sep 16 15:17:50.836032 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:50.836000    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-v962d_b01f60cc-9a21-408a-a667-f3e06f65fd70/discovery/0.log"
Sep 16 15:17:50.922223 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:50.922192    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s4dvn_c23e957f-3cd1-488e-8180-cc79722a6969/istio-proxy/0.log"
Sep 16 15:17:50.924827 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:50.924790    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s4dvn_c23e957f-3cd1-488e-8180-cc79722a6969/istio-proxy/1.log"
Sep 16 15:17:52.025405 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:52.025374    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x689k_fb17e6bc-80c5-42da-b03d-cbdf1384a028/serve-healthcheck-canary/0.log"
Sep 16 15:17:52.792762 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:52.792729    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m4b88_a50075ec-e341-4ca1-9081-d678815edde3/kube-rbac-proxy/0.log"
Sep 16 15:17:52.817679 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:52.817650    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m4b88_a50075ec-e341-4ca1-9081-d678815edde3/exporter/0.log"
Sep 16 15:17:52.841830 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:52.841799    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m4b88_a50075ec-e341-4ca1-9081-d678815edde3/extractor/0.log"
Sep 16 15:17:53.289383 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:53.289357    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-4v8ps"
Sep 16 15:17:55.698322 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:55.698293    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tp47q_0b84ec0b-762a-4351-954c-d7875337701d/server/0.log"
Sep 16 15:17:55.834640 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:55.834612    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2n9lt_cc8f1ba6-7cb9-4bdd-a495-63faa645b2e0/manager/0.log"
Sep 16 15:17:55.976480 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:55.976448    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846667779d-7crp2_571b5765-d419-4fd2-a609-8017f2bca42d/manager/0.log"
Sep 16 15:17:56.015517 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:56.015425    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846667779d-7crp2_571b5765-d419-4fd2-a609-8017f2bca42d/copy-manifests/0.log"
Sep 16 15:17:56.382716 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:56.382683    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759_d942c5a5-1a0e-402a-9c6b-84cdb9584082/istio-proxy/0.log"
Sep 16 15:17:56.813082 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:56.813048    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-v962d_b01f60cc-9a21-408a-a667-f3e06f65fd70/discovery/0.log"
Sep 16 15:17:56.863151 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:56.863115    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s4dvn_c23e957f-3cd1-488e-8180-cc79722a6969/istio-proxy/0.log"
Sep 16 15:17:56.865782 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:56.865756    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s4dvn_c23e957f-3cd1-488e-8180-cc79722a6969/istio-proxy/1.log"
Sep 16 15:17:57.485008 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:57.484977    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8787d76cb-nl82k_c60742e3-4908-43d6-93b6-a1c7c226215b/manager/0.log"
Sep 16 15:17:58.477925 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:58.477846    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759_d942c5a5-1a0e-402a-9c6b-84cdb9584082/istio-proxy/0.log"
Sep 16 15:17:58.918436 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:58.918403    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-v962d_b01f60cc-9a21-408a-a667-f3e06f65fd70/discovery/0.log"
Sep 16 15:17:58.994328 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:58.994297    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s4dvn_c23e957f-3cd1-488e-8180-cc79722a6969/istio-proxy/0.log"
Sep 16 15:17:58.997097 ip-10-0-132-120 kubenswrapper[2569]: I0916 15:17:58.997076    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s4dvn_c23e957f-3cd1-488e-8180-cc79722a6969/istio-proxy/1.log"