Sep 11 15:08:45.434932 ip-10-0-138-215 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 15:08:45.805772 ip-10-0-138-215 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 15:08:45.805772 ip-10-0-138-215 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 15:08:45.805772 ip-10-0-138-215 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 15:08:45.805772 ip-10-0-138-215 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 15:08:45.805772 ip-10-0-138-215 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 15:08:45.807550 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.807443    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 15:08:45.813240 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813220    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 15:08:45.813240 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813236    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 15:08:45.813240 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813240    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 15:08:45.813240 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813244    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 15:08:45.813240 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813247    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 15:08:45.813240 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813249    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813252    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813255    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813258    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813260    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813263    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813266    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813268    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813271    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813273    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813276    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813278    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813281    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813283    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813287    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813291    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813294    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813297    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813299    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 15:08:45.813456 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813302    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813304    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813307    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813309    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813312    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813314    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813317    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813320    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813322    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813325    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813328    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813330    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813333    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813335    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813338    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813342    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813345    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813347    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813350    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813353    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 15:08:45.813935 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813356    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813359    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813361    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813364    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813367    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813369    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813372    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813374    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813376    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813379    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813382    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813384    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813387    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813391    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813395    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813398    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813401    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813403    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813406    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813409    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 15:08:45.814439 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813411    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813414    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813416    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813418    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813421    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813423    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813427    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813431    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813433    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813436    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813438    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813440    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813443    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813445    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813448    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813450    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813453    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813455    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813458    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813462    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 15:08:45.814964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813464    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813467    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813469    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813475    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813479    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813481    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813484    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813487    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813490    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813492    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813495    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813498    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813500    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813503    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.813506    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814236    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814243    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814247    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814250    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 15:08:45.815482 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814255    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814258    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814261    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814264    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814267    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814269    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814272    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814274    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814277    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814279    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814283    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814287    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814290    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814293    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814296    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814299    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814302    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814304    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814306    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 15:08:45.815964 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814309    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814311    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814314    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814316    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814319    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814321    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814323    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814326    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814328    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814331    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814334    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814336    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814339    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814342    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814345    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814348    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814350    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814353    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814356    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814358    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 15:08:45.816447 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814361    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814364    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814366    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814369    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814371    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814374    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814377    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814380    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814383    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814387    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814390    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814392    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814395    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814398    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814400    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814403    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814405    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814408    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814410    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814413    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 15:08:45.816951 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814416    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814418    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814421    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814423    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814426    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814429    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814431    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814434    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814436    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814439    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814441    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814444    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814446    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814449    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814451    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814454    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814456    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814459    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814461    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814463    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 15:08:45.817431 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814467    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814469    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814471    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814475    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814479    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814481    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814484    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814486    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814489    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814491    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814494    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814497    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814499    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814502    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814504    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814506    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814908    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814913    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814916    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 15:08:45.817931 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814919    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814922    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814924    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814927    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814929    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814932    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814934    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814937    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814939    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814942    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814944    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814947    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814949    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814952    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814955    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814958    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814960    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814962    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814965    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814967    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 15:08:45.818416 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814970    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814973    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814976    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814978    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814981    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814983    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814986    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814988    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814990    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814993    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814996    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.814998    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815001    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815003    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815006    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815008    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815011    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815013    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815015    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815018    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 15:08:45.818926 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815020    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815023    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815025    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815027    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815032    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815035    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815038    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815041    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815043    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815045    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815048    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815050    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815052    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815055    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815057    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815060    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815063    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815065    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815067    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815070    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 15:08:45.819405 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815072    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815075    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815078    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815080    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815083    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815085    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815087    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815090    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815092    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815095    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815097    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815100    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815102    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815104    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815107    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815110    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815116    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815120    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815122    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 15:08:45.819943 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815125    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815128    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815131    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815134    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815136    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815139    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815141    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815144    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815146    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815148    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815152    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815155    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815157    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815160    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815162    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815164    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815167    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815244    2574 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815285    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815292    2574 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815297    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 15:08:45.820429 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815301    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815304    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815308    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815311    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815315    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815317    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815321    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815324    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815328    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815331    2574 flags.go:64] FLAG: --cgroup-root=""
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815333    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815336    2574 flags.go:64] FLAG: --client-ca-file=""
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815340    2574 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815343    2574 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815347    2574 flags.go:64] FLAG: --cluster-domain=""
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815350    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815353    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815356    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815359    2574 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815363    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815366    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815368    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815371    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815375    2574 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 15:08:45.820959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815377    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815380    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815384    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815387    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815390    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815393    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815396    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815399    2574 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815402    2574 flags.go:64] FLAG: --enable-server="true"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815405    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815409    2574 flags.go:64] FLAG: --event-burst="100"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815412    2574 flags.go:64] FLAG: --event-qps="50"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815415    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815418    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815421    2574 flags.go:64] FLAG: --eviction-hard=""
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815424    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815428    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815431    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815434    2574 flags.go:64] FLAG: --eviction-soft=""
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815436    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815439    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815442    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815446    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815449    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815452    2574 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 15:08:45.821559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815455    2574 flags.go:64] FLAG: --feature-gates=""
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815458    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815461    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815464    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815467    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815470    2574 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815473    2574 flags.go:64] FLAG: --help="false"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815475    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-138-215.ec2.internal"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815478    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815481    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815484    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815487    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815490    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815493    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815496    2574 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815498    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815501    2574 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815504    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815507    2574 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815509    2574 flags.go:64] FLAG: --kube-reserved=""
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815512    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815515    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815518    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815521    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 15:08:45.822266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815524    2574 flags.go:64] FLAG: --lock-file=""
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815527    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815529    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815532    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815537    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815548    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815550    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815553    2574 flags.go:64] FLAG: --logging-format="text"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815556    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815559    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815562    2574 flags.go:64] FLAG: --manifest-url=""
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815564    2574 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815573    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815576    2574 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815580    2574 flags.go:64] FLAG: --max-pods="110"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815583    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815585    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815588    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815591    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815594    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815596    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815599    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815606    2574 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815627    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815631    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 15:08:45.822873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815634    2574 flags.go:64] FLAG: --pod-cidr=""
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815636    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815642    2574 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815644    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815647    2574 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815650    2574 flags.go:64] FLAG: --port="10250"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815653    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815656    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c2cccdad6153312d"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815659    2574 flags.go:64] FLAG: --qos-reserved=""
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815662    2574 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815665    2574 flags.go:64] FLAG: --register-node="true"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815668    2574 flags.go:64] FLAG: --register-with-taints=""
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815672    2574 flags.go:64] FLAG: --registry-burst="10"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815676    2574 flags.go:64] FLAG: --registry-qps="5"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815679    2574 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815682    2574 flags.go:64] FLAG: --reserved-memory=""
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815686    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815689    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815692    2574 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815694    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815697    2574 flags.go:64] FLAG: --runonce="false"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815700    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815703    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815706    2574 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815709    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 15:08:45.823494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815712    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815714    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815717    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815720    2574 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815723    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815726    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815728    2574 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815731    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815734    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815737    2574 flags.go:64] FLAG: --system-cgroups=""
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815740    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815745    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815748    2574 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815751    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815754    2574 flags.go:64] FLAG: --tls-min-version=""
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815758    2574 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815760    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815763    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815766    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815769    2574 flags.go:64] FLAG: --v="2"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815775    2574 flags.go:64] FLAG: --version="false"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815779    2574 flags.go:64] FLAG: --vmodule=""
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815783    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.815786    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815896    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 15:08:45.824114 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815901    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815904    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815907    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815909    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815912    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815915    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815920    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815924    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815928    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815932    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815935    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815937    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815942    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815945    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815948    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815951    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815954    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815956    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815959    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 15:08:45.824821 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815962    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815964    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815967    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815970    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815973    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815976    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815979    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815982    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815986    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815989    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815993    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815997    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.815999    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816002    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816005    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816007    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816010    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816014    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816016    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816018    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 15:08:45.825281 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816021    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816024    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816026    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816029    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816032    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816036    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816039    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816041    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816044    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816046    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816049    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816051    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816054    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816057    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816059    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816062    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816064    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816067    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816069    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 15:08:45.825776 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816072    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816075    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816078    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816081    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816083    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816086    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816088    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816091    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816093    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816096    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816100    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816102    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816105    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816107    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816110    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816112    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816115    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816118    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816120    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816122    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 15:08:45.826222 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816125    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816127    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816130    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816132    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816135    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816137    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816140    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816142    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816145    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816147    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816150    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816152    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816155    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816159    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816161    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816163    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816166    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816169    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816171    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 15:08:45.826741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.816174    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.816771    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.823836    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.823852    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.823871    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.823877    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823933    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823938    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823941    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823944    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823947    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823950    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823953    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823956    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823959    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 15:08:45.827214 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823962    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823965    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823968    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823971    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823974    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823977    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823979    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823982    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823984    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823987    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823989    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823992    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823994    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823996    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.823999    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824002    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824005    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824007    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824010    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824013    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 15:08:45.827575 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824020    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824023    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824026    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824029    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824032    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824034    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824037    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824039    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824042    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824044    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824047    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824049    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824052    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824054    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824057    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824059    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824062    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824064    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824067    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824070    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 15:08:45.828075 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824072    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824075    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824077    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824080    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824082    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824084    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824087    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824089    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824092    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824094    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824097    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824099    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824102    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824109    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824112    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824115    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824117    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824120    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824122    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824125    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 15:08:45.828582 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824128    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824130    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824133    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824135    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824137    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824141    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824146    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824150    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824153    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824156    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824158    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824161    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824163    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824166    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824168    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824171    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824173    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824176    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 15:08:45.829105 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824178    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824181    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824183    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824186    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824188    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824191    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824194    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824197    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824205    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824208    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824210    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824214    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.824219    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824344    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 15:08:45.829534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824349    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824351    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824354    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824357    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824360    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824362    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824365    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824367    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824370    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824372    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824375    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824377    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824380    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824382    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824384    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824387    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824389    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824392    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824394    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824397    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 15:08:45.829961 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824399    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824402    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824405    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824409    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824412    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824415    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824419    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824426    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824428    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824431    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824433    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824436    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824438    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824441    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824444    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824448    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824450    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824453    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824455    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 15:08:45.830441 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824458    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824460    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824462    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824465    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824467    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824470    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824472    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824475    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824477    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824479    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824488    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824491    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824493    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824496    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824498    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824501    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824503    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824506    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824508    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824511    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 15:08:45.830952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824513    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824520    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824523    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824525    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824527    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824530    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824532    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824535    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824537    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824540    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824542    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824544    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824547    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824549    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824551    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824554    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824558    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824561    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824563    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 15:08:45.831422 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824566    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824569    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824571    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824574    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824577    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824579    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824582    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824584    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824587    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824590    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824592    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824596    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824598    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824601    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824604    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824628    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824631    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824634    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824636    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 15:08:45.831895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:45.824639    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 15:08:45.832355 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.824644    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 15:08:45.832355 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.824763    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 15:08:45.832355 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.826704    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 15:08:45.832355 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.827511    2574 server.go:1019] "Starting client certificate rotation"
Sep 11 15:08:45.832355 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.827609    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 15:08:45.832355 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.827666    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 15:08:45.832355 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.830735    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 15:08:45.832355 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.832068    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 15:08:45.841744 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.841728    2574 log.go:25] "Validated CRI v1 runtime API"
Sep 11 15:08:45.846005 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.845988    2574 log.go:25] "Validated CRI v1 image API"
Sep 11 15:08:45.848511 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.848483    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 15:08:45.853495 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.853476    2574 fs.go:135] Filesystem UUIDs: map[3ee3c3f8-e716-460f-a3ae-6d25cd7e1102:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ab54a096-f176-4d6f-a44c-28f6e4fa3ad8:/dev/nvme0n1p3]
Sep 11 15:08:45.853565 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.853494    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 15:08:45.857208 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.857191    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 15:08:45.858439 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.858335    2574 manager.go:216] Machine: {Timestamp:2026-09-11 15:08:45.857085924 +0000 UTC m=+0.316802915 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100499 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec267a176435396ff72fe61946bfad62 SystemUUID:ec267a17-6435-396f-f72f-e61946bfad62 BootID:7230d064-ca9f-42ab-8be6-8423788e8ff3 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:70:0c:1f:c5:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:70:0c:1f:c5:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:0e:ed:f1:9e:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 15:08:45.858439 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.858437    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 15:08:45.858550 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.858539    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 15:08:45.861185 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.861163    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 15:08:45.861327 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.861187    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 15:08:45.861850 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.861840    2574 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 15:08:45.861880 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.861853    2574 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 15:08:45.861880 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.861860    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 15:08:45.862392 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.862383    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 15:08:45.863156 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.863146    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 15:08:45.868022 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.868010    2574 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 15:08:45.868145 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.868136    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 15:08:45.868191 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.868174    2574 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 15:08:45.868224 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.868192    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 15:08:45.868224 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.868202    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 15:08:45.868224 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.868211    2574 kubelet.go:398] "Adding apiserver pod source"
Sep 11 15:08:45.868224 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.868220    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 15:08:45.868635 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.868624    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 15:08:45.868688 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.868651    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 15:08:45.870825 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.870806    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 15:08:45.872654 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.872639    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 15:08:45.872724 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.872670    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 15:08:45.874030 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874017    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 15:08:45.874079 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874035    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 15:08:45.874079 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874041    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 15:08:45.874079 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874046    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 15:08:45.874079 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874055    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 15:08:45.874079 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874060    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 15:08:45.874079 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874073    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 15:08:45.874079 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874079    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 15:08:45.874274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874087    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 15:08:45.874274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874093    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 15:08:45.874274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874102    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 15:08:45.874274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874107    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 15:08:45.874867 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874854    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 15:08:45.874867 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.874866    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 15:08:45.879216 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.878959    2574 server.go:1268] "Started kubelet"
Sep 11 15:08:45.879216 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.879022    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-545zn"
Sep 11 15:08:45.879520 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.879427    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 15:08:45.879669 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.879488    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 15:08:45.879669 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.879582    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 15:08:45.880092 ip-10-0-138-215 systemd[1]: Started Kubernetes Kubelet.
Sep 11 15:08:45.880324 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.880202    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 15:08:45.880324 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:45.880298    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 15:08:45.880324 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:45.880298    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 15:08:45.881211 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.881162    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 15:08:45.881493 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.881476    2574 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 15:08:45.884496 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:45.884272    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 15:08:45.886066 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.886047    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 15:08:45.886627 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.886598    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 15:08:45.886833 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:45.886812    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-215.ec2.internal\" not found"
Sep 11 15:08:45.887085 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.887047    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-545zn"
Sep 11 15:08:45.887307 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:45.886189    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-215.ec2.internal.18d44cbcd4b1b148  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-215.ec2.internal,UID:ip-10-0-138-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-215.ec2.internal,},FirstTimestamp:2026-09-11 15:08:45.878907208 +0000 UTC m=+0.338624200,LastTimestamp:2026-09-11 15:08:45.878907208 +0000 UTC m=+0.338624200,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-215.ec2.internal,}"
Sep 11 15:08:45.887407 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.887311    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 15:08:45.887407 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.887321    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 15:08:45.887407 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.887334    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 15:08:45.887537 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.887422    2574 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 15:08:45.887537 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.887427    2574 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 15:08:45.887537 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.887457    2574 factory.go:55] Registering systemd factory
Sep 11 15:08:45.887537 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.887468    2574 factory.go:223] Registration of the systemd container factory successfully
Sep 11 15:08:45.888130 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.888113    2574 factory.go:153] Registering CRI-O factory
Sep 11 15:08:45.888130 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.888130    2574 factory.go:223] Registration of the crio container factory successfully
Sep 11 15:08:45.888247 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.888198    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 15:08:45.888247 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.888215    2574 factory.go:103] Registering Raw factory
Sep 11 15:08:45.888247 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.888230    2574 manager.go:1196] Started watching for new ooms in manager
Sep 11 15:08:45.888542 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.888530    2574 manager.go:349] Starting recovery of all containers
Sep 11 15:08:45.896183 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.896163    2574 manager.go:354] Recovery completed
Sep 11 15:08:45.900905 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:45.900844    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 15:08:45.900991 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:45.900937    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 15:08:45.901318 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.901304    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 15:08:45.904160 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.904139    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 15:08:45.904251 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.904177    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 15:08:45.904251 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.904191    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientPID"
Sep 11 15:08:45.904799 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.904779    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 15:08:45.904799 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.904791    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 15:08:45.904892 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.904809    2574 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 15:08:45.904892 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.904811    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 15:08:45.906124 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.906110    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 15:08:45.906183 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.906138    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 15:08:45.906183 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.906155    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientPID"
Sep 11 15:08:45.906890 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.906867    2574 policy_none.go:49] "None policy: Start"
Sep 11 15:08:45.906951 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.906896    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 15:08:45.906951 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.906910    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 15:08:45.908924 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.908906    2574 policy_none.go:47] "Start"
Sep 11 15:08:45.945326 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.945306    2574 manager.go:337] "Starting Device Plugin manager"
Sep 11 15:08:45.967289 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:45.945347    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 15:08:45.967289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.945359    2574 server.go:87] "Starting device plugin registration server"
Sep 11 15:08:45.967289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.945658    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 15:08:45.967289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.945672    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 15:08:45.967289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.945769    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 15:08:45.967289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.945869    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 15:08:45.967289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.945880    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 15:08:45.967289 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:45.946399    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 15:08:45.967289 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:45.946451    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-215.ec2.internal\" not found"
Sep 11 15:08:45.986408 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.986379    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 15:08:45.987753 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.987735    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 15:08:45.987865 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.987786    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 15:08:45.987865 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.987810    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 15:08:45.987865 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:45.987847    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 15:08:45.990434 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:45.990411    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 15:08:46.046303 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.046271    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 15:08:46.047249 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.047232    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 15:08:46.047320 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.047265    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 15:08:46.047320 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.047280    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientPID"
Sep 11 15:08:46.047320 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.047304    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.055396 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.055381    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.055455 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:46.055404    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-215.ec2.internal\": node \"ip-10-0-138-215.ec2.internal\" not found"
Sep 11 15:08:46.065287 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:46.065206    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-215.ec2.internal\" not found"
Sep 11 15:08:46.088468 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.088442    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-215.ec2.internal"]
Sep 11 15:08:46.088530 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.088521    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 15:08:46.089585 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.089565    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 15:08:46.089694 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.089605    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 15:08:46.089694 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.089637    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientPID"
Sep 11 15:08:46.091939 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.091924    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 15:08:46.092063 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.092046    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.092108 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.092080    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 15:08:46.092717 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.092701    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 15:08:46.092791 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.092735    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 15:08:46.092791 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.092737    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 15:08:46.092791 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.092752    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientPID"
Sep 11 15:08:46.092791 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.092777    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 15:08:46.092791 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.092792    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientPID"
Sep 11 15:08:46.095148 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.095133    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.095211 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.095157    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 15:08:46.095935 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.095918    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 15:08:46.095997 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.095946    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 15:08:46.095997 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.095960    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeHasSufficientPID"
Sep 11 15:08:46.123384 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:46.123359    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-215.ec2.internal\" not found" node="ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.128044 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:46.128028    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-215.ec2.internal\" not found" node="ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.165923 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:46.165892    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-215.ec2.internal\" not found"
Sep 11 15:08:46.189553 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.189526    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34fcac9a5f075670faf70c4db03d88c0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-215.ec2.internal\" (UID: \"34fcac9a5f075670faf70c4db03d88c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.189650 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.189586    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d57f357b7c0aa82ef2e7aa8264d8d7f0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal\" (UID: \"d57f357b7c0aa82ef2e7aa8264d8d7f0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.189650 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.189605    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d57f357b7c0aa82ef2e7aa8264d8d7f0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal\" (UID: \"d57f357b7c0aa82ef2e7aa8264d8d7f0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.266210 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:46.266177    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-215.ec2.internal\" not found"
Sep 11 15:08:46.290625 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.290589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34fcac9a5f075670faf70c4db03d88c0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-215.ec2.internal\" (UID: \"34fcac9a5f075670faf70c4db03d88c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.290682 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.290654    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d57f357b7c0aa82ef2e7aa8264d8d7f0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal\" (UID: \"d57f357b7c0aa82ef2e7aa8264d8d7f0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.290718 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.290684    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d57f357b7c0aa82ef2e7aa8264d8d7f0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal\" (UID: \"d57f357b7c0aa82ef2e7aa8264d8d7f0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.290718 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.290703    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34fcac9a5f075670faf70c4db03d88c0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-215.ec2.internal\" (UID: \"34fcac9a5f075670faf70c4db03d88c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.290777 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.290726    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d57f357b7c0aa82ef2e7aa8264d8d7f0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal\" (UID: \"d57f357b7c0aa82ef2e7aa8264d8d7f0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.290814 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.290780    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d57f357b7c0aa82ef2e7aa8264d8d7f0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal\" (UID: \"d57f357b7c0aa82ef2e7aa8264d8d7f0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.366863 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:46.366836    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-215.ec2.internal\" not found"
Sep 11 15:08:46.425526 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.425492    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.431381 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.431363    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.467975 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:46.467943    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-215.ec2.internal\" not found"
Sep 11 15:08:46.568515 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:46.568480    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-215.ec2.internal\" not found"
Sep 11 15:08:46.669063 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:46.668988    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-215.ec2.internal\" not found"
Sep 11 15:08:46.769596 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:46.769566    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-215.ec2.internal\" not found"
Sep 11 15:08:46.828070 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.828039    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 15:08:46.828481 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.828190    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 15:08:46.870462 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:46.870436    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-215.ec2.internal\" not found"
Sep 11 15:08:46.900117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.900086    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 15:03:46 +0000 UTC" deadline="2028-06-13 18:09:00.801158388 +0000 UTC"
Sep 11 15:08:46.900117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.900111    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15387h0m13.901049965s"
Sep 11 15:08:46.906707 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.906690    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 15:08:46.908972 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.908955    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 15:08:46.987377 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.987341    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:46.999779 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:46.999758    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 15:08:47.001329 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.001314    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-215.ec2.internal"
Sep 11 15:08:47.009469 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.009449    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 15:08:47.077626 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:47.077450    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34fcac9a5f075670faf70c4db03d88c0.slice/crio-d5d79a1e79d389c308e34228c79608bcf3424c613e9c0aa70ecd3d3ba1711534 WatchSource:0}: Error finding container d5d79a1e79d389c308e34228c79608bcf3424c613e9c0aa70ecd3d3ba1711534: Status 404 returned error can't find the container with id d5d79a1e79d389c308e34228c79608bcf3424c613e9c0aa70ecd3d3ba1711534
Sep 11 15:08:47.078062 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:47.078042    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57f357b7c0aa82ef2e7aa8264d8d7f0.slice/crio-6bd525308c6934e3c5f7236c2b720c78d184c8a56ef5730440406d9dd16887f4 WatchSource:0}: Error finding container 6bd525308c6934e3c5f7236c2b720c78d184c8a56ef5730440406d9dd16887f4: Status 404 returned error can't find the container with id 6bd525308c6934e3c5f7236c2b720c78d184c8a56ef5730440406d9dd16887f4
Sep 11 15:08:47.082890 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.082864    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 15:08:47.116081 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.116052    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 15:08:47.869991 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.869955    2574 apiserver.go:52] "Watching apiserver"
Sep 11 15:08:47.878524 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.878497    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 15:08:47.879100 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.879069    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-564ps","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal","openshift-multus/multus-additional-cni-plugins-mlqk7","openshift-multus/multus-h6bbf","openshift-multus/network-metrics-daemon-rxztz","openshift-network-operator/iptables-alerter-pqxzf","kube-system/konnectivity-agent-8x5g2","kube-system/kube-apiserver-proxy-ip-10-0-138-215.ec2.internal","openshift-cluster-node-tuning-operator/tuned-gk6z7","openshift-dns/node-resolver-6hhmc","openshift-image-registry/node-ca-kbnd2","openshift-network-diagnostics/network-check-target-ptqp9","openshift-ovn-kubernetes/ovnkube-node-cfscz"]
Sep 11 15:08:47.881850 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.881792    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pqxzf"
Sep 11 15:08:47.884090 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.883823    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:47.884090 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:47.883895    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:08:47.886231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.884492    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 15:08:47.886231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.884809    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 15:08:47.886231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.884961    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 15:08:47.886231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.885156    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m78gj\""
Sep 11 15:08:47.888305 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.886744    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.888305 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.887539    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 15:08:47.888983 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.888963    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:47.890804 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.890581    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 15:08:47.890804 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.890788    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 15:08:47.891049 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.891032    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r6bcz\""
Sep 11 15:08:47.891423 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.891321    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 15:08:47.891535 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.891501    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 15:08:47.891752 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.891734    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 15:08:47.892008 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.891987    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:47.892099 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.892046    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 15:08:47.892099 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.892062    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 15:08:47.892203 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.892116    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 15:08:47.892203 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.892123    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 15:08:47.892393 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.892326    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 15:08:47.892465 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.892379    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 15:08:47.892465 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.892415    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pjgqz\""
Sep 11 15:08:47.893926 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.893896    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:47.894015 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:47.893969    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:08:47.894174 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.894154    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-kubelet\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-etc-openvswitch\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898224    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-run-openvswitch\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898255    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-run-ovn\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898280    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-log-socket\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898313    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898345    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2gcl\" (UniqueName: \"kubernetes.io/projected/b770d260-7414-4aa1-b96e-ca8e653982f7-kube-api-access-d2gcl\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898379    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-run-netns\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898410    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-cni-bin\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898436    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9dfde654-1081-4bb8-abca-26afbb3acb92-ovnkube-script-lib\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898575    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4fxp\" (UniqueName: \"kubernetes.io/projected/9dfde654-1081-4bb8-abca-26afbb3acb92-kube-api-access-p4fxp\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898595    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b770d260-7414-4aa1-b96e-ca8e653982f7-system-cni-dir\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898638    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c0e0dc9-7fde-4cc6-956e-5fc002722603-host-slash\") pod \"iptables-alerter-pqxzf\" (UID: \"3c0e0dc9-7fde-4cc6-956e-5fc002722603\") " pod="openshift-network-operator/iptables-alerter-pqxzf"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898667    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2rxb\" (UniqueName: \"kubernetes.io/projected/3c0e0dc9-7fde-4cc6-956e-5fc002722603-kube-api-access-x2rxb\") pod \"iptables-alerter-pqxzf\" (UID: \"3c0e0dc9-7fde-4cc6-956e-5fc002722603\") " pod="openshift-network-operator/iptables-alerter-pqxzf"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.898691    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-node-log\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.899083    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v64wk\""
Sep 11 15:08:47.899274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.899226    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8x5g2"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.899869    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9dfde654-1081-4bb8-abca-26afbb3acb92-ovn-node-metrics-cert\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.899897    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b770d260-7414-4aa1-b96e-ca8e653982f7-cnibin\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.899915    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b770d260-7414-4aa1-b96e-ca8e653982f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.899934    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-run-systemd\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.899962    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-var-lib-openvswitch\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.900001    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-cni-netd\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.900018    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b770d260-7414-4aa1-b96e-ca8e653982f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.900037    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b770d260-7414-4aa1-b96e-ca8e653982f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.900056    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-systemd-units\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.900075    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b770d260-7414-4aa1-b96e-ca8e653982f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.900092    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrxdv\" (UniqueName: \"kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv\") pod \"network-check-target-ptqp9\" (UID: \"03f436e2-eb76-41e5-83e5-8e5ea522044c\") " pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.900107    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-slash\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.900132    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9dfde654-1081-4bb8-abca-26afbb3acb92-ovnkube-config\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.900150    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c0e0dc9-7fde-4cc6-956e-5fc002722603-iptables-alerter-script\") pod \"iptables-alerter-pqxzf\" (UID: \"3c0e0dc9-7fde-4cc6-956e-5fc002722603\") " pod="openshift-network-operator/iptables-alerter-pqxzf"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.900168    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.900190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.900185    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9dfde654-1081-4bb8-abca-26afbb3acb92-env-overrides\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:47.902077 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.901122    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 15:08:47.902720 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.902394    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qhkst\""
Sep 11 15:08:47.902720 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.902507    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 15:08:47.902900 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.902875    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 15:08:47.903685 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.903666    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:47.904359 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:47.903772    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:08:47.905331 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.904549    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:47.907838 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.907249    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:47.908562 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.908438    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 15:08:47.908562 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.908502    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2xlmh\""
Sep 11 15:08:47.908787 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.908769    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 15:08:47.908894 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.908876    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 15:08:47.909231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.909211    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 15:08:47.909629 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.909585    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5mjvx\""
Sep 11 15:08:47.909851 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.909835    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 15:08:47.910031 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.910016    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6hhmc"
Sep 11 15:08:47.912100 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.912080    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kbnd2"
Sep 11 15:08:47.912948 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.912925    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rj2ft\""
Sep 11 15:08:47.913115 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.913092    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 15:08:47.913210 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.912927    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 15:08:47.915029 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.915010    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 15:08:47.915125 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.915108    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 15:08:47.915255 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.915238    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xpmng\""
Sep 11 15:08:47.915377 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.915194    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 15:08:47.923530 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.923507    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4jz27"
Sep 11 15:08:47.931301 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.931247    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4jz27"
Sep 11 15:08:47.988440 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.988410    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 15:08:47.993263 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.993187    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-215.ec2.internal" event={"ID":"34fcac9a5f075670faf70c4db03d88c0","Type":"ContainerStarted","Data":"d5d79a1e79d389c308e34228c79608bcf3424c613e9c0aa70ecd3d3ba1711534"}
Sep 11 15:08:47.994629 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:47.994600    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal" event={"ID":"d57f357b7c0aa82ef2e7aa8264d8d7f0","Type":"ContainerStarted","Data":"6bd525308c6934e3c5f7236c2b720c78d184c8a56ef5730440406d9dd16887f4"}
Sep 11 15:08:48.001420 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001394    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-sysctl-conf\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.001547 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001436    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-tmp\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.001547 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001497    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-multus-conf-dir\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.001547 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001524    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2608766e-f60a-4e61-846a-4f569aab6e5b-tmp-dir\") pod \"node-resolver-6hhmc\" (UID: \"2608766e-f60a-4e61-846a-4f569aab6e5b\") " pod="openshift-dns/node-resolver-6hhmc"
Sep 11 15:08:48.001748 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001551    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-etc-kubernetes\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.001748 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001583    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cba69abe-6178-4c82-9abb-bb8deb31ffaf-agent-certs\") pod \"konnectivity-agent-8x5g2\" (UID: \"cba69abe-6178-4c82-9abb-bb8deb31ffaf\") " pod="kube-system/konnectivity-agent-8x5g2"
Sep 11 15:08:48.001748 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001613    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-etc-openvswitch\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.001748 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001664    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-run-openvswitch\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.001748 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001688    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-run-ovn\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.001748 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001713    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-log-socket\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.001748 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001740    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.002084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001767    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-device-dir\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.002084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001799    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-systemd\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.002084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001833    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-var-lib-kubelet\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.002084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001864    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-run-ovn\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.002084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001872    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-run-netns\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.002084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001925    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-run-netns\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.002084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001921    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-cni-bin\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.002084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001970    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9dfde654-1081-4bb8-abca-26afbb3acb92-ovnkube-script-lib\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.002084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.001978    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-log-socket\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.002084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002006    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4fxp\" (UniqueName: \"kubernetes.io/projected/9dfde654-1081-4bb8-abca-26afbb3acb92-kube-api-access-p4fxp\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.002084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002032    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b770d260-7414-4aa1-b96e-ca8e653982f7-system-cni-dir\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.002084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002062    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0163d627-b988-4307-a7df-d5c3971306ff-dbus\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cpzb\" (UniqueName: \"kubernetes.io/projected/e366b22a-3300-4be4-8bfb-a2dc1ea30440-kube-api-access-5cpzb\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002137    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2rxb\" (UniqueName: \"kubernetes.io/projected/3c0e0dc9-7fde-4cc6-956e-5fc002722603-kube-api-access-x2rxb\") pod \"iptables-alerter-pqxzf\" (UID: \"3c0e0dc9-7fde-4cc6-956e-5fc002722603\") " pod="openshift-network-operator/iptables-alerter-pqxzf"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002171    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-kubernetes\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002204    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62d795b1-c30b-4e92-9f31-e1ebda198036-cni-binary-copy\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002242    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-run-k8s-cni-cncf-io\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002266    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-hostroot\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002291    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3185ded6-e599-494c-8445-ec7d3e8eb611-host\") pod \"node-ca-kbnd2\" (UID: \"3185ded6-e599-494c-8445-ec7d3e8eb611\") " pod="openshift-image-registry/node-ca-kbnd2"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdzsg\" (UniqueName: \"kubernetes.io/projected/91cc8492-8379-4837-a063-561240230e70-kube-api-access-gdzsg\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002365    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-registration-dir\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002418    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-etc-selinux\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002443    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-multus-cni-dir\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002476    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-multus-socket-dir-parent\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002502    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-var-lib-kubelet\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.002681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002562    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-cni-netd\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.003422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002731    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9dfde654-1081-4bb8-abca-26afbb3acb92-ovnkube-script-lib\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.003422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002947    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-etc-openvswitch\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.003422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.002957    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-cni-bin\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.003422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003034    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.003422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003066    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-run-openvswitch\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.003422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003091    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-cni-netd\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.003422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003114    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b770d260-7414-4aa1-b96e-ca8e653982f7-system-cni-dir\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.003422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b770d260-7414-4aa1-b96e-ca8e653982f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.003422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003220    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.003422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003266    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-lib-modules\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.003422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003315    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:48.004009 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003354    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-modprobe-d\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.004009 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003852    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b770d260-7414-4aa1-b96e-ca8e653982f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.004009 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003857    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-system-cni-dir\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.004009 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-slash\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.004009 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003967    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-socket-dir\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.004009 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.003980    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-slash\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.004350 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.004181    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c0e0dc9-7fde-4cc6-956e-5fc002722603-iptables-alerter-script\") pod \"iptables-alerter-pqxzf\" (UID: \"3c0e0dc9-7fde-4cc6-956e-5fc002722603\") " pod="openshift-network-operator/iptables-alerter-pqxzf"
Sep 11 15:08:48.004448 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.004396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.004506 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.004453    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9dfde654-1081-4bb8-abca-26afbb3acb92-env-overrides\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.004506 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.004491    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-sysconfig\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.009400 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009362    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-run\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.009500 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009402    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-cnibin\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.009500 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009438    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-kubelet\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.009613 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009502    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2gcl\" (UniqueName: \"kubernetes.io/projected/b770d260-7414-4aa1-b96e-ca8e653982f7-kube-api-access-d2gcl\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.009613 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009538    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-sys-fs\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.009613 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009584    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-host\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.009809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009612    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-run-multus-certs\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.009809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009644    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l7ps\" (UniqueName: \"kubernetes.io/projected/62d795b1-c30b-4e92-9f31-e1ebda198036-kube-api-access-6l7ps\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.009809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009676    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xb2d\" (UniqueName: \"kubernetes.io/projected/3185ded6-e599-494c-8445-ec7d3e8eb611-kube-api-access-9xb2d\") pod \"node-ca-kbnd2\" (UID: \"3185ded6-e599-494c-8445-ec7d3e8eb611\") " pod="openshift-image-registry/node-ca-kbnd2"
Sep 11 15:08:48.009809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009747    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2608766e-f60a-4e61-846a-4f569aab6e5b-hosts-file\") pod \"node-resolver-6hhmc\" (UID: \"2608766e-f60a-4e61-846a-4f569aab6e5b\") " pod="openshift-dns/node-resolver-6hhmc"
Sep 11 15:08:48.009809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009777    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c0e0dc9-7fde-4cc6-956e-5fc002722603-host-slash\") pod \"iptables-alerter-pqxzf\" (UID: \"3c0e0dc9-7fde-4cc6-956e-5fc002722603\") " pod="openshift-network-operator/iptables-alerter-pqxzf"
Sep 11 15:08:48.010102 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009826    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-node-log\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.010102 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009859    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0163d627-b988-4307-a7df-d5c3971306ff-kubelet-config\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:48.010102 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009889    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-sys\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.010102 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009931    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-run-netns\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.010102 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.009963    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-var-lib-cni-multus\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.010102 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010014    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62d795b1-c30b-4e92-9f31-e1ebda198036-multus-daemon-config\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.010102 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010048    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp2jg\" (UniqueName: \"kubernetes.io/projected/2608766e-f60a-4e61-846a-4f569aab6e5b-kube-api-access-dp2jg\") pod \"node-resolver-6hhmc\" (UID: \"2608766e-f60a-4e61-846a-4f569aab6e5b\") " pod="openshift-dns/node-resolver-6hhmc"
Sep 11 15:08:48.010467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010100    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9dfde654-1081-4bb8-abca-26afbb3acb92-ovn-node-metrics-cert\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.010467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010140    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b770d260-7414-4aa1-b96e-ca8e653982f7-cnibin\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.010467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010168    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b770d260-7414-4aa1-b96e-ca8e653982f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.010467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-tuned\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.010467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010239    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-var-lib-cni-bin\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.010467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010272    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3185ded6-e599-494c-8445-ec7d3e8eb611-serviceca\") pod \"node-ca-kbnd2\" (UID: \"3185ded6-e599-494c-8445-ec7d3e8eb611\") " pod="openshift-image-registry/node-ca-kbnd2"
Sep 11 15:08:48.010467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010302    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-run-systemd\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.010467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010336    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-var-lib-openvswitch\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.010467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b770d260-7414-4aa1-b96e-ca8e653982f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.010467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010404    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:48.010467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010447    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-systemd-units\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.011040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010483    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b770d260-7414-4aa1-b96e-ca8e653982f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.011040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010520    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c0e0dc9-7fde-4cc6-956e-5fc002722603-iptables-alerter-script\") pod \"iptables-alerter-pqxzf\" (UID: \"3c0e0dc9-7fde-4cc6-956e-5fc002722603\") " pod="openshift-network-operator/iptables-alerter-pqxzf"
Sep 11 15:08:48.011040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010517    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqtvq\" (UniqueName: \"kubernetes.io/projected/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-kube-api-access-tqtvq\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.011040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010580    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cba69abe-6178-4c82-9abb-bb8deb31ffaf-konnectivity-ca\") pod \"konnectivity-agent-8x5g2\" (UID: \"cba69abe-6178-4c82-9abb-bb8deb31ffaf\") " pod="kube-system/konnectivity-agent-8x5g2"
Sep 11 15:08:48.011040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010635    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-kubelet\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.011040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010642    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrxdv\" (UniqueName: \"kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv\") pod \"network-check-target-ptqp9\" (UID: \"03f436e2-eb76-41e5-83e5-8e5ea522044c\") " pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:48.011040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010679    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9dfde654-1081-4bb8-abca-26afbb3acb92-ovnkube-config\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.011040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-sysctl-d\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.011040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-node-log\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.011040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010754    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c0e0dc9-7fde-4cc6-956e-5fc002722603-host-slash\") pod \"iptables-alerter-pqxzf\" (UID: \"3c0e0dc9-7fde-4cc6-956e-5fc002722603\") " pod="openshift-network-operator/iptables-alerter-pqxzf"
Sep 11 15:08:48.011040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.010886    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 15:08:48.012627 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.011609    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-var-lib-openvswitch\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.012627 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.011716    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b770d260-7414-4aa1-b96e-ca8e653982f7-cnibin\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.012627 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.011880    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b770d260-7414-4aa1-b96e-ca8e653982f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.012627 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.012022    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-run-systemd\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.012627 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.012048    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.012627 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.012486    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9dfde654-1081-4bb8-abca-26afbb3acb92-env-overrides\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.012627 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.012531    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b770d260-7414-4aa1-b96e-ca8e653982f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.013546 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.012765    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9dfde654-1081-4bb8-abca-26afbb3acb92-systemd-units\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.013546 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.013180    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b770d260-7414-4aa1-b96e-ca8e653982f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.013714 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.013675    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9dfde654-1081-4bb8-abca-26afbb3acb92-ovnkube-config\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.015844 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.015780    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9dfde654-1081-4bb8-abca-26afbb3acb92-ovn-node-metrics-cert\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.017893 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.017552    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 15:08:48.017893 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.017582    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 15:08:48.017893 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.017598    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wrxdv for pod openshift-network-diagnostics/network-check-target-ptqp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:08:48.017893 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.017688    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv podName:03f436e2-eb76-41e5-83e5-8e5ea522044c nodeName:}" failed. No retries permitted until 2026-09-11 15:08:48.517665801 +0000 UTC m=+2.977382802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wrxdv" (UniqueName: "kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv") pod "network-check-target-ptqp9" (UID: "03f436e2-eb76-41e5-83e5-8e5ea522044c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:08:48.017893 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.017797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4fxp\" (UniqueName: \"kubernetes.io/projected/9dfde654-1081-4bb8-abca-26afbb3acb92-kube-api-access-p4fxp\") pod \"ovnkube-node-cfscz\" (UID: \"9dfde654-1081-4bb8-abca-26afbb3acb92\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.021264 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.021223    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2rxb\" (UniqueName: \"kubernetes.io/projected/3c0e0dc9-7fde-4cc6-956e-5fc002722603-kube-api-access-x2rxb\") pod \"iptables-alerter-pqxzf\" (UID: \"3c0e0dc9-7fde-4cc6-956e-5fc002722603\") " pod="openshift-network-operator/iptables-alerter-pqxzf"
Sep 11 15:08:48.023995 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.023969    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2gcl\" (UniqueName: \"kubernetes.io/projected/b770d260-7414-4aa1-b96e-ca8e653982f7-kube-api-access-d2gcl\") pod \"multus-additional-cni-plugins-mlqk7\" (UID: \"b770d260-7414-4aa1-b96e-ca8e653982f7\") " pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.111018 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.110979    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-multus-socket-dir-parent\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.111018 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111022    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-var-lib-kubelet\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.111259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111044    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.111259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111091    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-lib-modules\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.111259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111115    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:48.111259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111133    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-modprobe-d\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.111259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111149    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-system-cni-dir\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.111259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111174    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-socket-dir\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.111259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111200    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-sysconfig\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.111259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111228    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-run\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.111259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111252    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-cnibin\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111280    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-sys-fs\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111304    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-host\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111328    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-run-multus-certs\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111353    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l7ps\" (UniqueName: \"kubernetes.io/projected/62d795b1-c30b-4e92-9f31-e1ebda198036-kube-api-access-6l7ps\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111379    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xb2d\" (UniqueName: \"kubernetes.io/projected/3185ded6-e599-494c-8445-ec7d3e8eb611-kube-api-access-9xb2d\") pod \"node-ca-kbnd2\" (UID: \"3185ded6-e599-494c-8445-ec7d3e8eb611\") " pod="openshift-image-registry/node-ca-kbnd2"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111405    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2608766e-f60a-4e61-846a-4f569aab6e5b-hosts-file\") pod \"node-resolver-6hhmc\" (UID: \"2608766e-f60a-4e61-846a-4f569aab6e5b\") " pod="openshift-dns/node-resolver-6hhmc"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0163d627-b988-4307-a7df-d5c3971306ff-kubelet-config\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111465    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-sys\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111492    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-run-netns\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-var-lib-cni-multus\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111543    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62d795b1-c30b-4e92-9f31-e1ebda198036-multus-daemon-config\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp2jg\" (UniqueName: \"kubernetes.io/projected/2608766e-f60a-4e61-846a-4f569aab6e5b-kube-api-access-dp2jg\") pod \"node-resolver-6hhmc\" (UID: \"2608766e-f60a-4e61-846a-4f569aab6e5b\") " pod="openshift-dns/node-resolver-6hhmc"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111595    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-tuned\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111615    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-var-lib-cni-bin\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111641    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3185ded6-e599-494c-8445-ec7d3e8eb611-serviceca\") pod \"node-ca-kbnd2\" (UID: \"3185ded6-e599-494c-8445-ec7d3e8eb611\") " pod="openshift-image-registry/node-ca-kbnd2"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111670    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqtvq\" (UniqueName: \"kubernetes.io/projected/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-kube-api-access-tqtvq\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.111809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cba69abe-6178-4c82-9abb-bb8deb31ffaf-konnectivity-ca\") pod \"konnectivity-agent-8x5g2\" (UID: \"cba69abe-6178-4c82-9abb-bb8deb31ffaf\") " pod="kube-system/konnectivity-agent-8x5g2"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-sysctl-d\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111818    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-sysctl-conf\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111842    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-tmp\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111866    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-multus-conf-dir\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111892    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2608766e-f60a-4e61-846a-4f569aab6e5b-tmp-dir\") pod \"node-resolver-6hhmc\" (UID: \"2608766e-f60a-4e61-846a-4f569aab6e5b\") " pod="openshift-dns/node-resolver-6hhmc"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111915    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-etc-kubernetes\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111939    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cba69abe-6178-4c82-9abb-bb8deb31ffaf-agent-certs\") pod \"konnectivity-agent-8x5g2\" (UID: \"cba69abe-6178-4c82-9abb-bb8deb31ffaf\") " pod="kube-system/konnectivity-agent-8x5g2"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-device-dir\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.111997    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-systemd\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112023    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-var-lib-kubelet\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112057    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0163d627-b988-4307-a7df-d5c3971306ff-dbus\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112083    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cpzb\" (UniqueName: \"kubernetes.io/projected/e366b22a-3300-4be4-8bfb-a2dc1ea30440-kube-api-access-5cpzb\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112114    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-kubernetes\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112139    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62d795b1-c30b-4e92-9f31-e1ebda198036-cni-binary-copy\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112165    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-run-k8s-cni-cncf-io\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112192    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-hostroot\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112216    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3185ded6-e599-494c-8445-ec7d3e8eb611-host\") pod \"node-ca-kbnd2\" (UID: \"3185ded6-e599-494c-8445-ec7d3e8eb611\") " pod="openshift-image-registry/node-ca-kbnd2"
Sep 11 15:08:48.112735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112242    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdzsg\" (UniqueName: \"kubernetes.io/projected/91cc8492-8379-4837-a063-561240230e70-kube-api-access-gdzsg\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112268    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-registration-dir\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112302    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-etc-selinux\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112332    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-multus-cni-dir\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112618    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-multus-cni-dir\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112648    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.112785    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-lib-modules\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.112883    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.112949    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret podName:0163d627-b988-4307-a7df-d5c3971306ff nodeName:}" failed. No retries permitted until 2026-09-11 15:08:48.612928665 +0000 UTC m=+3.072645649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret") pod "global-pull-secret-syncer-564ps" (UID: "0163d627-b988-4307-a7df-d5c3971306ff") : object "kube-system"/"original-pull-secret" not registered
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.113202    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-modprobe-d\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.113240    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3185ded6-e599-494c-8445-ec7d3e8eb611-serviceca\") pod \"node-ca-kbnd2\" (UID: \"3185ded6-e599-494c-8445-ec7d3e8eb611\") " pod="openshift-image-registry/node-ca-kbnd2"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.113280    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-system-cni-dir\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.113308    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-var-lib-kubelet\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.113396    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.113397    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-socket-dir\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.113450    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-sysconfig\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.113460    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs podName:91cc8492-8379-4837-a063-561240230e70 nodeName:}" failed. No retries permitted until 2026-09-11 15:08:48.613443576 +0000 UTC m=+3.073160557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs") pod "network-metrics-daemon-rxztz" (UID: "91cc8492-8379-4837-a063-561240230e70") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:08:48.113621 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.113501    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-run\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.113550    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-cnibin\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.113604    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-sys-fs\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.113654    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-host\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.113718    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-run-multus-certs\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.113865    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-sysctl-d\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.114001    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-sysctl-conf\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.114126    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2608766e-f60a-4e61-846a-4f569aab6e5b-hosts-file\") pod \"node-resolver-6hhmc\" (UID: \"2608766e-f60a-4e61-846a-4f569aab6e5b\") " pod="openshift-dns/node-resolver-6hhmc"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.114190    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0163d627-b988-4307-a7df-d5c3971306ff-kubelet-config\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.114242    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-sys\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.114282    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-run-netns\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.114323    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-var-lib-cni-multus\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.114417    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-kubernetes\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.114540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.114474    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-multus-conf-dir\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.115197 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.114795    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2608766e-f60a-4e61-846a-4f569aab6e5b-tmp-dir\") pod \"node-resolver-6hhmc\" (UID: \"2608766e-f60a-4e61-846a-4f569aab6e5b\") " pod="openshift-dns/node-resolver-6hhmc"
Sep 11 15:08:48.115197 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.114870    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-etc-kubernetes\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.115197 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.114887    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62d795b1-c30b-4e92-9f31-e1ebda198036-multus-daemon-config\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.115458    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-var-lib-kubelet\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.115479    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0163d627-b988-4307-a7df-d5c3971306ff-dbus\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.115530    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-device-dir\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.115543    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-var-lib-cni-bin\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.115580    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-hostroot\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.115585    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-systemd\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.115621    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-host-run-k8s-cni-cncf-io\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.115661    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-registration-dir\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.115698    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e366b22a-3300-4be4-8bfb-a2dc1ea30440-etc-selinux\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.115715    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62d795b1-c30b-4e92-9f31-e1ebda198036-multus-socket-dir-parent\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.115752    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3185ded6-e599-494c-8445-ec7d3e8eb611-host\") pod \"node-ca-kbnd2\" (UID: \"3185ded6-e599-494c-8445-ec7d3e8eb611\") " pod="openshift-image-registry/node-ca-kbnd2"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.116038    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62d795b1-c30b-4e92-9f31-e1ebda198036-cni-binary-copy\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.116504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.116189    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cba69abe-6178-4c82-9abb-bb8deb31ffaf-konnectivity-ca\") pod \"konnectivity-agent-8x5g2\" (UID: \"cba69abe-6178-4c82-9abb-bb8deb31ffaf\") " pod="kube-system/konnectivity-agent-8x5g2"
Sep 11 15:08:48.118258 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.118227    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-tmp\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.118480 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.118460    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-etc-tuned\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.118548 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.118504    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cba69abe-6178-4c82-9abb-bb8deb31ffaf-agent-certs\") pod \"konnectivity-agent-8x5g2\" (UID: \"cba69abe-6178-4c82-9abb-bb8deb31ffaf\") " pod="kube-system/konnectivity-agent-8x5g2"
Sep 11 15:08:48.137492 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.137424    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xb2d\" (UniqueName: \"kubernetes.io/projected/3185ded6-e599-494c-8445-ec7d3e8eb611-kube-api-access-9xb2d\") pod \"node-ca-kbnd2\" (UID: \"3185ded6-e599-494c-8445-ec7d3e8eb611\") " pod="openshift-image-registry/node-ca-kbnd2"
Sep 11 15:08:48.138000 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.137978    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdzsg\" (UniqueName: \"kubernetes.io/projected/91cc8492-8379-4837-a063-561240230e70-kube-api-access-gdzsg\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:48.138468 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.138399    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp2jg\" (UniqueName: \"kubernetes.io/projected/2608766e-f60a-4e61-846a-4f569aab6e5b-kube-api-access-dp2jg\") pod \"node-resolver-6hhmc\" (UID: \"2608766e-f60a-4e61-846a-4f569aab6e5b\") " pod="openshift-dns/node-resolver-6hhmc"
Sep 11 15:08:48.138468 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.138410    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cpzb\" (UniqueName: \"kubernetes.io/projected/e366b22a-3300-4be4-8bfb-a2dc1ea30440-kube-api-access-5cpzb\") pod \"aws-ebs-csi-driver-node-nzfcb\" (UID: \"e366b22a-3300-4be4-8bfb-a2dc1ea30440\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.139089 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.139067    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqtvq\" (UniqueName: \"kubernetes.io/projected/c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a-kube-api-access-tqtvq\") pod \"tuned-gk6z7\" (UID: \"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a\") " pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.139848 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.139824    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l7ps\" (UniqueName: \"kubernetes.io/projected/62d795b1-c30b-4e92-9f31-e1ebda198036-kube-api-access-6l7ps\") pod \"multus-h6bbf\" (UID: \"62d795b1-c30b-4e92-9f31-e1ebda198036\") " pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.199045 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.199015    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pqxzf"
Sep 11 15:08:48.211551 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.211520    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:08:48.219761 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.219730    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mlqk7"
Sep 11 15:08:48.226828 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.226807    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h6bbf"
Sep 11 15:08:48.233737 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.233713    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8x5g2"
Sep 11 15:08:48.237516 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.237494    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 15:08:48.246121 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.246096    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb"
Sep 11 15:08:48.256205 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.256179    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gk6z7"
Sep 11 15:08:48.263999 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.263948    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6hhmc"
Sep 11 15:08:48.270805 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.270778    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kbnd2"
Sep 11 15:08:48.616920 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.616886    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:48.617116 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.616953    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:48.617116 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.616987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrxdv\" (UniqueName: \"kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv\") pod \"network-check-target-ptqp9\" (UID: \"03f436e2-eb76-41e5-83e5-8e5ea522044c\") " pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:48.617116 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.617077    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 15:08:48.617116 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.617115    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 15:08:48.617342 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.617136    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 15:08:48.617342 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.617144    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret podName:0163d627-b988-4307-a7df-d5c3971306ff nodeName:}" failed. No retries permitted until 2026-09-11 15:08:49.617128111 +0000 UTC m=+4.076845091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret") pod "global-pull-secret-syncer-564ps" (UID: "0163d627-b988-4307-a7df-d5c3971306ff") : object "kube-system"/"original-pull-secret" not registered
Sep 11 15:08:48.617342 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.617151    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wrxdv for pod openshift-network-diagnostics/network-check-target-ptqp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:08:48.617342 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.617206    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv podName:03f436e2-eb76-41e5-83e5-8e5ea522044c nodeName:}" failed. No retries permitted until 2026-09-11 15:08:49.617187938 +0000 UTC m=+4.076904938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrxdv" (UniqueName: "kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv") pod "network-check-target-ptqp9" (UID: "03f436e2-eb76-41e5-83e5-8e5ea522044c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:08:48.617342 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.617274    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:08:48.617342 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.617312    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs podName:91cc8492-8379-4837-a063-561240230e70 nodeName:}" failed. No retries permitted until 2026-09-11 15:08:49.617298647 +0000 UTC m=+4.077015656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs") pod "network-metrics-daemon-rxztz" (UID: "91cc8492-8379-4837-a063-561240230e70") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:08:48.935867 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.935778    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 15:03:48 +0000 UTC" deadline="2028-03-08 14:10:15.837025611 +0000 UTC"
Sep 11 15:08:48.935867 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.935809    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13055h1m26.901219968s"
Sep 11 15:08:48.988600 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:48.988568    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:48.988769 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:48.988704    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:08:49.256302 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:49.256275    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35125b4_0ff4_41b7_9f7f_43e03b3e1b6a.slice/crio-47db7bd2484de2dbb94b991030f263076b1b4373fe8c9f18d0b4c763711743b5 WatchSource:0}: Error finding container 47db7bd2484de2dbb94b991030f263076b1b4373fe8c9f18d0b4c763711743b5: Status 404 returned error can't find the container with id 47db7bd2484de2dbb94b991030f263076b1b4373fe8c9f18d0b4c763711743b5
Sep 11 15:08:49.257841 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:49.257801    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0e0dc9_7fde_4cc6_956e_5fc002722603.slice/crio-d82ebd9d66dfdd6e42625b0bf29d122f68160a66890134492f07df8bd37b19d6 WatchSource:0}: Error finding container d82ebd9d66dfdd6e42625b0bf29d122f68160a66890134492f07df8bd37b19d6: Status 404 returned error can't find the container with id d82ebd9d66dfdd6e42625b0bf29d122f68160a66890134492f07df8bd37b19d6
Sep 11 15:08:49.259406 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:49.259361    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba69abe_6178_4c82_9abb_bb8deb31ffaf.slice/crio-c11ec0a2c2701444746c605d6a9f7a998adcf6371c7322a7e047cf7cf3195af0 WatchSource:0}: Error finding container c11ec0a2c2701444746c605d6a9f7a998adcf6371c7322a7e047cf7cf3195af0: Status 404 returned error can't find the container with id c11ec0a2c2701444746c605d6a9f7a998adcf6371c7322a7e047cf7cf3195af0
Sep 11 15:08:49.259683 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:49.259612    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d795b1_c30b_4e92_9f31_e1ebda198036.slice/crio-ac5908804ff1d1b1888a66d39f9bbc91ea411a1189ef2a7c425c7cc957084177 WatchSource:0}: Error finding container ac5908804ff1d1b1888a66d39f9bbc91ea411a1189ef2a7c425c7cc957084177: Status 404 returned error can't find the container with id ac5908804ff1d1b1888a66d39f9bbc91ea411a1189ef2a7c425c7cc957084177
Sep 11 15:08:49.261190 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:49.261146    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3185ded6_e599_494c_8445_ec7d3e8eb611.slice/crio-b9935698a3e45ea64986dcea6a359b0890c70a27085c2d9aa8fa3dd6590ad78b WatchSource:0}: Error finding container b9935698a3e45ea64986dcea6a359b0890c70a27085c2d9aa8fa3dd6590ad78b: Status 404 returned error can't find the container with id b9935698a3e45ea64986dcea6a359b0890c70a27085c2d9aa8fa3dd6590ad78b
Sep 11 15:08:49.265981 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:08:49.265755    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode366b22a_3300_4be4_8bfb_a2dc1ea30440.slice/crio-087f233f343de4d221522fb819c4301ba0d304970b3615ebdb29baea90c36700 WatchSource:0}: Error finding container 087f233f343de4d221522fb819c4301ba0d304970b3615ebdb29baea90c36700: Status 404 returned error can't find the container with id 087f233f343de4d221522fb819c4301ba0d304970b3615ebdb29baea90c36700
Sep 11 15:08:49.624722 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:49.624677    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:49.624722 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:49.624720    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrxdv\" (UniqueName: \"kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv\") pod \"network-check-target-ptqp9\" (UID: \"03f436e2-eb76-41e5-83e5-8e5ea522044c\") " pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:49.624910 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:49.624760    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:49.624910 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:49.624803    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:08:49.624910 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:49.624861    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs podName:91cc8492-8379-4837-a063-561240230e70 nodeName:}" failed. No retries permitted until 2026-09-11 15:08:51.624846514 +0000 UTC m=+6.084563494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs") pod "network-metrics-daemon-rxztz" (UID: "91cc8492-8379-4837-a063-561240230e70") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:08:49.624910 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:49.624864    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 15:08:49.624910 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:49.624883    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 15:08:49.624910 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:49.624904    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 15:08:49.624910 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:49.624915    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret podName:0163d627-b988-4307-a7df-d5c3971306ff nodeName:}" failed. No retries permitted until 2026-09-11 15:08:51.624898406 +0000 UTC m=+6.084615402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret") pod "global-pull-secret-syncer-564ps" (UID: "0163d627-b988-4307-a7df-d5c3971306ff") : object "kube-system"/"original-pull-secret" not registered
Sep 11 15:08:49.625179 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:49.624917    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wrxdv for pod openshift-network-diagnostics/network-check-target-ptqp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:08:49.625179 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:49.624957    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv podName:03f436e2-eb76-41e5-83e5-8e5ea522044c nodeName:}" failed. No retries permitted until 2026-09-11 15:08:51.624948897 +0000 UTC m=+6.084665877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrxdv" (UniqueName: "kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv") pod "network-check-target-ptqp9" (UID: "03f436e2-eb76-41e5-83e5-8e5ea522044c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:08:49.936781 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:49.936719    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 15:03:48 +0000 UTC" deadline="2028-04-03 08:21:59.204472768 +0000 UTC"
Sep 11 15:08:49.936781 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:49.936775    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13673h13m9.26770061s"
Sep 11 15:08:49.988565 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:49.988507    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:49.988777 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:49.988701    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:08:49.989343 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:49.989320    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:49.989473 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:49.989453    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:08:50.000868 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.000838    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kbnd2" event={"ID":"3185ded6-e599-494c-8445-ec7d3e8eb611","Type":"ContainerStarted","Data":"b9935698a3e45ea64986dcea6a359b0890c70a27085c2d9aa8fa3dd6590ad78b"}
Sep 11 15:08:50.003568 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.003540    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h6bbf" event={"ID":"62d795b1-c30b-4e92-9f31-e1ebda198036","Type":"ContainerStarted","Data":"ac5908804ff1d1b1888a66d39f9bbc91ea411a1189ef2a7c425c7cc957084177"}
Sep 11 15:08:50.005555 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.005506    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gk6z7" event={"ID":"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a","Type":"ContainerStarted","Data":"47db7bd2484de2dbb94b991030f263076b1b4373fe8c9f18d0b4c763711743b5"}
Sep 11 15:08:50.009016 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.008987    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-215.ec2.internal" event={"ID":"34fcac9a5f075670faf70c4db03d88c0","Type":"ContainerStarted","Data":"a95bbc74bf3f4aff9771309b8ca4f1a722a45245e9c65560847121b22d31e01f"}
Sep 11 15:08:50.010954 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.010928    2574 generic.go:356] "Generic (PLEG): container finished" podID="d57f357b7c0aa82ef2e7aa8264d8d7f0" containerID="204656ae65450d4e620b264ac0c60c1b77ebbf8b54ad92a5a557fa899933d8ba" exitCode=0
Sep 11 15:08:50.011055 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.011013    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal" event={"ID":"d57f357b7c0aa82ef2e7aa8264d8d7f0","Type":"ContainerDied","Data":"204656ae65450d4e620b264ac0c60c1b77ebbf8b54ad92a5a557fa899933d8ba"}
Sep 11 15:08:50.013074 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.012483    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6hhmc" event={"ID":"2608766e-f60a-4e61-846a-4f569aab6e5b","Type":"ContainerStarted","Data":"fcb5de42185b57a5d0b8cc764fdca5805c34515d46a96de8068b5a482e8832f5"}
Sep 11 15:08:50.015031 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.015004    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz" event={"ID":"9dfde654-1081-4bb8-abca-26afbb3acb92","Type":"ContainerStarted","Data":"6d38326ee3318c2f6b6bb44d1a678352293ed4bda09af5f3617e85882963cb6f"}
Sep 11 15:08:50.017727 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.017624    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb" event={"ID":"e366b22a-3300-4be4-8bfb-a2dc1ea30440","Type":"ContainerStarted","Data":"087f233f343de4d221522fb819c4301ba0d304970b3615ebdb29baea90c36700"}
Sep 11 15:08:50.020272 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.020237    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8x5g2" event={"ID":"cba69abe-6178-4c82-9abb-bb8deb31ffaf","Type":"ContainerStarted","Data":"c11ec0a2c2701444746c605d6a9f7a998adcf6371c7322a7e047cf7cf3195af0"}
Sep 11 15:08:50.022151 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.022044    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pqxzf" event={"ID":"3c0e0dc9-7fde-4cc6-956e-5fc002722603","Type":"ContainerStarted","Data":"d82ebd9d66dfdd6e42625b0bf29d122f68160a66890134492f07df8bd37b19d6"}
Sep 11 15:08:50.024718 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.023781    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-215.ec2.internal" podStartSLOduration=3.023755916 podStartE2EDuration="3.023755916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:08:50.02350811 +0000 UTC m=+4.483225116" watchObservedRunningTime="2026-09-11 15:08:50.023755916 +0000 UTC m=+4.483472919"
Sep 11 15:08:50.031707 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.031665    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlqk7" event={"ID":"b770d260-7414-4aa1-b96e-ca8e653982f7","Type":"ContainerStarted","Data":"b1f6e338f51007fb0b6bb804c674fd9ae58c838be00ee13d4d9a359d073e1485"}
Sep 11 15:08:50.988871 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:50.988602    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:50.989348 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:50.988980    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:08:51.056395 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:51.056288    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal" event={"ID":"d57f357b7c0aa82ef2e7aa8264d8d7f0","Type":"ContainerStarted","Data":"d89dd2558f8a1b70b85121ebae25211853e79eb46322821b816b25fa9bd0fe38"}
Sep 11 15:08:51.641912 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:51.641287    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:51.641912 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:51.641340    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrxdv\" (UniqueName: \"kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv\") pod \"network-check-target-ptqp9\" (UID: \"03f436e2-eb76-41e5-83e5-8e5ea522044c\") " pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:51.641912 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:51.641390    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:51.641912 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:51.641547    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 15:08:51.641912 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:51.641620    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret podName:0163d627-b988-4307-a7df-d5c3971306ff nodeName:}" failed. No retries permitted until 2026-09-11 15:08:55.64159562 +0000 UTC m=+10.101312620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret") pod "global-pull-secret-syncer-564ps" (UID: "0163d627-b988-4307-a7df-d5c3971306ff") : object "kube-system"/"original-pull-secret" not registered
Sep 11 15:08:51.641912 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:51.641659    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:08:51.641912 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:51.641720    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs podName:91cc8492-8379-4837-a063-561240230e70 nodeName:}" failed. No retries permitted until 2026-09-11 15:08:55.641707837 +0000 UTC m=+10.101424832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs") pod "network-metrics-daemon-rxztz" (UID: "91cc8492-8379-4837-a063-561240230e70") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:08:51.641912 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:51.641804    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 15:08:51.641912 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:51.641817    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 15:08:51.641912 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:51.641830    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wrxdv for pod openshift-network-diagnostics/network-check-target-ptqp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:08:51.641912 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:51.641866    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv podName:03f436e2-eb76-41e5-83e5-8e5ea522044c nodeName:}" failed. No retries permitted until 2026-09-11 15:08:55.641853231 +0000 UTC m=+10.101570217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrxdv" (UniqueName: "kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv") pod "network-check-target-ptqp9" (UID: "03f436e2-eb76-41e5-83e5-8e5ea522044c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:08:51.991756 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:51.990903    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:51.991756 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:51.991054    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:08:51.991756 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:51.991520    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:51.991756 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:51.991636    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:08:52.988528 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:52.988485    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:52.988697 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:52.988640    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:08:53.989757 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:53.989722    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:53.990214 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:53.989867    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:08:53.991934 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:53.991909    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:53.992055 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:53.992015    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:08:54.989039 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:54.988587    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:54.989039 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:54.988737    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:08:55.676291 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:55.676250    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:55.676802 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:55.676304    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrxdv\" (UniqueName: \"kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv\") pod \"network-check-target-ptqp9\" (UID: \"03f436e2-eb76-41e5-83e5-8e5ea522044c\") " pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:55.676802 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:55.676354    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:55.676802 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:55.676485    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 15:08:55.676802 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:55.676546    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret podName:0163d627-b988-4307-a7df-d5c3971306ff nodeName:}" failed. No retries permitted until 2026-09-11 15:09:03.676529654 +0000 UTC m=+18.136246652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret") pod "global-pull-secret-syncer-564ps" (UID: "0163d627-b988-4307-a7df-d5c3971306ff") : object "kube-system"/"original-pull-secret" not registered
Sep 11 15:08:55.676802 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:55.676755    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 15:08:55.676802 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:55.676764    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:08:55.676802 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:55.676777    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 15:08:55.676802 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:55.676789    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wrxdv for pod openshift-network-diagnostics/network-check-target-ptqp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:08:55.677205 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:55.676833    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs podName:91cc8492-8379-4837-a063-561240230e70 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:03.676815834 +0000 UTC m=+18.136532830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs") pod "network-metrics-daemon-rxztz" (UID: "91cc8492-8379-4837-a063-561240230e70") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:08:55.677205 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:55.676855    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv podName:03f436e2-eb76-41e5-83e5-8e5ea522044c nodeName:}" failed. No retries permitted until 2026-09-11 15:09:03.676844368 +0000 UTC m=+18.136561351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrxdv" (UniqueName: "kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv") pod "network-check-target-ptqp9" (UID: "03f436e2-eb76-41e5-83e5-8e5ea522044c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:08:55.989117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:55.989033    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:55.989276 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:55.989151    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:08:55.989276 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:55.989199    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:55.989369 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:55.989287    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:08:56.988820 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:56.988677    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:56.988820 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:56.988780    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:08:57.989128 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:57.989088    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:57.989519 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:57.989226    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:08:57.989719 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:57.989697    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:57.989851 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:57.989788    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:08:58.989056 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:58.989012    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:08:58.989239 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:58.989145    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:08:59.988328 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:59.988294    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:08:59.988511 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:59.988434    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:08:59.988800 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:08:59.988777    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:08:59.988945 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:08:59.988896    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:09:00.988936 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:00.988852    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:00.989300 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:00.988980    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:09:01.988354 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:01.988320    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:01.988516 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:01.988320    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:01.988516 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:01.988470    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:09:01.988628 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:01.988552    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:09:02.987999 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:02.987965    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:02.988490 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:02.988079    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:09:03.737535 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:03.737498    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:03.737749 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:03.737566    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:03.737749 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:03.737588    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrxdv\" (UniqueName: \"kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv\") pod \"network-check-target-ptqp9\" (UID: \"03f436e2-eb76-41e5-83e5-8e5ea522044c\") " pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:03.737749 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:03.737686    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 15:09:03.737749 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:03.737722    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:09:03.737749 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:03.737727    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 15:09:03.737749 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:03.737750    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 15:09:03.738030 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:03.737763    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wrxdv for pod openshift-network-diagnostics/network-check-target-ptqp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:09:03.738030 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:03.737766    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret podName:0163d627-b988-4307-a7df-d5c3971306ff nodeName:}" failed. No retries permitted until 2026-09-11 15:09:19.737745305 +0000 UTC m=+34.197462309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret") pod "global-pull-secret-syncer-564ps" (UID: "0163d627-b988-4307-a7df-d5c3971306ff") : object "kube-system"/"original-pull-secret" not registered
Sep 11 15:09:03.738030 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:03.737787    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs podName:91cc8492-8379-4837-a063-561240230e70 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:19.737776728 +0000 UTC m=+34.197493715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs") pod "network-metrics-daemon-rxztz" (UID: "91cc8492-8379-4837-a063-561240230e70") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:09:03.738030 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:03.737803    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv podName:03f436e2-eb76-41e5-83e5-8e5ea522044c nodeName:}" failed. No retries permitted until 2026-09-11 15:09:19.737793524 +0000 UTC m=+34.197510502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrxdv" (UniqueName: "kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv") pod "network-check-target-ptqp9" (UID: "03f436e2-eb76-41e5-83e5-8e5ea522044c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:09:03.988468 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:03.988102    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:03.988468 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:03.988242    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:09:03.988468 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:03.988304    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:03.988468 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:03.988384    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:09:04.988259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:04.988222    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:04.988454 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:04.988351    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:09:05.988821 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:05.988789    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:05.989271 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:05.988913    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:09:05.989271 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:05.988966    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:05.989271 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:05.989055    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:09:06.988456 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:06.988426    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:06.988660 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:06.988535    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:09:07.988846 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:07.988699    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:07.989439 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:07.988924    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:09:07.989439 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:07.988750    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:07.989439 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:07.989071    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:09:08.093253 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.093223    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6hhmc" event={"ID":"2608766e-f60a-4e61-846a-4f569aab6e5b","Type":"ContainerStarted","Data":"88734f01fbea103c72c594b00fd265d9f7b0f0686bd32db5188936d157f1b2bb"}
Sep 11 15:09:08.098216 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.098193    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz" event={"ID":"9dfde654-1081-4bb8-abca-26afbb3acb92","Type":"ContainerStarted","Data":"d80f4b7556ff05d6d3b69bb2b3944dab8c3e0023b4c238f836b60b77ae173be2"}
Sep 11 15:09:08.098321 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.098267    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz" event={"ID":"9dfde654-1081-4bb8-abca-26afbb3acb92","Type":"ContainerStarted","Data":"0c7e5a88e536f9e47c58046c40d7f038590ebf841fa6fc611c7171c9d39a8303"}
Sep 11 15:09:08.098321 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.098311    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz" event={"ID":"9dfde654-1081-4bb8-abca-26afbb3acb92","Type":"ContainerStarted","Data":"f166a94fe2495ae1bc5ddff2c4c193803d2a418bedff713b2112e2947c4392cd"}
Sep 11 15:09:08.098445 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.098344    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz" event={"ID":"9dfde654-1081-4bb8-abca-26afbb3acb92","Type":"ContainerStarted","Data":"a39cca08cba44cd4bd99893a87419d29bfb671f0c6cdfd42e7b6fa4c557ddbaa"}
Sep 11 15:09:08.099751 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.099729    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb" event={"ID":"e366b22a-3300-4be4-8bfb-a2dc1ea30440","Type":"ContainerStarted","Data":"a8f75099384536ef42ffab80f8ace8df1c376e7081d688853511812543b9f140"}
Sep 11 15:09:08.101124 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.101093    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8x5g2" event={"ID":"cba69abe-6178-4c82-9abb-bb8deb31ffaf","Type":"ContainerStarted","Data":"9eba493dcf6e2e12a85b380561d22ef052d6a315db1338947ea348b7125637ce"}
Sep 11 15:09:08.102669 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.102647    2574 generic.go:356] "Generic (PLEG): container finished" podID="b770d260-7414-4aa1-b96e-ca8e653982f7" containerID="00a0dfacb95d2e5c64e0723db71b7a0d003f948f7f6739064eac1f5e14c45bca" exitCode=0
Sep 11 15:09:08.102756 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.102726    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlqk7" event={"ID":"b770d260-7414-4aa1-b96e-ca8e653982f7","Type":"ContainerDied","Data":"00a0dfacb95d2e5c64e0723db71b7a0d003f948f7f6739064eac1f5e14c45bca"}
Sep 11 15:09:08.107039 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.106217    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kbnd2" event={"ID":"3185ded6-e599-494c-8445-ec7d3e8eb611","Type":"ContainerStarted","Data":"93427cdf5af5cdb77eb914c489f2a1a5efeafa2c2a816e75091f83535cd28548"}
Sep 11 15:09:08.108994 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.108634    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h6bbf" event={"ID":"62d795b1-c30b-4e92-9f31-e1ebda198036","Type":"ContainerStarted","Data":"a8da149e7bd6caa504b96bc7cb5bf845348f3daecfb8f1b4ead2142c9e02c10c"}
Sep 11 15:09:08.108994 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.108962    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6hhmc" podStartSLOduration=3.730271378 podStartE2EDuration="22.108950762s" totalImagesPullingTime="18.378679384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:08.108700855 +0000 UTC m=+22.568417858" watchObservedRunningTime="2026-09-11 15:09:08.108950762 +0000 UTC m=+22.568667762"
Sep 11 15:09:08.109411 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.109379    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-215.ec2.internal" podStartSLOduration=21.109370412 podStartE2EDuration="21.109370412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:08:51.073871143 +0000 UTC m=+5.533588142" watchObservedRunningTime="2026-09-11 15:09:08.109370412 +0000 UTC m=+22.569087412"
Sep 11 15:09:08.110193 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.110169    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gk6z7" event={"ID":"c35125b4-0ff4-41b7-9f7f-43e03b3e1b6a","Type":"ContainerStarted","Data":"f10eb62edb100f462c146be0fa4188b242b86f924f068d369694382b39bcb84f"}
Sep 11 15:09:08.144493 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.144446    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kbnd2" podStartSLOduration=3.759074266 podStartE2EDuration="22.144108217s" totalImagesPullingTime="18.385033951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:08.123733493 +0000 UTC m=+22.583450492" watchObservedRunningTime="2026-09-11 15:09:08.144108217 +0000 UTC m=+22.603825224"
Sep 11 15:09:08.164375 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.164303    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h6bbf" podStartSLOduration=3.722761618 podStartE2EDuration="22.164290243s" totalImagesPullingTime="18.441528625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:08.163956139 +0000 UTC m=+22.623673151" watchObservedRunningTime="2026-09-11 15:09:08.164290243 +0000 UTC m=+22.624007243"
Sep 11 15:09:08.197608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.197462    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8x5g2" podStartSLOduration=3.8060804409999998 podStartE2EDuration="22.19744918s" totalImagesPullingTime="18.391368739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:08.178662725 +0000 UTC m=+22.638379716" watchObservedRunningTime="2026-09-11 15:09:08.19744918 +0000 UTC m=+22.657166180"
Sep 11 15:09:08.197738 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.197679    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gk6z7" podStartSLOduration=3.804059986 podStartE2EDuration="22.197674823s" totalImagesPullingTime="18.393614837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:08.196778695 +0000 UTC m=+22.656495695" watchObservedRunningTime="2026-09-11 15:09:08.197674823 +0000 UTC m=+22.657391822"
Sep 11 15:09:08.988351 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:08.988250    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:08.988585 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:08.988365    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:09:09.114594 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:09.114547    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pqxzf" event={"ID":"3c0e0dc9-7fde-4cc6-956e-5fc002722603","Type":"ContainerStarted","Data":"a2a66d65b8025589b60550d83d4e9c085716894396d191849f3776194677f2a0"}
Sep 11 15:09:09.118302 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:09.118272    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz" event={"ID":"9dfde654-1081-4bb8-abca-26afbb3acb92","Type":"ContainerStarted","Data":"bd334e35f433750343944b4e7859728664838c7a1f77cebe04c60f12e61709ae"}
Sep 11 15:09:09.118418 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:09.118356    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz" event={"ID":"9dfde654-1081-4bb8-abca-26afbb3acb92","Type":"ContainerStarted","Data":"75c6a1fe65bba156194f9d65a4ca0f70ebdae17ef04da4f87d8fb682f26a6bf2"}
Sep 11 15:09:09.130463 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:09.130420    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pqxzf" podStartSLOduration=4.73562813 podStartE2EDuration="23.130405088s" totalImagesPullingTime="18.394776958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:09.130147104 +0000 UTC m=+23.589864105" watchObservedRunningTime="2026-09-11 15:09:09.130405088 +0000 UTC m=+23.590122088"
Sep 11 15:09:09.393154 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:09.393132    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 15:09:09.454313 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:09.454287    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8x5g2"
Sep 11 15:09:09.454887 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:09.454870    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8x5g2"
Sep 11 15:09:09.959268 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:09.959160    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T15:09:09.393149028Z","UUID":"464bfcd3-2a48-4edf-9c05-a17e9eac9fa6","Handler":null,"Name":"","Endpoint":""}
Sep 11 15:09:09.960663 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:09.960640    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 15:09:09.960786 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:09.960675    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 15:09:09.988326 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:09.988301    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:09.988482 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:09.988432    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:09:09.988572 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:09.988555    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:09.988692 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:09.988666    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:09:10.125539 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:10.125474    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb" event={"ID":"e366b22a-3300-4be4-8bfb-a2dc1ea30440","Type":"ContainerStarted","Data":"efc1989f217ef5faef736c0c2e98485da85edd8a229d748c87330b9b5a3cc1ea"}
Sep 11 15:09:10.126094 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:10.125946    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8x5g2"
Sep 11 15:09:10.127226 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:10.127202    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8x5g2"
Sep 11 15:09:10.988668 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:10.988638    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:10.988826 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:10.988763    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:09:11.129351 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:11.129315    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb" event={"ID":"e366b22a-3300-4be4-8bfb-a2dc1ea30440","Type":"ContainerStarted","Data":"ef70f5fb1a0f329c22102f6fbbecb98eeee407a7657ba6c7222bd6a66defdc93"}
Sep 11 15:09:11.133354 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:11.133313    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz" event={"ID":"9dfde654-1081-4bb8-abca-26afbb3acb92","Type":"ContainerStarted","Data":"b9516dd9819a53903232915f29bbc56aeef2d76d2f663e0e0c087c02bdc81ef0"}
Sep 11 15:09:11.151383 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:11.151342    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzfcb" podStartSLOduration=4.042502299 podStartE2EDuration="25.151327651s" totalImagesPullingTime="21.108825352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:08:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:11.150392732 +0000 UTC m=+25.610109733" watchObservedRunningTime="2026-09-11 15:09:11.151327651 +0000 UTC m=+25.611044650"
Sep 11 15:09:11.988681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:11.988643    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:11.988681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:11.988681    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:11.988920 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:11.988776    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:09:11.988920 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:11.988887    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:09:12.989029 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:12.988807    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:12.989463 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:12.989077    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:09:13.994134 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:13.994064    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:13.994753 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:13.994066    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:13.994753 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:13.994162    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:09:13.994753 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:13.994278    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:09:14.143284 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:14.143248    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz" event={"ID":"9dfde654-1081-4bb8-abca-26afbb3acb92","Type":"ContainerStarted","Data":"ea1c2dba6cc25b52e3225ab6e581dafec67d3c952ea7ef84c1d05b73c5ffcf19"}
Sep 11 15:09:14.143511 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:14.143485    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:09:14.145236 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:14.145213    2574 generic.go:356] "Generic (PLEG): container finished" podID="b770d260-7414-4aa1-b96e-ca8e653982f7" containerID="79f2f757bf7c058cde43a204a6c4e7df364bd85c3e18f4a7e1a61270df29ab3b" exitCode=0
Sep 11 15:09:14.145374 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:14.145255    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlqk7" event={"ID":"b770d260-7414-4aa1-b96e-ca8e653982f7","Type":"ContainerDied","Data":"79f2f757bf7c058cde43a204a6c4e7df364bd85c3e18f4a7e1a61270df29ab3b"}
Sep 11 15:09:14.160058 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:14.160032    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:09:14.215681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:14.215503    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz" podStartSLOduration=9.767725112 podStartE2EDuration="28.215489188s" totalImagesPullingTime="18.447764076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:14.174708992 +0000 UTC m=+28.634425992" watchObservedRunningTime="2026-09-11 15:09:14.215489188 +0000 UTC m=+28.675206188"
Sep 11 15:09:14.988393 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:14.988369    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:14.988512 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:14.988484    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:09:15.149185 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:15.149153    2574 generic.go:356] "Generic (PLEG): container finished" podID="b770d260-7414-4aa1-b96e-ca8e653982f7" containerID="83df6099790ff0d066deeab74ec1ce0b2d2cac2a0d118290f3c6773704e6cc55" exitCode=0
Sep 11 15:09:15.149565 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:15.149210    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlqk7" event={"ID":"b770d260-7414-4aa1-b96e-ca8e653982f7","Type":"ContainerDied","Data":"83df6099790ff0d066deeab74ec1ce0b2d2cac2a0d118290f3c6773704e6cc55"}
Sep 11 15:09:15.149669 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:15.149650    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:09:15.149724 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:15.149713    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:09:15.165888 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:15.165868    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:09:15.261356 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:15.261274    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxztz"]
Sep 11 15:09:15.261499 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:15.261418    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:15.261558 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:15.261529    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:09:15.264353 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:15.264327    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-564ps"]
Sep 11 15:09:15.264485 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:15.264418    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:15.264533 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:15.264509    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:09:15.265066 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:15.265040    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ptqp9"]
Sep 11 15:09:15.265174 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:15.265136    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:15.265256 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:15.265235    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:09:16.153952 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:16.153873    2574 generic.go:356] "Generic (PLEG): container finished" podID="b770d260-7414-4aa1-b96e-ca8e653982f7" containerID="db86874d79eed5a1821cb06a59ad5ba3562246e5f1b50ae78cb891af850d4583" exitCode=0
Sep 11 15:09:16.154268 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:16.153958    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlqk7" event={"ID":"b770d260-7414-4aa1-b96e-ca8e653982f7","Type":"ContainerDied","Data":"db86874d79eed5a1821cb06a59ad5ba3562246e5f1b50ae78cb891af850d4583"}
Sep 11 15:09:16.989112 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:16.989031    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:16.989112 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:16.989062    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:16.989301 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:16.989183    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:16.989469 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:16.989443    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:09:16.989535 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:16.989453    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:09:16.989535 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:16.989525    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:09:18.988270 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:18.988237    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:18.988270 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:18.988265    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:18.988927 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:18.988237    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:18.988927 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:18.988352    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:09:18.988927 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:18.988430    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:09:18.988927 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:18.988513    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:09:19.753805 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:19.753714    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:19.753805 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:19.753803    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:19.754006 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:19.753831    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrxdv\" (UniqueName: \"kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv\") pod \"network-check-target-ptqp9\" (UID: \"03f436e2-eb76-41e5-83e5-8e5ea522044c\") " pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:19.754006 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:19.753890    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 15:09:19.754006 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:19.753951    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:09:19.754006 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:19.753963    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret podName:0163d627-b988-4307-a7df-d5c3971306ff nodeName:}" failed. No retries permitted until 2026-09-11 15:09:51.753947311 +0000 UTC m=+66.213664289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret") pod "global-pull-secret-syncer-564ps" (UID: "0163d627-b988-4307-a7df-d5c3971306ff") : object "kube-system"/"original-pull-secret" not registered
Sep 11 15:09:19.754006 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:19.753969    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 15:09:19.754006 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:19.753985    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 15:09:19.754006 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:19.753996    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wrxdv for pod openshift-network-diagnostics/network-check-target-ptqp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:09:19.754006 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:19.754007    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs podName:91cc8492-8379-4837-a063-561240230e70 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:51.75399016 +0000 UTC m=+66.213707152 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs") pod "network-metrics-daemon-rxztz" (UID: "91cc8492-8379-4837-a063-561240230e70") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 15:09:19.754255 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:19.754029    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv podName:03f436e2-eb76-41e5-83e5-8e5ea522044c nodeName:}" failed. No retries permitted until 2026-09-11 15:09:51.754019436 +0000 UTC m=+66.213736415 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrxdv" (UniqueName: "kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv") pod "network-check-target-ptqp9" (UID: "03f436e2-eb76-41e5-83e5-8e5ea522044c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 15:09:20.988610 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:20.988540    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:20.988983 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:20.988547    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:20.988983 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:20.988657    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptqp9" podUID="03f436e2-eb76-41e5-83e5-8e5ea522044c"
Sep 11 15:09:20.988983 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:20.988731    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:20.988983 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:20.988719    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxztz" podUID="91cc8492-8379-4837-a063-561240230e70"
Sep 11 15:09:20.988983 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:20.988794    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-564ps" podUID="0163d627-b988-4307-a7df-d5c3971306ff"
Sep 11 15:09:21.384185 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.384156    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-215.ec2.internal" event="NodeReady"
Sep 11 15:09:21.384345 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.384329    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 15:09:21.431803 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.431774    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4cjxh"]
Sep 11 15:09:21.442455 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.442430    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m99lc"]
Sep 11 15:09:21.442601 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.442585    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:21.445180 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.445135    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 15:09:21.445180 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.445135    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 15:09:21.445488 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.445469    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zldr7\""
Sep 11 15:09:21.456098 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.456080    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4cjxh"]
Sep 11 15:09:21.456183 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.456108    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m99lc"]
Sep 11 15:09:21.456220 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.456182    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m99lc"
Sep 11 15:09:21.460947 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.460929    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 15:09:21.461066 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.460989    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 15:09:21.461066 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.461043    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6rfh2\""
Sep 11 15:09:21.461066 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.461061    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 15:09:21.567634 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.567523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:21.567634 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.567572    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dff78c9-a59f-45c1-90ff-98e020990538-tmp-dir\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:21.567634 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.567592    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x9qn\" (UniqueName: \"kubernetes.io/projected/226b5e7c-1a27-4c4d-a559-eb75e44a6d52-kube-api-access-8x9qn\") pod \"ingress-canary-m99lc\" (UID: \"226b5e7c-1a27-4c4d-a559-eb75e44a6d52\") " pod="openshift-ingress-canary/ingress-canary-m99lc"
Sep 11 15:09:21.567845 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.567693    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dff78c9-a59f-45c1-90ff-98e020990538-config-volume\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:21.567845 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.567740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pshfq\" (UniqueName: \"kubernetes.io/projected/5dff78c9-a59f-45c1-90ff-98e020990538-kube-api-access-pshfq\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:21.567845 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.567780    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/226b5e7c-1a27-4c4d-a559-eb75e44a6d52-cert\") pod \"ingress-canary-m99lc\" (UID: \"226b5e7c-1a27-4c4d-a559-eb75e44a6d52\") " pod="openshift-ingress-canary/ingress-canary-m99lc"
Sep 11 15:09:21.582174 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.582147    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ktskk"]
Sep 11 15:09:21.604052 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.604026    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ktskk"]
Sep 11 15:09:21.604169 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.604118    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ktskk"
Sep 11 15:09:21.606605 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.606586    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rnvl2\""
Sep 11 15:09:21.606605 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.606590    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 15:09:21.606899 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.606643    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 15:09:21.668497 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.668471    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:21.668704 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.668517    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dff78c9-a59f-45c1-90ff-98e020990538-tmp-dir\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:21.668704 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.668536    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9qn\" (UniqueName: \"kubernetes.io/projected/226b5e7c-1a27-4c4d-a559-eb75e44a6d52-kube-api-access-8x9qn\") pod \"ingress-canary-m99lc\" (UID: \"226b5e7c-1a27-4c4d-a559-eb75e44a6d52\") " pod="openshift-ingress-canary/ingress-canary-m99lc"
Sep 11 15:09:21.668704 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.668558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dff78c9-a59f-45c1-90ff-98e020990538-config-volume\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:21.668704 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.668581    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pshfq\" (UniqueName: \"kubernetes.io/projected/5dff78c9-a59f-45c1-90ff-98e020990538-kube-api-access-pshfq\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:21.668704 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.668604    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/226b5e7c-1a27-4c4d-a559-eb75e44a6d52-cert\") pod \"ingress-canary-m99lc\" (UID: \"226b5e7c-1a27-4c4d-a559-eb75e44a6d52\") " pod="openshift-ingress-canary/ingress-canary-m99lc"
Sep 11 15:09:21.668704 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:21.668656    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 15:09:21.669149 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:21.668787    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls podName:5dff78c9-a59f-45c1-90ff-98e020990538 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:22.168758246 +0000 UTC m=+36.628475238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls") pod "dns-default-4cjxh" (UID: "5dff78c9-a59f-45c1-90ff-98e020990538") : secret "dns-default-metrics-tls" not found
Sep 11 15:09:21.669149 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.668965    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dff78c9-a59f-45c1-90ff-98e020990538-tmp-dir\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:21.669287 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.669265    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dff78c9-a59f-45c1-90ff-98e020990538-config-volume\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:21.673141 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.673119    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/226b5e7c-1a27-4c4d-a559-eb75e44a6d52-cert\") pod \"ingress-canary-m99lc\" (UID: \"226b5e7c-1a27-4c4d-a559-eb75e44a6d52\") " pod="openshift-ingress-canary/ingress-canary-m99lc"
Sep 11 15:09:21.673473 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.673454    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-22ppp"]
Sep 11 15:09:21.682884 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.682863    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pshfq\" (UniqueName: \"kubernetes.io/projected/5dff78c9-a59f-45c1-90ff-98e020990538-kube-api-access-pshfq\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:21.686851 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.686831    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x9qn\" (UniqueName: \"kubernetes.io/projected/226b5e7c-1a27-4c4d-a559-eb75e44a6d52-kube-api-access-8x9qn\") pod \"ingress-canary-m99lc\" (UID: \"226b5e7c-1a27-4c4d-a559-eb75e44a6d52\") " pod="openshift-ingress-canary/ingress-canary-m99lc"
Sep 11 15:09:21.696087 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.696067    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5ff9ffd588-8d7t4"]
Sep 11 15:09:21.696207 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.696192    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.698513 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.698497    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 15:09:21.698664 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.698640    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 15:09:21.698664 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.698649    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 15:09:21.698886 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.698872    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 15:09:21.699054 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.699031    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rnfv7\""
Sep 11 15:09:21.707312 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.707295    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 15:09:21.714158 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.714141    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-22ppp"]
Sep 11 15:09:21.714236 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.714168    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5ff9ffd588-8d7t4"]
Sep 11 15:09:21.714289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.714243    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.716695 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.716674    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 15:09:21.716774 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.716692    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 15:09:21.716774 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.716713    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 15:09:21.716774 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.716729    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 15:09:21.716932 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.716839    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 15:09:21.717044 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.717024    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 15:09:21.717044 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.717040    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wcd7v\""
Sep 11 15:09:21.763543 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.763514    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m99lc"
Sep 11 15:09:21.769857 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.769837    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2n88\" (UniqueName: \"kubernetes.io/projected/4ba73a4b-2fd0-48c5-9968-bf039932ca57-kube-api-access-b2n88\") pod \"volume-data-source-validator-86695b7cc7-ktskk\" (UID: \"4ba73a4b-2fd0-48c5-9968-bf039932ca57\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ktskk"
Sep 11 15:09:21.871379 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.871343    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.871509 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.871409    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d909c90-2653-4d91-a82c-4774d65db370-tmp\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.871509 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.871442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d909c90-2653-4d91-a82c-4774d65db370-trusted-ca-bundle\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.871644 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.871517    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-default-certificate\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.871644 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.871556    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.871644 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.871585    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j9vd\" (UniqueName: \"kubernetes.io/projected/92321919-f0c2-4635-a454-4601466d148b-kube-api-access-5j9vd\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.871786 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.871649    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2n88\" (UniqueName: \"kubernetes.io/projected/4ba73a4b-2fd0-48c5-9968-bf039932ca57-kube-api-access-b2n88\") pod \"volume-data-source-validator-86695b7cc7-ktskk\" (UID: \"4ba73a4b-2fd0-48c5-9968-bf039932ca57\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ktskk"
Sep 11 15:09:21.871786 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.871686    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6d909c90-2653-4d91-a82c-4774d65db370-snapshots\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.871786 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.871711    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lnkj\" (UniqueName: \"kubernetes.io/projected/6d909c90-2653-4d91-a82c-4774d65db370-kube-api-access-5lnkj\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.871786 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.871750    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d909c90-2653-4d91-a82c-4774d65db370-serving-cert\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.871968 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.871910    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d909c90-2653-4d91-a82c-4774d65db370-service-ca-bundle\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.872049 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.871963    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-stats-auth\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.880404 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.880379    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2n88\" (UniqueName: \"kubernetes.io/projected/4ba73a4b-2fd0-48c5-9968-bf039932ca57-kube-api-access-b2n88\") pod \"volume-data-source-validator-86695b7cc7-ktskk\" (UID: \"4ba73a4b-2fd0-48c5-9968-bf039932ca57\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ktskk"
Sep 11 15:09:21.912353 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.912333    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ktskk"
Sep 11 15:09:21.973290 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.973109    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d909c90-2653-4d91-a82c-4774d65db370-serving-cert\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.973427 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.973317    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d909c90-2653-4d91-a82c-4774d65db370-service-ca-bundle\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.973427 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.973358    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-stats-auth\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.973427 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.973396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.973427 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.973421    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d909c90-2653-4d91-a82c-4774d65db370-tmp\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.973643 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.973436    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d909c90-2653-4d91-a82c-4774d65db370-trusted-ca-bundle\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.973643 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.973452    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-default-certificate\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.973643 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.973480    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.973643 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.973503    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j9vd\" (UniqueName: \"kubernetes.io/projected/92321919-f0c2-4635-a454-4601466d148b-kube-api-access-5j9vd\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.973643 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.973544    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6d909c90-2653-4d91-a82c-4774d65db370-snapshots\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.973886 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:21.973693    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 15:09:21.973886 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:21.973768    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs podName:92321919-f0c2-4635-a454-4601466d148b nodeName:}" failed. No retries permitted until 2026-09-11 15:09:22.473747827 +0000 UTC m=+36.933464805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs") pod "router-default-5ff9ffd588-8d7t4" (UID: "92321919-f0c2-4635-a454-4601466d148b") : secret "router-metrics-certs-default" not found
Sep 11 15:09:21.973886 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.973821    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d909c90-2653-4d91-a82c-4774d65db370-tmp\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.974073 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.974048    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d909c90-2653-4d91-a82c-4774d65db370-service-ca-bundle\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.974134 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.974052    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lnkj\" (UniqueName: \"kubernetes.io/projected/6d909c90-2653-4d91-a82c-4774d65db370-kube-api-access-5lnkj\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.974134 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:21.974060    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle podName:92321919-f0c2-4635-a454-4601466d148b nodeName:}" failed. No retries permitted until 2026-09-11 15:09:22.474040561 +0000 UTC m=+36.933757560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle") pod "router-default-5ff9ffd588-8d7t4" (UID: "92321919-f0c2-4635-a454-4601466d148b") : configmap references non-existent config key: service-ca.crt
Sep 11 15:09:21.974390 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.974356    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d909c90-2653-4d91-a82c-4774d65db370-trusted-ca-bundle\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.974534 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.974513    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6d909c90-2653-4d91-a82c-4774d65db370-snapshots\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.976216 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.976193    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-default-certificate\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.976296 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.976191    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-stats-auth\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.976500 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.976480    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d909c90-2653-4d91-a82c-4774d65db370-serving-cert\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:21.986214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.986186    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j9vd\" (UniqueName: \"kubernetes.io/projected/92321919-f0c2-4635-a454-4601466d148b-kube-api-access-5j9vd\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:21.988087 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:21.986799    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lnkj\" (UniqueName: \"kubernetes.io/projected/6d909c90-2653-4d91-a82c-4774d65db370-kube-api-access-5lnkj\") pod \"insights-operator-5844b856db-22ppp\" (UID: \"6d909c90-2653-4d91-a82c-4774d65db370\") " pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:22.008535 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.008501    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-22ppp"
Sep 11 15:09:22.078568 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.078537    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m99lc"]
Sep 11 15:09:22.082640 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:09:22.082593    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226b5e7c_1a27_4c4d_a559_eb75e44a6d52.slice/crio-6c9bfe75d68990abbd8be4d342d1d3c909f3dfbe847851ff5e2eeb2f0f80d6bd WatchSource:0}: Error finding container 6c9bfe75d68990abbd8be4d342d1d3c909f3dfbe847851ff5e2eeb2f0f80d6bd: Status 404 returned error can't find the container with id 6c9bfe75d68990abbd8be4d342d1d3c909f3dfbe847851ff5e2eeb2f0f80d6bd
Sep 11 15:09:22.169224 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.169196    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m99lc" event={"ID":"226b5e7c-1a27-4c4d-a559-eb75e44a6d52","Type":"ContainerStarted","Data":"6c9bfe75d68990abbd8be4d342d1d3c909f3dfbe847851ff5e2eeb2f0f80d6bd"}
Sep 11 15:09:22.172068 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.172045    2574 generic.go:356] "Generic (PLEG): container finished" podID="b770d260-7414-4aa1-b96e-ca8e653982f7" containerID="5b1b0d4ca76106a1f406fe7f5377b31c1c993b97924fa55a156fa395c8d60cf8" exitCode=0
Sep 11 15:09:22.172184 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.172103    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlqk7" event={"ID":"b770d260-7414-4aa1-b96e-ca8e653982f7","Type":"ContainerDied","Data":"5b1b0d4ca76106a1f406fe7f5377b31c1c993b97924fa55a156fa395c8d60cf8"}
Sep 11 15:09:22.175464 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.175439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:22.175564 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:22.175541    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 15:09:22.175664 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:22.175595    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls podName:5dff78c9-a59f-45c1-90ff-98e020990538 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:23.17557925 +0000 UTC m=+37.635296237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls") pod "dns-default-4cjxh" (UID: "5dff78c9-a59f-45c1-90ff-98e020990538") : secret "dns-default-metrics-tls" not found
Sep 11 15:09:22.202979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.202955    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ktskk"]
Sep 11 15:09:22.206047 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:09:22.206028    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba73a4b_2fd0_48c5_9968_bf039932ca57.slice/crio-434f4f4c265000d2b4b06337272b2c331585370be139f63dcd7661d070ba6934 WatchSource:0}: Error finding container 434f4f4c265000d2b4b06337272b2c331585370be139f63dcd7661d070ba6934: Status 404 returned error can't find the container with id 434f4f4c265000d2b4b06337272b2c331585370be139f63dcd7661d070ba6934
Sep 11 15:09:22.291984 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.291961    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-22ppp"]
Sep 11 15:09:22.295052 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:09:22.295020    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d909c90_2653_4d91_a82c_4774d65db370.slice/crio-3aff173f0618454fd9bd836013ecd35188a9d171a217cea345378b65800d4ed4 WatchSource:0}: Error finding container 3aff173f0618454fd9bd836013ecd35188a9d171a217cea345378b65800d4ed4: Status 404 returned error can't find the container with id 3aff173f0618454fd9bd836013ecd35188a9d171a217cea345378b65800d4ed4
Sep 11 15:09:22.478317 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.478224    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:22.478317 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.478279    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:22.478484 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:22.478397    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle podName:92321919-f0c2-4635-a454-4601466d148b nodeName:}" failed. No retries permitted until 2026-09-11 15:09:23.478379445 +0000 UTC m=+37.938096428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle") pod "router-default-5ff9ffd588-8d7t4" (UID: "92321919-f0c2-4635-a454-4601466d148b") : configmap references non-existent config key: service-ca.crt
Sep 11 15:09:22.478484 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:22.478400    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 15:09:22.478484 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:22.478438    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs podName:92321919-f0c2-4635-a454-4601466d148b nodeName:}" failed. No retries permitted until 2026-09-11 15:09:23.478431183 +0000 UTC m=+37.938148160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs") pod "router-default-5ff9ffd588-8d7t4" (UID: "92321919-f0c2-4635-a454-4601466d148b") : secret "router-metrics-certs-default" not found
Sep 11 15:09:22.988680 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.988649    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:22.988851 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.988777    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:22.988919 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.988655    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:22.992392 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.992369    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 15:09:22.992596 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.992579    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 15:09:22.992817 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.992799    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2f6h7\""
Sep 11 15:09:22.994077 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.993020    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 15:09:22.994077 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.993169    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 15:09:22.994077 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:22.993306    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4h8rg\""
Sep 11 15:09:23.176993 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.176950    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ktskk" event={"ID":"4ba73a4b-2fd0-48c5-9968-bf039932ca57","Type":"ContainerStarted","Data":"434f4f4c265000d2b4b06337272b2c331585370be139f63dcd7661d070ba6934"}
Sep 11 15:09:23.184189 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.184158    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:23.184359 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:23.184320    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 15:09:23.184462 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:23.184377    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls podName:5dff78c9-a59f-45c1-90ff-98e020990538 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:25.184358729 +0000 UTC m=+39.644075721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls") pod "dns-default-4cjxh" (UID: "5dff78c9-a59f-45c1-90ff-98e020990538") : secret "dns-default-metrics-tls" not found
Sep 11 15:09:23.185247 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.185219    2574 generic.go:356] "Generic (PLEG): container finished" podID="b770d260-7414-4aa1-b96e-ca8e653982f7" containerID="0ea6d4da7229aa8e7bd81925626ad3bd652755b515f0094a6ae69aab7af087a6" exitCode=0
Sep 11 15:09:23.185526 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.185493    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlqk7" event={"ID":"b770d260-7414-4aa1-b96e-ca8e653982f7","Type":"ContainerDied","Data":"0ea6d4da7229aa8e7bd81925626ad3bd652755b515f0094a6ae69aab7af087a6"}
Sep 11 15:09:23.187033 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.186995    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-22ppp" event={"ID":"6d909c90-2653-4d91-a82c-4774d65db370","Type":"ContainerStarted","Data":"3aff173f0618454fd9bd836013ecd35188a9d171a217cea345378b65800d4ed4"}
Sep 11 15:09:23.485019 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.484988    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-qm4lg"]
Sep 11 15:09:23.487114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.487081    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:23.487242 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.487144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:23.487310 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:23.487255    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle podName:92321919-f0c2-4635-a454-4601466d148b nodeName:}" failed. No retries permitted until 2026-09-11 15:09:25.487231626 +0000 UTC m=+39.946948621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle") pod "router-default-5ff9ffd588-8d7t4" (UID: "92321919-f0c2-4635-a454-4601466d148b") : configmap references non-existent config key: service-ca.crt
Sep 11 15:09:23.487310 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:23.487264    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 15:09:23.487474 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:23.487313    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs podName:92321919-f0c2-4635-a454-4601466d148b nodeName:}" failed. No retries permitted until 2026-09-11 15:09:25.487299018 +0000 UTC m=+39.947016010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs") pod "router-default-5ff9ffd588-8d7t4" (UID: "92321919-f0c2-4635-a454-4601466d148b") : secret "router-metrics-certs-default" not found
Sep 11 15:09:23.498930 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.498905    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-qm4lg"]
Sep 11 15:09:23.499071 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.499002    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-qm4lg"
Sep 11 15:09:23.501755 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.501530    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cttfp\""
Sep 11 15:09:23.588020 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.587985    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlvvx\" (UniqueName: \"kubernetes.io/projected/b60ea4cf-2628-4872-bb6d-681fe7421d6e-kube-api-access-hlvvx\") pod \"network-check-source-6f8b768455-qm4lg\" (UID: \"b60ea4cf-2628-4872-bb6d-681fe7421d6e\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-qm4lg"
Sep 11 15:09:23.689435 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.689211    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlvvx\" (UniqueName: \"kubernetes.io/projected/b60ea4cf-2628-4872-bb6d-681fe7421d6e-kube-api-access-hlvvx\") pod \"network-check-source-6f8b768455-qm4lg\" (UID: \"b60ea4cf-2628-4872-bb6d-681fe7421d6e\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-qm4lg"
Sep 11 15:09:23.699801 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.699739    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlvvx\" (UniqueName: \"kubernetes.io/projected/b60ea4cf-2628-4872-bb6d-681fe7421d6e-kube-api-access-hlvvx\") pod \"network-check-source-6f8b768455-qm4lg\" (UID: \"b60ea4cf-2628-4872-bb6d-681fe7421d6e\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-qm4lg"
Sep 11 15:09:23.812243 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:23.812166    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-qm4lg"
Sep 11 15:09:24.191899 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:24.191868    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ktskk" event={"ID":"4ba73a4b-2fd0-48c5-9968-bf039932ca57","Type":"ContainerStarted","Data":"6d4aa48a1bc8ef04c1497154d6f8c8c989f7e24355c4aa8493c9502363784203"}
Sep 11 15:09:24.196155 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:24.196127    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlqk7" event={"ID":"b770d260-7414-4aa1-b96e-ca8e653982f7","Type":"ContainerStarted","Data":"3318972b1c9b3a92c8c56ea8636bbb504a830805bb55e842f840bb1ac7d6463a"}
Sep 11 15:09:24.207870 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:24.207819    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ktskk" podStartSLOduration=1.92614309 podStartE2EDuration="3.207803177s" totalImagesPullingTime="1.281660087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:24.206583385 +0000 UTC m=+38.666300385" watchObservedRunningTime="2026-09-11 15:09:24.207803177 +0000 UTC m=+38.667520348"
Sep 11 15:09:24.233770 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:24.233714    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mlqk7" podStartSLOduration=7.993565309 podStartE2EDuration="38.233691874s" totalImagesPullingTime="30.240126565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:08:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:24.231206954 +0000 UTC m=+38.690923956" watchObservedRunningTime="2026-09-11 15:09:24.233691874 +0000 UTC m=+38.693408875"
Sep 11 15:09:25.201159 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:25.201133    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:25.201520 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:25.201280    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 15:09:25.201520 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:25.201341    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls podName:5dff78c9-a59f-45c1-90ff-98e020990538 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:29.201325619 +0000 UTC m=+43.661042598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls") pod "dns-default-4cjxh" (UID: "5dff78c9-a59f-45c1-90ff-98e020990538") : secret "dns-default-metrics-tls" not found
Sep 11 15:09:25.504528 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:25.504449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:25.504528 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:25.504498    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:25.504720 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:25.504603    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 15:09:25.504720 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:25.504607    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle podName:92321919-f0c2-4635-a454-4601466d148b nodeName:}" failed. No retries permitted until 2026-09-11 15:09:29.504590154 +0000 UTC m=+43.964307131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle") pod "router-default-5ff9ffd588-8d7t4" (UID: "92321919-f0c2-4635-a454-4601466d148b") : configmap references non-existent config key: service-ca.crt
Sep 11 15:09:25.504720 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:25.504701    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs podName:92321919-f0c2-4635-a454-4601466d148b nodeName:}" failed. No retries permitted until 2026-09-11 15:09:29.504681418 +0000 UTC m=+43.964398403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs") pod "router-default-5ff9ffd588-8d7t4" (UID: "92321919-f0c2-4635-a454-4601466d148b") : secret "router-metrics-certs-default" not found
Sep 11 15:09:25.827869 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:25.827539    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-qm4lg"]
Sep 11 15:09:25.830534 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:09:25.830505    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60ea4cf_2628_4872_bb6d_681fe7421d6e.slice/crio-2562bec6cfe56a639f077c8013953087884f7cb3bb9660aec129bcec121c4ce2 WatchSource:0}: Error finding container 2562bec6cfe56a639f077c8013953087884f7cb3bb9660aec129bcec121c4ce2: Status 404 returned error can't find the container with id 2562bec6cfe56a639f077c8013953087884f7cb3bb9660aec129bcec121c4ce2
Sep 11 15:09:25.923129 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:25.923098    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-h9rf7"]
Sep 11 15:09:25.952080 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:25.952030    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-h9rf7"]
Sep 11 15:09:25.952229 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:25.952146    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-h9rf7"
Sep 11 15:09:25.954938 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:25.954908    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7pvp6\""
Sep 11 15:09:25.955267 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:25.955250    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 15:09:25.956118 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:25.955956    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 15:09:26.110634 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.110525    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v75jv\" (UniqueName: \"kubernetes.io/projected/5745c1b2-45ad-4f40-a7e3-94121b52cec9-kube-api-access-v75jv\") pod \"migrator-8b4d697c5-h9rf7\" (UID: \"5745c1b2-45ad-4f40-a7e3-94121b52cec9\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-h9rf7"
Sep 11 15:09:26.201798 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.201759    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-qm4lg" event={"ID":"b60ea4cf-2628-4872-bb6d-681fe7421d6e","Type":"ContainerStarted","Data":"2562bec6cfe56a639f077c8013953087884f7cb3bb9660aec129bcec121c4ce2"}
Sep 11 15:09:26.203306 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.203278    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-22ppp" event={"ID":"6d909c90-2653-4d91-a82c-4774d65db370","Type":"ContainerStarted","Data":"0110027a88833ea5404e6f759f620c76b211bc258e2b1dc32b2df8f6e6842703"}
Sep 11 15:09:26.204834 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.204813    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m99lc" event={"ID":"226b5e7c-1a27-4c4d-a559-eb75e44a6d52","Type":"ContainerStarted","Data":"dad3e3a7f5424a0de6fe18c4e1d1ff3ea995ab2784a141154475bf116dd3c02f"}
Sep 11 15:09:26.211387 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.211370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v75jv\" (UniqueName: \"kubernetes.io/projected/5745c1b2-45ad-4f40-a7e3-94121b52cec9-kube-api-access-v75jv\") pod \"migrator-8b4d697c5-h9rf7\" (UID: \"5745c1b2-45ad-4f40-a7e3-94121b52cec9\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-h9rf7"
Sep 11 15:09:26.218703 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.218599    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-22ppp" podStartSLOduration=1.949613689 podStartE2EDuration="5.218582178s" totalImagesPullingTime="3.268968489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:26.218149606 +0000 UTC m=+40.677866609" watchObservedRunningTime="2026-09-11 15:09:26.218582178 +0000 UTC m=+40.678299179"
Sep 11 15:09:26.222807 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.222788    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v75jv\" (UniqueName: \"kubernetes.io/projected/5745c1b2-45ad-4f40-a7e3-94121b52cec9-kube-api-access-v75jv\") pod \"migrator-8b4d697c5-h9rf7\" (UID: \"5745c1b2-45ad-4f40-a7e3-94121b52cec9\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-h9rf7"
Sep 11 15:09:26.232578 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.232528    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m99lc" podStartSLOduration=1.7559698990000001 podStartE2EDuration="5.23250929s" totalImagesPullingTime="3.476539391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:26.232233881 +0000 UTC m=+40.691950883" watchObservedRunningTime="2026-09-11 15:09:26.23250929 +0000 UTC m=+40.692226291"
Sep 11 15:09:26.262449 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.262424    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-h9rf7"
Sep 11 15:09:26.529985 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.529955    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lh82f"]
Sep 11 15:09:26.557063 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.557033    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.559924 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.559897    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cr68x\""
Sep 11 15:09:26.560216 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.560198    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 15:09:26.560531 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.560510    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 15:09:26.572137 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.572109    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lh82f"]
Sep 11 15:09:26.581991 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.581966    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-h9rf7"]
Sep 11 15:09:26.585410 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:09:26.585378    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5745c1b2_45ad_4f40_a7e3_94121b52cec9.slice/crio-837490075e0324c161cbc71286e46664b048c82fcb66ccdb1ffa3b77f5ea9724 WatchSource:0}: Error finding container 837490075e0324c161cbc71286e46664b048c82fcb66ccdb1ffa3b77f5ea9724: Status 404 returned error can't find the container with id 837490075e0324c161cbc71286e46664b048c82fcb66ccdb1ffa3b77f5ea9724
Sep 11 15:09:26.715424 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.715390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbb82\" (UniqueName: \"kubernetes.io/projected/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-api-access-sbb82\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.715604 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.715469    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.715604 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.715535    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-data-volume\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.715731 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.715604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-crio-socket\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.715731 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.715647    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.816958 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.816873    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbb82\" (UniqueName: \"kubernetes.io/projected/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-api-access-sbb82\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.817109 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.816986    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.817109 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.817021    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-data-volume\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.817109 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.817046    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-crio-socket\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.817109 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.817072    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.817302 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:26.817123    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 15:09:26.817302 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:26.817178    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 15:09:26.817302 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:26.817186    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm podName:752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:27.317167772 +0000 UTC m=+41.776884749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lh82f" (UID: "752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8") : configmap "kube-rbac-proxy" not found
Sep 11 15:09:26.817302 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:26.817211    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls podName:752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:27.317201262 +0000 UTC m=+41.776918255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lh82f" (UID: "752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8") : secret "insights-runtime-extractor-tls" not found
Sep 11 15:09:26.817473 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.817354    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-crio-socket\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.817473 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.817368    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-data-volume\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:26.825482 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:26.825455    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbb82\" (UniqueName: \"kubernetes.io/projected/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-api-access-sbb82\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:27.209035 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:27.208998    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-h9rf7" event={"ID":"5745c1b2-45ad-4f40-a7e3-94121b52cec9","Type":"ContainerStarted","Data":"837490075e0324c161cbc71286e46664b048c82fcb66ccdb1ffa3b77f5ea9724"}
Sep 11 15:09:27.321796 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:27.321753    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:27.322175 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:27.321958    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:27.322175 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:27.322053    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 15:09:27.322175 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:27.322121    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls podName:752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:28.322100046 +0000 UTC m=+42.781817043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lh82f" (UID: "752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8") : secret "insights-runtime-extractor-tls" not found
Sep 11 15:09:27.322700 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:27.322505    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 15:09:27.322778 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:27.322771    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm podName:752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:28.322734908 +0000 UTC m=+42.782451932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lh82f" (UID: "752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8") : configmap "kube-rbac-proxy" not found
Sep 11 15:09:28.332493 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:28.332450    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:28.332945 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:28.332560    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:28.332945 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:28.332658    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 15:09:28.332945 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:28.332669    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 15:09:28.332945 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:28.332746    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm podName:752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:30.332726664 +0000 UTC m=+44.792443665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lh82f" (UID: "752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8") : configmap "kube-rbac-proxy" not found
Sep 11 15:09:28.332945 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:28.332763    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls podName:752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:30.332756094 +0000 UTC m=+44.792473071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lh82f" (UID: "752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8") : secret "insights-runtime-extractor-tls" not found
Sep 11 15:09:29.090575 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:29.090543    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6hhmc_2608766e-f60a-4e61-846a-4f569aab6e5b/dns-node-resolver/0.log"
Sep 11 15:09:29.238934 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:29.238904    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:29.239084 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:29.239010    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 15:09:29.239084 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:29.239064    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls podName:5dff78c9-a59f-45c1-90ff-98e020990538 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:37.239052057 +0000 UTC m=+51.698769035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls") pod "dns-default-4cjxh" (UID: "5dff78c9-a59f-45c1-90ff-98e020990538") : secret "dns-default-metrics-tls" not found
Sep 11 15:09:29.540795 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:29.540761    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:29.541185 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:29.540812    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:29.541185 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:29.540940    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 15:09:29.541185 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:29.540946    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle podName:92321919-f0c2-4635-a454-4601466d148b nodeName:}" failed. No retries permitted until 2026-09-11 15:09:37.540926987 +0000 UTC m=+52.000643969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle") pod "router-default-5ff9ffd588-8d7t4" (UID: "92321919-f0c2-4635-a454-4601466d148b") : configmap references non-existent config key: service-ca.crt
Sep 11 15:09:29.541185 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:29.540979    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs podName:92321919-f0c2-4635-a454-4601466d148b nodeName:}" failed. No retries permitted until 2026-09-11 15:09:37.540967645 +0000 UTC m=+52.000684622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs") pod "router-default-5ff9ffd588-8d7t4" (UID: "92321919-f0c2-4635-a454-4601466d148b") : secret "router-metrics-certs-default" not found
Sep 11 15:09:30.219301 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:30.219268    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-qm4lg" event={"ID":"b60ea4cf-2628-4872-bb6d-681fe7421d6e","Type":"ContainerStarted","Data":"8e3ff9d2e89a4890de61078ba8522ab4d58d9a0d5407735c365477811f1ac9c9"}
Sep 11 15:09:30.221103 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:30.221079    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-h9rf7" event={"ID":"5745c1b2-45ad-4f40-a7e3-94121b52cec9","Type":"ContainerStarted","Data":"518af5d8537b490d84ca40b14024fe31d68349861b58955c0fba908921ff8696"}
Sep 11 15:09:30.221222 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:30.221125    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-h9rf7" event={"ID":"5745c1b2-45ad-4f40-a7e3-94121b52cec9","Type":"ContainerStarted","Data":"a5537c627bf8784c43b712ab0d85b334dffcc48799f4569ba2c2b282b0c53337"}
Sep 11 15:09:30.237841 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:30.237798    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-qm4lg" podStartSLOduration=3.373849037 podStartE2EDuration="7.237785134s" totalImagesPullingTime="3.863936097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:30.236835663 +0000 UTC m=+44.696552664" watchObservedRunningTime="2026-09-11 15:09:30.237785134 +0000 UTC m=+44.697502140"
Sep 11 15:09:30.256989 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:30.256950    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-h9rf7" podStartSLOduration=2.157048533 podStartE2EDuration="5.256937603s" totalImagesPullingTime="3.09988907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:30.25582194 +0000 UTC m=+44.715538939" watchObservedRunningTime="2026-09-11 15:09:30.256937603 +0000 UTC m=+44.716654602"
Sep 11 15:09:30.291008 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:30.290984    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kbnd2_3185ded6-e599-494c-8445-ec7d3e8eb611/node-ca/0.log"
Sep 11 15:09:30.346541 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:30.346510    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:30.346758 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:30.346573    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:30.346758 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:30.346653    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 15:09:30.346758 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:30.346696    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 15:09:30.346758 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:30.346727    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm podName:752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:34.346705396 +0000 UTC m=+48.806422374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lh82f" (UID: "752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8") : configmap "kube-rbac-proxy" not found
Sep 11 15:09:30.346758 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:30.346749    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls podName:752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:34.346739381 +0000 UTC m=+48.806456361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lh82f" (UID: "752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8") : secret "insights-runtime-extractor-tls" not found
Sep 11 15:09:31.090466 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:31.090439    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m99lc_226b5e7c-1a27-4c4d-a559-eb75e44a6d52/serve-healthcheck-canary/0.log"
Sep 11 15:09:31.492747 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:31.492714    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-h9rf7_5745c1b2-45ad-4f40-a7e3-94121b52cec9/migrator/0.log"
Sep 11 15:09:31.691106 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:31.691079    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-h9rf7_5745c1b2-45ad-4f40-a7e3-94121b52cec9/graceful-termination/0.log"
Sep 11 15:09:34.376266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:34.376228    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:34.376711 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:34.376299    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:34.376711 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:34.376353    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 15:09:34.376711 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:34.376422    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm podName:752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:42.376406903 +0000 UTC m=+56.836123898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lh82f" (UID: "752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8") : configmap "kube-rbac-proxy" not found
Sep 11 15:09:34.376711 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:34.376439    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 15:09:34.376711 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:34.376490    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls podName:752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8 nodeName:}" failed. No retries permitted until 2026-09-11 15:09:42.376474446 +0000 UTC m=+56.836191429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lh82f" (UID: "752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8") : secret "insights-runtime-extractor-tls" not found
Sep 11 15:09:37.297710 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:37.297671    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:37.302922 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:37.302894    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dff78c9-a59f-45c1-90ff-98e020990538-metrics-tls\") pod \"dns-default-4cjxh\" (UID: \"5dff78c9-a59f-45c1-90ff-98e020990538\") " pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:37.352739 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:37.352700    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:37.600385 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:37.600302    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:37.600385 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:37.600357    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:37.600563 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:09:37.600473    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle podName:92321919-f0c2-4635-a454-4601466d148b nodeName:}" failed. No retries permitted until 2026-09-11 15:09:53.600454261 +0000 UTC m=+68.060171238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle") pod "router-default-5ff9ffd588-8d7t4" (UID: "92321919-f0c2-4635-a454-4601466d148b") : configmap references non-existent config key: service-ca.crt
Sep 11 15:09:37.602910 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:37.602884    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92321919-f0c2-4635-a454-4601466d148b-metrics-certs\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:37.642738 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:37.642707    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4cjxh"]
Sep 11 15:09:37.645829 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:09:37.645801    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dff78c9_a59f_45c1_90ff_98e020990538.slice/crio-40d6736f43adef3dfe2b84451da4888ffb85b2635c55bfccb256da5406ef8851 WatchSource:0}: Error finding container 40d6736f43adef3dfe2b84451da4888ffb85b2635c55bfccb256da5406ef8851: Status 404 returned error can't find the container with id 40d6736f43adef3dfe2b84451da4888ffb85b2635c55bfccb256da5406ef8851
Sep 11 15:09:38.246289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:38.246253    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4cjxh" event={"ID":"5dff78c9-a59f-45c1-90ff-98e020990538","Type":"ContainerStarted","Data":"40d6736f43adef3dfe2b84451da4888ffb85b2635c55bfccb256da5406ef8851"}
Sep 11 15:09:40.258083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:40.258048    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4cjxh" event={"ID":"5dff78c9-a59f-45c1-90ff-98e020990538","Type":"ContainerStarted","Data":"9e4962be38ba1a0762e82b8d4e3db3471c99ce8b6226e5d0f2b7b76f5988694d"}
Sep 11 15:09:40.258541 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:40.258106    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4cjxh" event={"ID":"5dff78c9-a59f-45c1-90ff-98e020990538","Type":"ContainerStarted","Data":"581c03247912f99243ed14c3aca076bad472e6c642fe329ca3dab70e65147b3c"}
Sep 11 15:09:40.258541 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:40.258179    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:40.279399 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:40.277259    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4cjxh" podStartSLOduration=17.370492962 podStartE2EDuration="19.277246719s" totalImagesPullingTime="1.906753757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:40.276798895 +0000 UTC m=+54.736515894" watchObservedRunningTime="2026-09-11 15:09:40.277246719 +0000 UTC m=+54.736963716"
Sep 11 15:09:42.440652 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:42.440599    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:42.441017 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:42.440705    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:42.441200 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:42.441184    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:42.443175 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:42.443154    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh82f\" (UID: \"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8\") " pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:42.468068 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:42.468046    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lh82f"
Sep 11 15:09:42.741308 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:42.741234    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lh82f"]
Sep 11 15:09:42.744500 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:09:42.744476    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod752cdc71_9e33_4ca8_b8fd_6aaba05d3ad8.slice/crio-e42f94068ce46c881b502f81dff0491ec46404ad9e73124de42582f802738f82 WatchSource:0}: Error finding container e42f94068ce46c881b502f81dff0491ec46404ad9e73124de42582f802738f82: Status 404 returned error can't find the container with id e42f94068ce46c881b502f81dff0491ec46404ad9e73124de42582f802738f82
Sep 11 15:09:43.274241 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:43.274205    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lh82f" event={"ID":"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8","Type":"ContainerStarted","Data":"c1754a6f16ab6e70ca10aab8e4333becf52b8d6f9dbe0b000e48654b1286ca12"}
Sep 11 15:09:43.274397 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:43.274282    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lh82f" event={"ID":"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8","Type":"ContainerStarted","Data":"e42f94068ce46c881b502f81dff0491ec46404ad9e73124de42582f802738f82"}
Sep 11 15:09:44.278784 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:44.278749    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lh82f" event={"ID":"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8","Type":"ContainerStarted","Data":"6cf3708c3a89baadd050201d291155453523bae4fad647aabfe5f315a851455d"}
Sep 11 15:09:46.287561 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:46.287525    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lh82f" event={"ID":"752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8","Type":"ContainerStarted","Data":"cb6c200c52306fe7458687f7d766bdb3a9f24e2cfe42f83ecff75fa4842d2aab"}
Sep 11 15:09:46.306499 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:46.306446    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lh82f" podStartSLOduration=17.487719863 podStartE2EDuration="20.306431771s" totalImagesPullingTime="2.818711908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:09:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:46.305238436 +0000 UTC m=+60.764955426" watchObservedRunningTime="2026-09-11 15:09:46.306431771 +0000 UTC m=+60.766148770"
Sep 11 15:09:47.167101 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:47.167074    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfscz"
Sep 11 15:09:48.777878 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.777845    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"]
Sep 11 15:09:48.781280 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.781260    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.784175 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.784153    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 15:09:48.784289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.784206    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 15:09:48.784344 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.784296    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 15:09:48.784548 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.784530    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 15:09:48.785329 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.785301    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 15:09:48.785430 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.785316    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 15:09:48.788157 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.788135    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 15:09:48.799414 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.799390    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"]
Sep 11 15:09:48.893215 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.893176    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/eb9fdf6b-0efb-4b81-b863-8d4f44144205-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.893215 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.893215    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtxdc\" (UniqueName: \"kubernetes.io/projected/eb9fdf6b-0efb-4b81-b863-8d4f44144205-kube-api-access-xtxdc\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.893464 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.893342    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb9fdf6b-0efb-4b81-b863-8d4f44144205-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.893464 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.893383    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/eb9fdf6b-0efb-4b81-b863-8d4f44144205-ca\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.893464 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.893412    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9fdf6b-0efb-4b81-b863-8d4f44144205-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.893464 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.893455    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/eb9fdf6b-0efb-4b81-b863-8d4f44144205-hub\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.994725 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.994685    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb9fdf6b-0efb-4b81-b863-8d4f44144205-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.994725 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.994728    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/eb9fdf6b-0efb-4b81-b863-8d4f44144205-ca\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.994967 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.994745    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9fdf6b-0efb-4b81-b863-8d4f44144205-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.994967 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.994877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/eb9fdf6b-0efb-4b81-b863-8d4f44144205-hub\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.994967 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.994935    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/eb9fdf6b-0efb-4b81-b863-8d4f44144205-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.994967 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.994964    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtxdc\" (UniqueName: \"kubernetes.io/projected/eb9fdf6b-0efb-4b81-b863-8d4f44144205-kube-api-access-xtxdc\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.995799 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.995773    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9fdf6b-0efb-4b81-b863-8d4f44144205-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.997783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.997760    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/eb9fdf6b-0efb-4b81-b863-8d4f44144205-ca\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.997880 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.997786    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/eb9fdf6b-0efb-4b81-b863-8d4f44144205-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.997919 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.997905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/eb9fdf6b-0efb-4b81-b863-8d4f44144205-hub\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:48.997919 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:48.997911    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb9fdf6b-0efb-4b81-b863-8d4f44144205-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:49.005293 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:49.005273    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtxdc\" (UniqueName: \"kubernetes.io/projected/eb9fdf6b-0efb-4b81-b863-8d4f44144205-kube-api-access-xtxdc\") pod \"cluster-proxy-proxy-agent-57768f5894-j26g5\" (UID: \"eb9fdf6b-0efb-4b81-b863-8d4f44144205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:49.103598 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:49.103512    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"
Sep 11 15:09:49.372711 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:49.372685    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5"]
Sep 11 15:09:49.375475 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:09:49.375443    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb9fdf6b_0efb_4b81_b863_8d4f44144205.slice/crio-a13210b3c2cef818c702154ba6c4100fe2537a7f158a3513b741b9c58767af99 WatchSource:0}: Error finding container a13210b3c2cef818c702154ba6c4100fe2537a7f158a3513b741b9c58767af99: Status 404 returned error can't find the container with id a13210b3c2cef818c702154ba6c4100fe2537a7f158a3513b741b9c58767af99
Sep 11 15:09:50.264586 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:50.264549    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4cjxh"
Sep 11 15:09:50.304606 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:50.304566    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5" event={"ID":"eb9fdf6b-0efb-4b81-b863-8d4f44144205","Type":"ContainerStarted","Data":"a13210b3c2cef818c702154ba6c4100fe2537a7f158a3513b741b9c58767af99"}
Sep 11 15:09:51.821085 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:51.821045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrxdv\" (UniqueName: \"kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv\") pod \"network-check-target-ptqp9\" (UID: \"03f436e2-eb76-41e5-83e5-8e5ea522044c\") " pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:51.821558 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:51.821107    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:51.821558 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:51.821142    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:51.823787 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:51.823765    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 15:09:51.824127 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:51.824104    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrxdv\" (UniqueName: \"kubernetes.io/projected/03f436e2-eb76-41e5-83e5-8e5ea522044c-kube-api-access-wrxdv\") pod \"network-check-target-ptqp9\" (UID: \"03f436e2-eb76-41e5-83e5-8e5ea522044c\") " pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:51.824600 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:51.824580    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 15:09:51.834076 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:51.834053    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cc8492-8379-4837-a063-561240230e70-metrics-certs\") pod \"network-metrics-daemon-rxztz\" (UID: \"91cc8492-8379-4837-a063-561240230e70\") " pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:51.834199 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:51.834113    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0163d627-b988-4307-a7df-d5c3971306ff-original-pull-secret\") pod \"global-pull-secret-syncer-564ps\" (UID: \"0163d627-b988-4307-a7df-d5c3971306ff\") " pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:52.105220 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:52.105126    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4h8rg\""
Sep 11 15:09:52.109469 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:52.109448    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-564ps"
Sep 11 15:09:52.113565 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:52.113543    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxztz"
Sep 11 15:09:52.119716 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:52.119692    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2f6h7\""
Sep 11 15:09:52.127245 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:52.127212    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:52.942316 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:52.942286    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxztz"]
Sep 11 15:09:52.947052 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:52.946678    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-564ps"]
Sep 11 15:09:52.947239 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:09:52.947120    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91cc8492_8379_4837_a063_561240230e70.slice/crio-bf3f83f93de341859837ddd70d2ab8a6526eef68909619483c90cd7d24ce6a8d WatchSource:0}: Error finding container bf3f83f93de341859837ddd70d2ab8a6526eef68909619483c90cd7d24ce6a8d: Status 404 returned error can't find the container with id bf3f83f93de341859837ddd70d2ab8a6526eef68909619483c90cd7d24ce6a8d
Sep 11 15:09:52.947995 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:52.947907    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ptqp9"]
Sep 11 15:09:52.949483 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:09:52.949456    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f436e2_eb76_41e5_83e5_8e5ea522044c.slice/crio-b1f5987b69ffbf88216a7ff4b6c82d365f2687b3606241b4e2e92f0349589580 WatchSource:0}: Error finding container b1f5987b69ffbf88216a7ff4b6c82d365f2687b3606241b4e2e92f0349589580: Status 404 returned error can't find the container with id b1f5987b69ffbf88216a7ff4b6c82d365f2687b3606241b4e2e92f0349589580
Sep 11 15:09:52.950211 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:09:52.950193    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0163d627_b988_4307_a7df_d5c3971306ff.slice/crio-39f3d0e6afab6ed8c705d2b559dfda3c01609626f986af7f45cd478fbd4ed750 WatchSource:0}: Error finding container 39f3d0e6afab6ed8c705d2b559dfda3c01609626f986af7f45cd478fbd4ed750: Status 404 returned error can't find the container with id 39f3d0e6afab6ed8c705d2b559dfda3c01609626f986af7f45cd478fbd4ed750
Sep 11 15:09:53.317109 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.317019    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5" event={"ID":"eb9fdf6b-0efb-4b81-b863-8d4f44144205","Type":"ContainerStarted","Data":"2abf285c5da525186099f057b3a98ea359ac9bf532e879b65a3e536c79c440cc"}
Sep 11 15:09:53.317109 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.317062    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5" event={"ID":"eb9fdf6b-0efb-4b81-b863-8d4f44144205","Type":"ContainerStarted","Data":"bec116d8623e093082b02a0023feab3131e3b08548148c4eca43a53f0e3b2e5d"}
Sep 11 15:09:53.317109 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.317075    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5" event={"ID":"eb9fdf6b-0efb-4b81-b863-8d4f44144205","Type":"ContainerStarted","Data":"1d9be22f670d72a2a08fa4de375f0d56cf451fa22a47a67cf6af8ec22b6c9852"}
Sep 11 15:09:53.318318 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.318295    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxztz" event={"ID":"91cc8492-8379-4837-a063-561240230e70","Type":"ContainerStarted","Data":"bf3f83f93de341859837ddd70d2ab8a6526eef68909619483c90cd7d24ce6a8d"}
Sep 11 15:09:53.319883 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.319863    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ptqp9" event={"ID":"03f436e2-eb76-41e5-83e5-8e5ea522044c","Type":"ContainerStarted","Data":"00bb6d42b83b063efbb875bdab8673619f72c988e34d0eb9548f4a4c0b3a512b"}
Sep 11 15:09:53.319988 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.319900    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ptqp9" event={"ID":"03f436e2-eb76-41e5-83e5-8e5ea522044c","Type":"ContainerStarted","Data":"b1f5987b69ffbf88216a7ff4b6c82d365f2687b3606241b4e2e92f0349589580"}
Sep 11 15:09:53.319988 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.319917    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:09:53.321078 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.321058    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-564ps" event={"ID":"0163d627-b988-4307-a7df-d5c3971306ff","Type":"ContainerStarted","Data":"39f3d0e6afab6ed8c705d2b559dfda3c01609626f986af7f45cd478fbd4ed750"}
Sep 11 15:09:53.341266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.341223    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57768f5894-j26g5" podStartSLOduration=1.999961942 podStartE2EDuration="5.341206658s" totalImagesPullingTime="3.341244716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:53.33966285 +0000 UTC m=+67.799379850" watchObservedRunningTime="2026-09-11 15:09:53.341206658 +0000 UTC m=+67.800923658"
Sep 11 15:09:53.357038 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.356994    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ptqp9" podStartSLOduration=67.356979843 podStartE2EDuration="1m7.356979843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:53.355986044 +0000 UTC m=+67.815703043" watchObservedRunningTime="2026-09-11 15:09:53.356979843 +0000 UTC m=+67.816696842"
Sep 11 15:09:53.635094 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.635049    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:53.635862 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.635836    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92321919-f0c2-4635-a454-4601466d148b-service-ca-bundle\") pod \"router-default-5ff9ffd588-8d7t4\" (UID: \"92321919-f0c2-4635-a454-4601466d148b\") " pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:53.824688 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.824656    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wcd7v\""
Sep 11 15:09:53.832819 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:53.832789    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:54.196148 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:54.195906    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5ff9ffd588-8d7t4"]
Sep 11 15:09:54.199271 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:09:54.199234    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92321919_f0c2_4635_a454_4601466d148b.slice/crio-01d9de2e7a74b3f986c9c55567ed435db41c2531a5a83fb75eb85565c330f447 WatchSource:0}: Error finding container 01d9de2e7a74b3f986c9c55567ed435db41c2531a5a83fb75eb85565c330f447: Status 404 returned error can't find the container with id 01d9de2e7a74b3f986c9c55567ed435db41c2531a5a83fb75eb85565c330f447
Sep 11 15:09:54.326845 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:54.326806    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5ff9ffd588-8d7t4" event={"ID":"92321919-f0c2-4635-a454-4601466d148b","Type":"ContainerStarted","Data":"472bbbd13e3551b2b6c341a829a2426da6da718dab2acafe2fed5e89b517c37d"}
Sep 11 15:09:54.327005 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:54.326872    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5ff9ffd588-8d7t4" event={"ID":"92321919-f0c2-4635-a454-4601466d148b","Type":"ContainerStarted","Data":"01d9de2e7a74b3f986c9c55567ed435db41c2531a5a83fb75eb85565c330f447"}
Sep 11 15:09:54.329013 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:54.328986    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxztz" event={"ID":"91cc8492-8379-4837-a063-561240230e70","Type":"ContainerStarted","Data":"0b397321d74c5dc0b39bc0f19819196841eb1dde41a291706e4ed2894f16e83c"}
Sep 11 15:09:54.329154 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:54.329029    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxztz" event={"ID":"91cc8492-8379-4837-a063-561240230e70","Type":"ContainerStarted","Data":"ff744edeb15b2da65a97e2d346ef18501d3a709aa4fe65de712da40dedf46d4e"}
Sep 11 15:09:54.347119 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:54.347046    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5ff9ffd588-8d7t4" podStartSLOduration=33.347027285 podStartE2EDuration="33.347027285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:09:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:54.346564002 +0000 UTC m=+68.806281003" watchObservedRunningTime="2026-09-11 15:09:54.347027285 +0000 UTC m=+68.806744289"
Sep 11 15:09:54.363537 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:54.363475    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rxztz" podStartSLOduration=67.368055311 podStartE2EDuration="1m8.363461053s" totalImagesPullingTime="995.405742ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:54.362598022 +0000 UTC m=+68.822315021" watchObservedRunningTime="2026-09-11 15:09:54.363461053 +0000 UTC m=+68.823178053"
Sep 11 15:09:54.833463 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:54.833426    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:54.837411 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:54.837388    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:55.333082 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:55.332825    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:55.333928 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:55.333907    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5ff9ffd588-8d7t4"
Sep 11 15:09:57.341922 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:57.341822    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-564ps" event={"ID":"0163d627-b988-4307-a7df-d5c3971306ff","Type":"ContainerStarted","Data":"53a9745bf3a8d0a8647a889fdbd03439d73195ea2f6da277f7d93a890da6a3b7"}
Sep 11 15:09:57.360539 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:09:57.360464    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-564ps" podStartSLOduration=67.270452256 podStartE2EDuration="1m11.360449034s" totalImagesPullingTime="4.089996778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:09:57.35956223 +0000 UTC m=+71.819279232" watchObservedRunningTime="2026-09-11 15:09:57.360449034 +0000 UTC m=+71.820166033"
Sep 11 15:10:12.945316 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:12.945205    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kt8sz"]
Sep 11 15:10:12.951045 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:12.951020    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:12.953745 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:12.953726    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 15:10:12.953995 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:12.953978    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 15:10:12.954047 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:12.954014    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zcpm2\""
Sep 11 15:10:12.954247 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:12.954233    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 15:10:12.954765 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:12.954752    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 15:10:12.955494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:12.955479    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 15:10:12.956907 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:12.956886    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 15:10:13.075786 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.075754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-sys\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.075965 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.075799    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-wtmp\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.075965 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.075819    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-textfile\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.075965 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.075835    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-metrics-client-ca\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.075965 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.075910    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.075965 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.075960    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.076159 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.075990    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99zwl\" (UniqueName: \"kubernetes.io/projected/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-kube-api-access-99zwl\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.076159 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.076007    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-root\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.076159 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.076032    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-tls\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177135 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-textfile\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177135 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177135    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-metrics-client-ca\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177351 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177161    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177351 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177300    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177461 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177355    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99zwl\" (UniqueName: \"kubernetes.io/projected/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-kube-api-access-99zwl\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177461 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177384    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-root\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177461 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177417    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-tls\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177461 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177441    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-textfile\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177661 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177465    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-sys\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177661 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177511    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-root\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177661 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177517    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-wtmp\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177661 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:10:13.177570    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 11 15:10:13.177661 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177572    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-sys\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.177830 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.177665    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-wtmp\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.178146 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.178120    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.178146 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.178135    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-metrics-client-ca\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.178304 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:10:13.178279    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-tls podName:d0556a24-0d76-4d3f-b78f-e7c96ac550d4 nodeName:}" failed. No retries permitted until 2026-09-11 15:10:13.678251979 +0000 UTC m=+88.137968974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-tls") pod "node-exporter-kt8sz" (UID: "d0556a24-0d76-4d3f-b78f-e7c96ac550d4") : secret "node-exporter-tls" not found
Sep 11 15:10:13.182224 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.180813    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.187527 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.187508    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99zwl\" (UniqueName: \"kubernetes.io/projected/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-kube-api-access-99zwl\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.679752 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.679715    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-tls\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:13.679932 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:10:13.679847    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 11 15:10:13.679932 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:10:13.679911    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-tls podName:d0556a24-0d76-4d3f-b78f-e7c96ac550d4 nodeName:}" failed. No retries permitted until 2026-09-11 15:10:14.67989561 +0000 UTC m=+89.139612588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-tls") pod "node-exporter-kt8sz" (UID: "d0556a24-0d76-4d3f-b78f-e7c96ac550d4") : secret "node-exporter-tls" not found
Sep 11 15:10:13.928353 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.928319    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 15:10:13.934168 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.934121    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:13.937130 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.937100    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 15:10:13.937243 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.937104    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 15:10:13.937299 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.937280    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 15:10:13.937384 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.937368    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 15:10:13.937591 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.937574    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 15:10:13.937657 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.937640    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 15:10:13.937760 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.937743    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 15:10:13.938252 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.938233    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 15:10:13.938319 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.938244    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7wftf\""
Sep 11 15:10:13.938373 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.938244    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 15:10:13.949317 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:13.949298    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 15:10:14.083380 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083340    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.083550 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083385    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2qjr\" (UniqueName: \"kubernetes.io/projected/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-kube-api-access-h2qjr\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.083550 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083441    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.083550 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083472    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-web-config\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.083550 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083501    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.083550 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.083796 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083561    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.083796 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083578    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.083796 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083599    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.083796 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083633    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.083796 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083657    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-config-out\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.083796 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083693    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.083796 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.083712    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.184762 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.184673    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.184762 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.184710    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.184762 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.184732    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.185033 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.184868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.185033 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.184900    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-config-out\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.185033 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.184945    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.185033 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.184984    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.185033 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.185028    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.185286 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.185068    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2qjr\" (UniqueName: \"kubernetes.io/projected/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-kube-api-access-h2qjr\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.185286 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.185095    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.185286 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.185118    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-web-config\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.185286 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.185145    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.185286 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.185179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.185723 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.185345    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.186407 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.186379    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.188156 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.188134    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.188316 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.188293    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.188442 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.188397    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.188656 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.188634    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.188744 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.188666    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.188924 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.188905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-config-out\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.188986 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.188937    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.189077 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.189056    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-web-config\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.190512 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.190489    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.190512 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.190503    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.193517 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.193501    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2qjr\" (UniqueName: \"kubernetes.io/projected/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-kube-api-access-h2qjr\") pod \"alertmanager-main-0\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.243700 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.243670    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:10:14.532190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.532168    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 15:10:14.534741 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:10:14.534715    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7ac537_bef0_4f91_977e_4b1f2ac0a65f.slice/crio-7094d5ba47e24f3341584b94f7f2f8631d5637fdd4159a0042c4fe5ac63eb805 WatchSource:0}: Error finding container 7094d5ba47e24f3341584b94f7f2f8631d5637fdd4159a0042c4fe5ac63eb805: Status 404 returned error can't find the container with id 7094d5ba47e24f3341584b94f7f2f8631d5637fdd4159a0042c4fe5ac63eb805
Sep 11 15:10:14.689587 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.689549    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-tls\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:14.692077 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.692054    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0556a24-0d76-4d3f-b78f-e7c96ac550d4-node-exporter-tls\") pod \"node-exporter-kt8sz\" (UID: \"d0556a24-0d76-4d3f-b78f-e7c96ac550d4\") " pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:14.761224 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:14.761191    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kt8sz"
Sep 11 15:10:14.773668 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:10:14.773634    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0556a24_0d76_4d3f_b78f_e7c96ac550d4.slice/crio-ae6c7a5ace5b2aa1d531e5dabfe8372f5dbb9012c326c83fcc5b9d8ee28dd5fa WatchSource:0}: Error finding container ae6c7a5ace5b2aa1d531e5dabfe8372f5dbb9012c326c83fcc5b9d8ee28dd5fa: Status 404 returned error can't find the container with id ae6c7a5ace5b2aa1d531e5dabfe8372f5dbb9012c326c83fcc5b9d8ee28dd5fa
Sep 11 15:10:15.404874 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:15.404839    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kt8sz" event={"ID":"d0556a24-0d76-4d3f-b78f-e7c96ac550d4","Type":"ContainerStarted","Data":"ae6c7a5ace5b2aa1d531e5dabfe8372f5dbb9012c326c83fcc5b9d8ee28dd5fa"}
Sep 11 15:10:15.406251 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:15.406228    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerStarted","Data":"7094d5ba47e24f3341584b94f7f2f8631d5637fdd4159a0042c4fe5ac63eb805"}
Sep 11 15:10:16.411819 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:16.411790    2574 generic.go:356] "Generic (PLEG): container finished" podID="d0556a24-0d76-4d3f-b78f-e7c96ac550d4" containerID="1d1a39c4217d973ef979f4d3d7becd3f5f08a4de031207c1dfe0a319b262139e" exitCode=0
Sep 11 15:10:16.412200 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:16.411841    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kt8sz" event={"ID":"d0556a24-0d76-4d3f-b78f-e7c96ac550d4","Type":"ContainerDied","Data":"1d1a39c4217d973ef979f4d3d7becd3f5f08a4de031207c1dfe0a319b262139e"}
Sep 11 15:10:17.418265 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:17.418233    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kt8sz" event={"ID":"d0556a24-0d76-4d3f-b78f-e7c96ac550d4","Type":"ContainerStarted","Data":"45a818b0d60328d742d91a440b1a37b836d363441d127da89fe403dd8691748e"}
Sep 11 15:10:17.418687 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:17.418287    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kt8sz" event={"ID":"d0556a24-0d76-4d3f-b78f-e7c96ac550d4","Type":"ContainerStarted","Data":"73f611a73eaa81292dd7d783607308f77552ea7c4b27fc0f8dfc19ca8bf20e8e"}
Sep 11 15:10:17.419868 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:17.419846    2574 generic.go:356] "Generic (PLEG): container finished" podID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerID="4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585" exitCode=0
Sep 11 15:10:17.419970 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:17.419926    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerDied","Data":"4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585"}
Sep 11 15:10:17.441955 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:17.441901    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kt8sz" podStartSLOduration=4.124737269 podStartE2EDuration="5.44188319s" totalImagesPullingTime="1.237363145s" totalInitContainerRuntime="79.782776ms" isStatefulPod=true podCreationTimestamp="2026-09-11 15:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:10:17.439738576 +0000 UTC m=+91.899455602" watchObservedRunningTime="2026-09-11 15:10:17.44188319 +0000 UTC m=+91.901600187"
Sep 11 15:10:19.432103 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:19.432071    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerStarted","Data":"5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d"}
Sep 11 15:10:19.432482 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:19.432144    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerStarted","Data":"427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12"}
Sep 11 15:10:19.432482 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:19.432173    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerStarted","Data":"2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668"}
Sep 11 15:10:19.432482 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:19.432210    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerStarted","Data":"8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99"}
Sep 11 15:10:19.432482 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:19.432242    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerStarted","Data":"beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9"}
Sep 11 15:10:20.439523 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:20.439490    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerStarted","Data":"236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79"}
Sep 11 15:10:20.467809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:20.467754    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.317973573 podStartE2EDuration="7.467738301s" totalImagesPullingTime="4.123997791s" totalInitContainerRuntime="25.766937ms" isStatefulPod=false podCreationTimestamp="2026-09-11 15:10:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:10:20.465402871 +0000 UTC m=+94.925119883" watchObservedRunningTime="2026-09-11 15:10:20.467738301 +0000 UTC m=+94.927455329"
Sep 11 15:10:24.331010 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:24.330969    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ptqp9"
Sep 11 15:10:51.550687 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:51.550589    2574 generic.go:356] "Generic (PLEG): container finished" podID="6d909c90-2653-4d91-a82c-4774d65db370" containerID="0110027a88833ea5404e6f759f620c76b211bc258e2b1dc32b2df8f6e6842703" exitCode=0
Sep 11 15:10:51.551030 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:51.550674    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-22ppp" event={"ID":"6d909c90-2653-4d91-a82c-4774d65db370","Type":"ContainerDied","Data":"0110027a88833ea5404e6f759f620c76b211bc258e2b1dc32b2df8f6e6842703"}
Sep 11 15:10:51.551030 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:51.551005    2574 scope.go:117] "RemoveContainer" containerID="0110027a88833ea5404e6f759f620c76b211bc258e2b1dc32b2df8f6e6842703"
Sep 11 15:10:52.556966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:10:52.556928    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-22ppp" event={"ID":"6d909c90-2653-4d91-a82c-4774d65db370","Type":"ContainerStarted","Data":"ae7a26ebc2d08804c9f0b1f6bde71b6ddfa9cc8d09eee38e098d995798ebb4e7"}
Sep 11 15:11:33.330343 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.330310    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 15:11:33.330882 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.330597    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="alertmanager" containerID="cri-o://beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9" gracePeriod=120
Sep 11 15:11:33.330882 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.330688    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="kube-rbac-proxy-metric" containerID="cri-o://5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d" gracePeriod=120
Sep 11 15:11:33.330882 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.330724    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="prom-label-proxy" containerID="cri-o://236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79" gracePeriod=120
Sep 11 15:11:33.330882 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.330770    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="config-reloader" containerID="cri-o://8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99" gracePeriod=120
Sep 11 15:11:33.330882 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.330734    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="kube-rbac-proxy-web" containerID="cri-o://2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668" gracePeriod=120
Sep 11 15:11:33.331202 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.330872    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="kube-rbac-proxy" containerID="cri-o://427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12" gracePeriod=120
Sep 11 15:11:33.702360 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.702327    2574 generic.go:356] "Generic (PLEG): container finished" podID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerID="236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79" exitCode=0
Sep 11 15:11:33.702360 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.702351    2574 generic.go:356] "Generic (PLEG): container finished" podID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerID="427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12" exitCode=0
Sep 11 15:11:33.702360 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.702357    2574 generic.go:356] "Generic (PLEG): container finished" podID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerID="8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99" exitCode=0
Sep 11 15:11:33.702360 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.702362    2574 generic.go:356] "Generic (PLEG): container finished" podID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerID="beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9" exitCode=0
Sep 11 15:11:33.702608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.702393    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerDied","Data":"236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79"}
Sep 11 15:11:33.702608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.702445    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerDied","Data":"427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12"}
Sep 11 15:11:33.702608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.702470    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerDied","Data":"8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99"}
Sep 11 15:11:33.702608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:33.702495    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerDied","Data":"beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9"}
Sep 11 15:11:34.572927 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.572903    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:34.703436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703329    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-tls-assets\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.703436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703387    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-metrics-client-ca\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.703706 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703507    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-cluster-tls-config\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.703706 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703575    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.703706 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703601    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-config-volume\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.703706 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703650    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-alertmanager-main-db\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.703706 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703690    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2qjr\" (UniqueName: \"kubernetes.io/projected/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-kube-api-access-h2qjr\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.703948 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703714    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-main-tls\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.703948 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703757    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-web-config\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.703948 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703782    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy-web\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.703948 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703781    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:11:34.703948 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703815    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-alertmanager-trusted-ca-bundle\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.703948 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703842    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-config-out\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.703948 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.703878    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy\") pod \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\" (UID: \"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f\") "
Sep 11 15:11:34.704268 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.704101    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-metrics-client-ca\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:34.706680 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.706647    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:11:34.706870 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.706828    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:11:34.707137 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.707102    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:11:34.707658 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.707629    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:11:34.707985 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.707936    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-kube-api-access-h2qjr" (OuterVolumeSpecName: "kube-api-access-h2qjr") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "kube-api-access-h2qjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:11:34.708182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.708154    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:11:34.708275 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.708241    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:11:34.708373 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.708333    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-config-volume" (OuterVolumeSpecName: "config-volume") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:11:34.708373 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.708345    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:11:34.708885 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.708863    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-config-out" (OuterVolumeSpecName: "config-out") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:11:34.711673 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.711624    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:11:34.714062 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.714038    2574 generic.go:356] "Generic (PLEG): container finished" podID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerID="5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d" exitCode=0
Sep 11 15:11:34.714062 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.714060    2574 generic.go:356] "Generic (PLEG): container finished" podID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerID="2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668" exitCode=0
Sep 11 15:11:34.714201 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.714080    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerDied","Data":"5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d"}
Sep 11 15:11:34.714201 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.714147    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerDied","Data":"2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668"}
Sep 11 15:11:34.714201 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.714192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b7ac537-bef0-4f91-977e-4b1f2ac0a65f","Type":"ContainerDied","Data":"7094d5ba47e24f3341584b94f7f2f8631d5637fdd4159a0042c4fe5ac63eb805"}
Sep 11 15:11:34.714365 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.714205    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:34.714365 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.714234    2574 scope.go:117] "RemoveContainer" containerID="236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79"
Sep 11 15:11:34.719834 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.719812    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-web-config" (OuterVolumeSpecName: "web-config") pod "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" (UID: "9b7ac537-bef0-4f91-977e-4b1f2ac0a65f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:11:34.722944 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.722927    2574 scope.go:117] "RemoveContainer" containerID="5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d"
Sep 11 15:11:34.729744 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.729727    2574 scope.go:117] "RemoveContainer" containerID="427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12"
Sep 11 15:11:34.736288 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.736269    2574 scope.go:117] "RemoveContainer" containerID="2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668"
Sep 11 15:11:34.743323 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.743308    2574 scope.go:117] "RemoveContainer" containerID="8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99"
Sep 11 15:11:34.750043 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.750016    2574 scope.go:117] "RemoveContainer" containerID="beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9"
Sep 11 15:11:34.756837 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.756820    2574 scope.go:117] "RemoveContainer" containerID="4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585"
Sep 11 15:11:34.763231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.763215    2574 scope.go:117] "RemoveContainer" containerID="236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79"
Sep 11 15:11:34.763494 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:11:34.763472    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79\": container with ID starting with 236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79 not found: ID does not exist" containerID="236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79"
Sep 11 15:11:34.763535 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.763502    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79"} err="failed to get container status \"236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79\": rpc error: code = NotFound desc = could not find container \"236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79\": container with ID starting with 236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79 not found: ID does not exist"
Sep 11 15:11:34.763535 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.763534    2574 scope.go:117] "RemoveContainer" containerID="5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d"
Sep 11 15:11:34.763794 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:11:34.763773    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d\": container with ID starting with 5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d not found: ID does not exist" containerID="5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d"
Sep 11 15:11:34.763878 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.763797    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d"} err="failed to get container status \"5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d\": rpc error: code = NotFound desc = could not find container \"5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d\": container with ID starting with 5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d not found: ID does not exist"
Sep 11 15:11:34.763878 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.763814    2574 scope.go:117] "RemoveContainer" containerID="427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12"
Sep 11 15:11:34.764051 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:11:34.764033    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12\": container with ID starting with 427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12 not found: ID does not exist" containerID="427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12"
Sep 11 15:11:34.764109 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.764060    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12"} err="failed to get container status \"427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12\": rpc error: code = NotFound desc = could not find container \"427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12\": container with ID starting with 427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12 not found: ID does not exist"
Sep 11 15:11:34.764109 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.764087    2574 scope.go:117] "RemoveContainer" containerID="2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668"
Sep 11 15:11:34.764353 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:11:34.764338    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668\": container with ID starting with 2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668 not found: ID does not exist" containerID="2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668"
Sep 11 15:11:34.764393 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.764357    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668"} err="failed to get container status \"2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668\": rpc error: code = NotFound desc = could not find container \"2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668\": container with ID starting with 2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668 not found: ID does not exist"
Sep 11 15:11:34.764393 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.764370    2574 scope.go:117] "RemoveContainer" containerID="8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99"
Sep 11 15:11:34.764607 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:11:34.764590    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99\": container with ID starting with 8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99 not found: ID does not exist" containerID="8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99"
Sep 11 15:11:34.764672 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.764640    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99"} err="failed to get container status \"8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99\": rpc error: code = NotFound desc = could not find container \"8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99\": container with ID starting with 8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99 not found: ID does not exist"
Sep 11 15:11:34.764672 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.764656    2574 scope.go:117] "RemoveContainer" containerID="beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9"
Sep 11 15:11:34.764891 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:11:34.764874    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9\": container with ID starting with beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9 not found: ID does not exist" containerID="beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9"
Sep 11 15:11:34.764960 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.764897    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9"} err="failed to get container status \"beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9\": rpc error: code = NotFound desc = could not find container \"beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9\": container with ID starting with beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9 not found: ID does not exist"
Sep 11 15:11:34.764960 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.764916    2574 scope.go:117] "RemoveContainer" containerID="4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585"
Sep 11 15:11:34.765137 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:11:34.765123    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585\": container with ID starting with 4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585 not found: ID does not exist" containerID="4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585"
Sep 11 15:11:34.765177 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.765140    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585"} err="failed to get container status \"4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585\": rpc error: code = NotFound desc = could not find container \"4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585\": container with ID starting with 4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585 not found: ID does not exist"
Sep 11 15:11:34.765177 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.765154    2574 scope.go:117] "RemoveContainer" containerID="236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79"
Sep 11 15:11:34.765347 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.765331    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79"} err="failed to get container status \"236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79\": rpc error: code = NotFound desc = could not find container \"236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79\": container with ID starting with 236c14ffbe3457ae627fc0405489484a7fd824cb54718a96640358465b3abd79 not found: ID does not exist"
Sep 11 15:11:34.765390 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.765347    2574 scope.go:117] "RemoveContainer" containerID="5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d"
Sep 11 15:11:34.765550 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.765534    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d"} err="failed to get container status \"5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d\": rpc error: code = NotFound desc = could not find container \"5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d\": container with ID starting with 5490dfb2a48e215663a40466f2ab34852b6d21d45c3c966200858e60723b5c7d not found: ID does not exist"
Sep 11 15:11:34.765637 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.765551    2574 scope.go:117] "RemoveContainer" containerID="427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12"
Sep 11 15:11:34.765801 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.765786    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12"} err="failed to get container status \"427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12\": rpc error: code = NotFound desc = could not find container \"427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12\": container with ID starting with 427e49ad178027d397eb95b3ba179b2f7cd7c7d08891b364c6aa6d4583a8bf12 not found: ID does not exist"
Sep 11 15:11:34.765845 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.765804    2574 scope.go:117] "RemoveContainer" containerID="2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668"
Sep 11 15:11:34.765999 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.765982    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668"} err="failed to get container status \"2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668\": rpc error: code = NotFound desc = could not find container \"2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668\": container with ID starting with 2611f871451523c72ea06b2c48ee4216912181a3c2a80ea3340088b890479668 not found: ID does not exist"
Sep 11 15:11:34.766062 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.766000    2574 scope.go:117] "RemoveContainer" containerID="8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99"
Sep 11 15:11:34.766205 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.766190    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99"} err="failed to get container status \"8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99\": rpc error: code = NotFound desc = could not find container \"8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99\": container with ID starting with 8ce6737174b2fbde534a8ddc473048927bb13dfa81afe89e723fe5287c175c99 not found: ID does not exist"
Sep 11 15:11:34.766249 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.766205    2574 scope.go:117] "RemoveContainer" containerID="beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9"
Sep 11 15:11:34.766390 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.766376    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9"} err="failed to get container status \"beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9\": rpc error: code = NotFound desc = could not find container \"beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9\": container with ID starting with beb9b09e6e59968941ee553994745825f3dedd10bb8dfa22668cfcbed01e7ea9 not found: ID does not exist"
Sep 11 15:11:34.766429 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.766390    2574 scope.go:117] "RemoveContainer" containerID="4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585"
Sep 11 15:11:34.766580 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.766563    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585"} err="failed to get container status \"4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585\": rpc error: code = NotFound desc = could not find container \"4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585\": container with ID starting with 4b480bcc765110445ca45b141fabfe346e7a57dc803241d7b7209c386aee0585 not found: ID does not exist"
Sep 11 15:11:34.804946 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.804916    2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-cluster-tls-config\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:34.804946 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.804943    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:34.805083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.804952    2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-config-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:34.805083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.804963    2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-alertmanager-main-db\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:34.805083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.804970    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2qjr\" (UniqueName: \"kubernetes.io/projected/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-kube-api-access-h2qjr\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:34.805083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.804979    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-main-tls\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:34.805083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.804987    2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-web-config\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:34.805083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.804996    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:34.805083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.805004    2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:34.805083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.805012    2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-config-out\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:34.805083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.805020    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:34.805083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:34.805028    2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f-tls-assets\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:11:35.038779 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.038750    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 15:11:35.043732 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.043708    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 15:11:35.069497 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069449    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 15:11:35.069706 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069694    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="kube-rbac-proxy"
Sep 11 15:11:35.069758 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069708    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="kube-rbac-proxy"
Sep 11 15:11:35.069758 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069720    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="init-config-reloader"
Sep 11 15:11:35.069758 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069726    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="init-config-reloader"
Sep 11 15:11:35.069758 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069733    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="kube-rbac-proxy-web"
Sep 11 15:11:35.069758 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069738    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="kube-rbac-proxy-web"
Sep 11 15:11:35.069758 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069746    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="prom-label-proxy"
Sep 11 15:11:35.069758 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069751    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="prom-label-proxy"
Sep 11 15:11:35.069758 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069758    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="kube-rbac-proxy-metric"
Sep 11 15:11:35.069979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069764    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="kube-rbac-proxy-metric"
Sep 11 15:11:35.069979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069775    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="alertmanager"
Sep 11 15:11:35.069979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069781    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="alertmanager"
Sep 11 15:11:35.069979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069788    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="config-reloader"
Sep 11 15:11:35.069979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069793    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="config-reloader"
Sep 11 15:11:35.069979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069829    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="prom-label-proxy"
Sep 11 15:11:35.069979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069837    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="kube-rbac-proxy-web"
Sep 11 15:11:35.069979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069843    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="kube-rbac-proxy-metric"
Sep 11 15:11:35.069979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069848    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="alertmanager"
Sep 11 15:11:35.069979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069853    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="kube-rbac-proxy"
Sep 11 15:11:35.069979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.069858    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" containerName="config-reloader"
Sep 11 15:11:35.074577 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.074559    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.077284 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.077263    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 15:11:35.077406 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.077395    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 15:11:35.077585 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.077561    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 15:11:35.077698 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.077601    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 15:11:35.077698 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.077656    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 15:11:35.077698 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.077671    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 15:11:35.077698 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.077690    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 15:11:35.077853 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.077694    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7wftf\""
Sep 11 15:11:35.078024 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.078006    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 15:11:35.085562 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.085531    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 15:11:35.090095 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.090066    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 15:11:35.206856 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.206824    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.206856 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.206862    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5f2w\" (UniqueName: \"kubernetes.io/projected/b25df72c-490c-4d4b-a397-9375cc3450d4-kube-api-access-k5f2w\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.207070 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.206883    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b25df72c-490c-4d4b-a397-9375cc3450d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.207070 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.206914    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b25df72c-490c-4d4b-a397-9375cc3450d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.207070 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.206938    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.207070 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.206996    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b25df72c-490c-4d4b-a397-9375cc3450d4-config-out\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.207070 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.207019    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.207070 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.207033    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25df72c-490c-4d4b-a397-9375cc3450d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.207070 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.207064    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b25df72c-490c-4d4b-a397-9375cc3450d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.207314 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.207106    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.207314 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.207170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.207314 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.207210    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-web-config\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.207314 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.207230    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308239 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308152    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5f2w\" (UniqueName: \"kubernetes.io/projected/b25df72c-490c-4d4b-a397-9375cc3450d4-kube-api-access-k5f2w\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308239 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308194    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b25df72c-490c-4d4b-a397-9375cc3450d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308239 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b25df72c-490c-4d4b-a397-9375cc3450d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308239 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308232    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308515 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308248    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b25df72c-490c-4d4b-a397-9375cc3450d4-config-out\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308515 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308515 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308281    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25df72c-490c-4d4b-a397-9375cc3450d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308515 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308311    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b25df72c-490c-4d4b-a397-9375cc3450d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308515 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308335    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308515 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308362    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308515 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308389    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-web-config\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308515 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308414    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.308515 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.308470    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.309287 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.309260    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b25df72c-490c-4d4b-a397-9375cc3450d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.309724 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.309702    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b25df72c-490c-4d4b-a397-9375cc3450d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.309911 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.309881    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b25df72c-490c-4d4b-a397-9375cc3450d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.311498 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.311459    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b25df72c-490c-4d4b-a397-9375cc3450d4-config-out\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.311498 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.311488    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b25df72c-490c-4d4b-a397-9375cc3450d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.311642 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.311601    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.311903 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.311884    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.311984 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.311957    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.312054 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.312035    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.312343 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.312317    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.312497 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.312477    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-web-config\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.313604 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.313584    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b25df72c-490c-4d4b-a397-9375cc3450d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.317272 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.317236    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5f2w\" (UniqueName: \"kubernetes.io/projected/b25df72c-490c-4d4b-a397-9375cc3450d4-kube-api-access-k5f2w\") pod \"alertmanager-main-0\" (UID: \"b25df72c-490c-4d4b-a397-9375cc3450d4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.384446 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.384410    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 15:11:35.678585 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.678153    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 15:11:35.681110 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:11:35.681072    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb25df72c_490c_4d4b_a397_9375cc3450d4.slice/crio-46e6e7178f9617f2f666831461c2d8d809dc824d9e22ef848908925590e7e0a2 WatchSource:0}: Error finding container 46e6e7178f9617f2f666831461c2d8d809dc824d9e22ef848908925590e7e0a2: Status 404 returned error can't find the container with id 46e6e7178f9617f2f666831461c2d8d809dc824d9e22ef848908925590e7e0a2
Sep 11 15:11:35.719503 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.719473    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b25df72c-490c-4d4b-a397-9375cc3450d4","Type":"ContainerStarted","Data":"46e6e7178f9617f2f666831461c2d8d809dc824d9e22ef848908925590e7e0a2"}
Sep 11 15:11:35.993041 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:35.992956    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b7ac537-bef0-4f91-977e-4b1f2ac0a65f" path="/var/lib/kubelet/pods/9b7ac537-bef0-4f91-977e-4b1f2ac0a65f/volumes"
Sep 11 15:11:36.724863 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:36.724780    2574 generic.go:356] "Generic (PLEG): container finished" podID="b25df72c-490c-4d4b-a397-9375cc3450d4" containerID="faac0d670c80536056485e57ef518b2549f44f09151ec68f7797b40acda916d4" exitCode=0
Sep 11 15:11:36.724863 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:36.724851    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b25df72c-490c-4d4b-a397-9375cc3450d4","Type":"ContainerDied","Data":"faac0d670c80536056485e57ef518b2549f44f09151ec68f7797b40acda916d4"}
Sep 11 15:11:37.732881 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:37.732803    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b25df72c-490c-4d4b-a397-9375cc3450d4","Type":"ContainerStarted","Data":"676373b85a8f51298277cc0da3661f88ad0fe829562ebead55514c305407175a"}
Sep 11 15:11:37.733233 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:37.732880    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b25df72c-490c-4d4b-a397-9375cc3450d4","Type":"ContainerStarted","Data":"ec64e38d8f5fb8c0fe770441af381ace6ea3b45f99039dfa542813eca55a1d9f"}
Sep 11 15:11:37.733233 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:37.732925    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b25df72c-490c-4d4b-a397-9375cc3450d4","Type":"ContainerStarted","Data":"3094cda44a47a5f5907f4bd182f071f345a163161b649530b28710448baa8560"}
Sep 11 15:11:37.733233 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:37.732967    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b25df72c-490c-4d4b-a397-9375cc3450d4","Type":"ContainerStarted","Data":"b4185f6794051f1445989284f69a6d2231ab6f7c86a8a77e8948af31a34e2f6b"}
Sep 11 15:11:37.733233 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:37.733004    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b25df72c-490c-4d4b-a397-9375cc3450d4","Type":"ContainerStarted","Data":"7879a744b63ea2c0fc7ac2373f9927a54863f0617f2962b656b0d36bdbcfbdf4"}
Sep 11 15:11:37.733233 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:37.733039    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b25df72c-490c-4d4b-a397-9375cc3450d4","Type":"ContainerStarted","Data":"d0fcf6308394d48f06feb8cb2cd0de400afa4d1d7244f903482c8d7d2e916a82"}
Sep 11 15:11:37.768303 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:11:37.768249    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.753474026 podStartE2EDuration="2.768233032s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.759006ms" isStatefulPod=false podCreationTimestamp="2026-09-11 15:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:11:37.767455846 +0000 UTC m=+172.227172846" watchObservedRunningTime="2026-09-11 15:11:37.768233032 +0000 UTC m=+172.227950043"
Sep 11 15:13:42.712846 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:42.712806    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-g7rfn"]
Sep 11 15:13:42.715886 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:42.715871    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-g7rfn"
Sep 11 15:13:42.718363 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:42.718337    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lfqd8\""
Sep 11 15:13:42.718363 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:42.718354    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 15:13:42.719270 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:42.719253    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 15:13:42.725475 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:42.725457    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-g7rfn"]
Sep 11 15:13:42.745836 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:42.745809    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsql4\" (UniqueName: \"kubernetes.io/projected/503e9115-5319-4382-93eb-b8b269e27f79-kube-api-access-jsql4\") pod \"cert-manager-55b4d954d5-g7rfn\" (UID: \"503e9115-5319-4382-93eb-b8b269e27f79\") " pod="cert-manager/cert-manager-55b4d954d5-g7rfn"
Sep 11 15:13:42.745930 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:42.745850    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/503e9115-5319-4382-93eb-b8b269e27f79-bound-sa-token\") pod \"cert-manager-55b4d954d5-g7rfn\" (UID: \"503e9115-5319-4382-93eb-b8b269e27f79\") " pod="cert-manager/cert-manager-55b4d954d5-g7rfn"
Sep 11 15:13:42.846853 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:42.846821    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsql4\" (UniqueName: \"kubernetes.io/projected/503e9115-5319-4382-93eb-b8b269e27f79-kube-api-access-jsql4\") pod \"cert-manager-55b4d954d5-g7rfn\" (UID: \"503e9115-5319-4382-93eb-b8b269e27f79\") " pod="cert-manager/cert-manager-55b4d954d5-g7rfn"
Sep 11 15:13:42.846987 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:42.846874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/503e9115-5319-4382-93eb-b8b269e27f79-bound-sa-token\") pod \"cert-manager-55b4d954d5-g7rfn\" (UID: \"503e9115-5319-4382-93eb-b8b269e27f79\") " pod="cert-manager/cert-manager-55b4d954d5-g7rfn"
Sep 11 15:13:42.854881 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:42.854859    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/503e9115-5319-4382-93eb-b8b269e27f79-bound-sa-token\") pod \"cert-manager-55b4d954d5-g7rfn\" (UID: \"503e9115-5319-4382-93eb-b8b269e27f79\") " pod="cert-manager/cert-manager-55b4d954d5-g7rfn"
Sep 11 15:13:42.854998 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:42.854935    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsql4\" (UniqueName: \"kubernetes.io/projected/503e9115-5319-4382-93eb-b8b269e27f79-kube-api-access-jsql4\") pod \"cert-manager-55b4d954d5-g7rfn\" (UID: \"503e9115-5319-4382-93eb-b8b269e27f79\") " pod="cert-manager/cert-manager-55b4d954d5-g7rfn"
Sep 11 15:13:43.025848 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:43.025776    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-g7rfn"
Sep 11 15:13:43.294192 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:43.294120    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-g7rfn"]
Sep 11 15:13:43.297061 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:13:43.297034    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod503e9115_5319_4382_93eb_b8b269e27f79.slice/crio-015dd860a6f0f1376dafe37020b1126f453b03b38a7edbd257b2e49348169ca8 WatchSource:0}: Error finding container 015dd860a6f0f1376dafe37020b1126f453b03b38a7edbd257b2e49348169ca8: Status 404 returned error can't find the container with id 015dd860a6f0f1376dafe37020b1126f453b03b38a7edbd257b2e49348169ca8
Sep 11 15:13:44.171146 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:44.171097    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-g7rfn" event={"ID":"503e9115-5319-4382-93eb-b8b269e27f79","Type":"ContainerStarted","Data":"015dd860a6f0f1376dafe37020b1126f453b03b38a7edbd257b2e49348169ca8"}
Sep 11 15:13:46.395602 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:46.395578    2574 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 15:13:47.187845 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:47.187810    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-g7rfn" event={"ID":"503e9115-5319-4382-93eb-b8b269e27f79","Type":"ContainerStarted","Data":"bbf4d127653a368630f7b9ba8cb07be72ef52f5f92f95991d2722a0a54ca1e51"}
Sep 11 15:13:47.206104 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:13:47.206051    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-g7rfn" podStartSLOduration=2.068720075 podStartE2EDuration="5.20603097s" totalImagesPullingTime="3.137310895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:13:47.205634629 +0000 UTC m=+301.665351624" watchObservedRunningTime="2026-09-11 15:13:47.20603097 +0000 UTC m=+301.665747971"
Sep 11 15:14:05.280884 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.280847    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"]
Sep 11 15:14:05.284168 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.284152    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.288303 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.288285    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 15:14:05.288474 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.288462    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 15:14:05.288856 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.288840    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 15:14:05.291103 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.291082    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gkvb7\""
Sep 11 15:14:05.291765 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.291750    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 15:14:05.303304 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.303285    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"]
Sep 11 15:14:05.313214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.313191    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc57b77d-e890-4662-85ee-722b6735d0c8-manifests\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.313302 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.313236    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc57b77d-e890-4662-85ee-722b6735d0c8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.313302 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.313262    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc57b77d-e890-4662-85ee-722b6735d0c8-tmp\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.313375 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.313305    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc57b77d-e890-4662-85ee-722b6735d0c8-webhook-cert\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.313375 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.313343    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pq64\" (UniqueName: \"kubernetes.io/projected/fc57b77d-e890-4662-85ee-722b6735d0c8-kube-api-access-9pq64\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.413753 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.413726    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc57b77d-e890-4662-85ee-722b6735d0c8-tmp\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.413753 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.413754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc57b77d-e890-4662-85ee-722b6735d0c8-webhook-cert\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.413925 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.413782    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pq64\" (UniqueName: \"kubernetes.io/projected/fc57b77d-e890-4662-85ee-722b6735d0c8-kube-api-access-9pq64\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.413925 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.413911    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc57b77d-e890-4662-85ee-722b6735d0c8-manifests\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.414025 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.413986    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc57b77d-e890-4662-85ee-722b6735d0c8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.414225 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.414209    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc57b77d-e890-4662-85ee-722b6735d0c8-manifests\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.416277 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.416247    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc57b77d-e890-4662-85ee-722b6735d0c8-tmp\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.416357 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.416303    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc57b77d-e890-4662-85ee-722b6735d0c8-webhook-cert\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.416397 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.416387    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc57b77d-e890-4662-85ee-722b6735d0c8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.422749 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.422729    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pq64\" (UniqueName: \"kubernetes.io/projected/fc57b77d-e890-4662-85ee-722b6735d0c8-kube-api-access-9pq64\") pod \"opendatahub-operator-controller-manager-87954dbdf-8bh4v\" (UID: \"fc57b77d-e890-4662-85ee-722b6735d0c8\") " pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.594512 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.594424    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:05.875023 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.874993    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"]
Sep 11 15:14:05.878280 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:14:05.878252    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc57b77d_e890_4662_85ee_722b6735d0c8.slice/crio-3bb1bd508d8d05393af8da0f77f69546828ca19888734c932cc605d185fdd9a9 WatchSource:0}: Error finding container 3bb1bd508d8d05393af8da0f77f69546828ca19888734c932cc605d185fdd9a9: Status 404 returned error can't find the container with id 3bb1bd508d8d05393af8da0f77f69546828ca19888734c932cc605d185fdd9a9
Sep 11 15:14:05.880199 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:05.880183    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 15:14:06.260600 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:06.260515    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v" event={"ID":"fc57b77d-e890-4662-85ee-722b6735d0c8","Type":"ContainerStarted","Data":"3bb1bd508d8d05393af8da0f77f69546828ca19888734c932cc605d185fdd9a9"}
Sep 11 15:14:09.275055 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:09.275010    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v" event={"ID":"fc57b77d-e890-4662-85ee-722b6735d0c8","Type":"ContainerStarted","Data":"56089c0b20a0276527651504b058086c9b46889d5fd87faab3a3359609e59b6e"}
Sep 11 15:14:10.280445 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:10.280412    2574 generic.go:356] "Generic (PLEG): container finished" podID="fc57b77d-e890-4662-85ee-722b6735d0c8" containerID="56089c0b20a0276527651504b058086c9b46889d5fd87faab3a3359609e59b6e" exitCode=0
Sep 11 15:14:10.280445 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:10.280450    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v" event={"ID":"fc57b77d-e890-4662-85ee-722b6735d0c8","Type":"ContainerDied","Data":"56089c0b20a0276527651504b058086c9b46889d5fd87faab3a3359609e59b6e"}
Sep 11 15:14:11.286424 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:11.286388    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v" event={"ID":"fc57b77d-e890-4662-85ee-722b6735d0c8","Type":"ContainerStarted","Data":"3ac9f360026609f7b74c6650c3695b485e6c2b6f4970048c7ea554afb6d91dfb"}
Sep 11 15:14:11.286872 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:11.286455    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:11.311773 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:11.311727    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v" podStartSLOduration=1.801000991 podStartE2EDuration="6.31170936s" totalImagesPullingTime="3.48321867s" totalInitContainerRuntime="1.027489699s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:14:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:14:11.310409434 +0000 UTC m=+325.770126434" watchObservedRunningTime="2026-09-11 15:14:11.31170936 +0000 UTC m=+325.771426360"
Sep 11 15:14:22.293308 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:22.293269    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-87954dbdf-8bh4v"
Sep 11 15:14:25.768559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.768528    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"]
Sep 11 15:14:25.775454 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.775432    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"
Sep 11 15:14:25.778346 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.778328    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9v2hd\""
Sep 11 15:14:25.778676 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.778656    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 15:14:25.779255 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.779240    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 15:14:25.799794 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.799738    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"]
Sep 11 15:14:25.874385 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.874340    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2sgb\" (UniqueName: \"kubernetes.io/projected/7aa4add0-de80-4e59-be7d-914d361b8a16-kube-api-access-l2sgb\") pod \"kube-auth-proxy-85b8bff76-p9fgz\" (UID: \"7aa4add0-de80-4e59-be7d-914d361b8a16\") " pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"
Sep 11 15:14:25.874558 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.874409    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aa4add0-de80-4e59-be7d-914d361b8a16-tls-certs\") pod \"kube-auth-proxy-85b8bff76-p9fgz\" (UID: \"7aa4add0-de80-4e59-be7d-914d361b8a16\") " pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"
Sep 11 15:14:25.874558 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.874432    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7aa4add0-de80-4e59-be7d-914d361b8a16-tmp\") pod \"kube-auth-proxy-85b8bff76-p9fgz\" (UID: \"7aa4add0-de80-4e59-be7d-914d361b8a16\") " pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"
Sep 11 15:14:25.974939 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.974904    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aa4add0-de80-4e59-be7d-914d361b8a16-tls-certs\") pod \"kube-auth-proxy-85b8bff76-p9fgz\" (UID: \"7aa4add0-de80-4e59-be7d-914d361b8a16\") " pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"
Sep 11 15:14:25.974939 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.974935    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7aa4add0-de80-4e59-be7d-914d361b8a16-tmp\") pod \"kube-auth-proxy-85b8bff76-p9fgz\" (UID: \"7aa4add0-de80-4e59-be7d-914d361b8a16\") " pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"
Sep 11 15:14:25.975181 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.974987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2sgb\" (UniqueName: \"kubernetes.io/projected/7aa4add0-de80-4e59-be7d-914d361b8a16-kube-api-access-l2sgb\") pod \"kube-auth-proxy-85b8bff76-p9fgz\" (UID: \"7aa4add0-de80-4e59-be7d-914d361b8a16\") " pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"
Sep 11 15:14:25.977482 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.977442    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7aa4add0-de80-4e59-be7d-914d361b8a16-tmp\") pod \"kube-auth-proxy-85b8bff76-p9fgz\" (UID: \"7aa4add0-de80-4e59-be7d-914d361b8a16\") " pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"
Sep 11 15:14:25.977590 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.977570    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aa4add0-de80-4e59-be7d-914d361b8a16-tls-certs\") pod \"kube-auth-proxy-85b8bff76-p9fgz\" (UID: \"7aa4add0-de80-4e59-be7d-914d361b8a16\") " pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"
Sep 11 15:14:25.984062 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:25.984026    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2sgb\" (UniqueName: \"kubernetes.io/projected/7aa4add0-de80-4e59-be7d-914d361b8a16-kube-api-access-l2sgb\") pod \"kube-auth-proxy-85b8bff76-p9fgz\" (UID: \"7aa4add0-de80-4e59-be7d-914d361b8a16\") " pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"
Sep 11 15:14:26.084780 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:26.084699    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"
Sep 11 15:14:26.356451 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:26.356429    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz"]
Sep 11 15:14:26.358942 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:14:26.358918    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa4add0_de80_4e59_be7d_914d361b8a16.slice/crio-18e8a5688d6ca6aeb9c6d325c1e64ed3327bc6d5498f5d22bb97891df222317a WatchSource:0}: Error finding container 18e8a5688d6ca6aeb9c6d325c1e64ed3327bc6d5498f5d22bb97891df222317a: Status 404 returned error can't find the container with id 18e8a5688d6ca6aeb9c6d325c1e64ed3327bc6d5498f5d22bb97891df222317a
Sep 11 15:14:27.171714 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.171684    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"]
Sep 11 15:14:27.173962 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.173947    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.179678 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.179655    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 15:14:27.179678 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.179673    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 15:14:27.179864 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.179655    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 15:14:27.185484 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.185465    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gr6n7\""
Sep 11 15:14:27.188152 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.188136    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 15:14:27.201877 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.201608    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"]
Sep 11 15:14:27.285437 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.285391    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.285437 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.285439    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.285751 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.285533    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfh74\" (UniqueName: \"kubernetes.io/projected/bb4c9f90-935b-4550-a3b6-939228ccd587-kube-api-access-vfh74\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.285751 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.285575    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.285751 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.285634    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.285751 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.285676    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.285751 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.285714    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb4c9f90-935b-4550-a3b6-939228ccd587-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.351481 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.351442    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz" event={"ID":"7aa4add0-de80-4e59-be7d-914d361b8a16","Type":"ContainerStarted","Data":"18e8a5688d6ca6aeb9c6d325c1e64ed3327bc6d5498f5d22bb97891df222317a"}
Sep 11 15:14:27.386991 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.386963    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.387182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.386998    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.387182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.387037    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfh74\" (UniqueName: \"kubernetes.io/projected/bb4c9f90-935b-4550-a3b6-939228ccd587-kube-api-access-vfh74\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.387182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.387073    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.387182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.387103    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.387182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.387125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.387182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.387145    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb4c9f90-935b-4550-a3b6-939228ccd587-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.387935 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.387889    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.389996 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.389945    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb4c9f90-935b-4550-a3b6-939228ccd587-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.390102 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.390037    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.390319 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.390289    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.390420 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.390300    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.396562 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.396540    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.396562 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.396548    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfh74\" (UniqueName: \"kubernetes.io/projected/bb4c9f90-935b-4550-a3b6-939228ccd587-kube-api-access-vfh74\") pod \"istiod-openshift-gateway-7b7995d5cd-bd6hh\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.483669 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.483571    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:27.765565 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:27.765473    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"]
Sep 11 15:14:27.770187 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:14:27.770145    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb4c9f90_935b_4550_a3b6_939228ccd587.slice/crio-660da33bd5dc67d3339d73ad64eecabbd1d91a1e6cfc028023db1826a4889837 WatchSource:0}: Error finding container 660da33bd5dc67d3339d73ad64eecabbd1d91a1e6cfc028023db1826a4889837: Status 404 returned error can't find the container with id 660da33bd5dc67d3339d73ad64eecabbd1d91a1e6cfc028023db1826a4889837
Sep 11 15:14:28.356933 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:28.356890    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh" event={"ID":"bb4c9f90-935b-4550-a3b6-939228ccd587","Type":"ContainerStarted","Data":"660da33bd5dc67d3339d73ad64eecabbd1d91a1e6cfc028023db1826a4889837"}
Sep 11 15:14:29.361803 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:29.361770    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz" event={"ID":"7aa4add0-de80-4e59-be7d-914d361b8a16","Type":"ContainerStarted","Data":"a77dcfd9a1f8b7a3736e4471c03ec7bdf7c9f8ade440dca9f6f19319c7ec972a"}
Sep 11 15:14:29.378609 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:29.378566    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85b8bff76-p9fgz" podStartSLOduration=1.457604312 podStartE2EDuration="4.378550616s" totalImagesPullingTime="2.920946304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:14:29.377428003 +0000 UTC m=+343.837145000" watchObservedRunningTime="2026-09-11 15:14:29.378550616 +0000 UTC m=+343.838267614"
Sep 11 15:14:44.035033 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:44.034995    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:14:44.035336 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:44.035078    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:14:44.421593 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:44.421562    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh" event={"ID":"bb4c9f90-935b-4550-a3b6-939228ccd587","Type":"ContainerStarted","Data":"2ec8eb3586d218b7cb441e1ed99eb2628a2c860ca99874a786b8395186481392"}
Sep 11 15:14:44.421790 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:44.421664    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:44.446948 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:44.446901    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh" podStartSLOduration=1.184554114 podStartE2EDuration="17.446885379s" totalImagesPullingTime="16.262331265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:14:44.445205455 +0000 UTC m=+358.904922454" watchObservedRunningTime="2026-09-11 15:14:44.446885379 +0000 UTC m=+358.906602376"
Sep 11 15:14:45.428645 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:45.428583    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-bd6hh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 15:14:45.429084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:45.428690    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh" podUID="bb4c9f90-935b-4550-a3b6-939228ccd587" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 15:14:46.155597 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.155566    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"]
Sep 11 15:14:46.158591 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.158572    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.163245 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.163222    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8x2j8\""
Sep 11 15:14:46.192153 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.192126    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"]
Sep 11 15:14:46.238565 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.238538    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.238565 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.238569    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.238780 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.238588    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e36c575-4d64-4153-9702-9636e4cd0dfd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.238780 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.238639    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.238780 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.238662    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e36c575-4d64-4153-9702-9636e4cd0dfd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.238780 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.238695    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.238780 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.238727    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e36c575-4d64-4153-9702-9636e4cd0dfd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.238780 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.238741    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq6xp\" (UniqueName: \"kubernetes.io/projected/1e36c575-4d64-4153-9702-9636e4cd0dfd-kube-api-access-zq6xp\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.238967 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.238792    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.339393 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.339364    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e36c575-4d64-4153-9702-9636e4cd0dfd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.339560 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.339402    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq6xp\" (UniqueName: \"kubernetes.io/projected/1e36c575-4d64-4153-9702-9636e4cd0dfd-kube-api-access-zq6xp\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.339560 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.339474    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.339560 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.339511    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.339560 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.339537    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.339794 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.339561    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e36c575-4d64-4153-9702-9636e4cd0dfd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.339794 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.339605    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.339794 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.339646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e36c575-4d64-4153-9702-9636e4cd0dfd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.339794 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.339695    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.340021 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.339995    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.340095 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.340072    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.340154 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.340109    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.340298 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.340264    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.340664 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.340644    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e36c575-4d64-4153-9702-9636e4cd0dfd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.342843 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.342822    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e36c575-4d64-4153-9702-9636e4cd0dfd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.343006 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.342987    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e36c575-4d64-4153-9702-9636e4cd0dfd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.357206 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.357171    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq6xp\" (UniqueName: \"kubernetes.io/projected/1e36c575-4d64-4153-9702-9636e4cd0dfd-kube-api-access-zq6xp\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.358522 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.358499    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e36c575-4d64-4153-9702-9636e4cd0dfd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cstcvc\" (UID: \"1e36c575-4d64-4153-9702-9636e4cd0dfd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.418098 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.418026    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"]
Sep 11 15:14:46.421184 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.421166    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"
Sep 11 15:14:46.423889 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.423863    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-t9z9v\""
Sep 11 15:14:46.424083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.424069    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 15:14:46.427045 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.427027    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"]
Sep 11 15:14:46.429068 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.429050    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"
Sep 11 15:14:46.433661 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.433602    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 15:14:46.433832 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.433812    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-tt9dq\""
Sep 11 15:14:46.435366 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.435346    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"]
Sep 11 15:14:46.452112 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.452085    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"]
Sep 11 15:14:46.468417 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.468391    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:46.541216 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.541094    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfbcec46-30a2-4b6e-846f-a95c74b0cc88-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8mn2j\" (UID: \"cfbcec46-30a2-4b6e-846f-a95c74b0cc88\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"
Sep 11 15:14:46.541216 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.541216    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d82d1815-29af-4e5d-8aec-6191e37c0282-cert\") pod \"kserve-controller-manager-d6f4b65b8-zs2fk\" (UID: \"d82d1815-29af-4e5d-8aec-6191e37c0282\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"
Sep 11 15:14:46.541514 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.541258    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxpv4\" (UniqueName: \"kubernetes.io/projected/cfbcec46-30a2-4b6e-846f-a95c74b0cc88-kube-api-access-vxpv4\") pod \"llmisvc-controller-manager-777c6bd7d5-8mn2j\" (UID: \"cfbcec46-30a2-4b6e-846f-a95c74b0cc88\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"
Sep 11 15:14:46.541514 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.541297    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlmp4\" (UniqueName: \"kubernetes.io/projected/d82d1815-29af-4e5d-8aec-6191e37c0282-kube-api-access-qlmp4\") pod \"kserve-controller-manager-d6f4b65b8-zs2fk\" (UID: \"d82d1815-29af-4e5d-8aec-6191e37c0282\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"
Sep 11 15:14:46.642092 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.642059    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxpv4\" (UniqueName: \"kubernetes.io/projected/cfbcec46-30a2-4b6e-846f-a95c74b0cc88-kube-api-access-vxpv4\") pod \"llmisvc-controller-manager-777c6bd7d5-8mn2j\" (UID: \"cfbcec46-30a2-4b6e-846f-a95c74b0cc88\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"
Sep 11 15:14:46.642092 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.642109    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlmp4\" (UniqueName: \"kubernetes.io/projected/d82d1815-29af-4e5d-8aec-6191e37c0282-kube-api-access-qlmp4\") pod \"kserve-controller-manager-d6f4b65b8-zs2fk\" (UID: \"d82d1815-29af-4e5d-8aec-6191e37c0282\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"
Sep 11 15:14:46.642337 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.642234    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfbcec46-30a2-4b6e-846f-a95c74b0cc88-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8mn2j\" (UID: \"cfbcec46-30a2-4b6e-846f-a95c74b0cc88\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"
Sep 11 15:14:46.642337 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.642303    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d82d1815-29af-4e5d-8aec-6191e37c0282-cert\") pod \"kserve-controller-manager-d6f4b65b8-zs2fk\" (UID: \"d82d1815-29af-4e5d-8aec-6191e37c0282\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"
Sep 11 15:14:46.644717 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.644696    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfbcec46-30a2-4b6e-846f-a95c74b0cc88-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8mn2j\" (UID: \"cfbcec46-30a2-4b6e-846f-a95c74b0cc88\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"
Sep 11 15:14:46.644807 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.644773    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d82d1815-29af-4e5d-8aec-6191e37c0282-cert\") pod \"kserve-controller-manager-d6f4b65b8-zs2fk\" (UID: \"d82d1815-29af-4e5d-8aec-6191e37c0282\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"
Sep 11 15:14:46.667327 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.667303    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxpv4\" (UniqueName: \"kubernetes.io/projected/cfbcec46-30a2-4b6e-846f-a95c74b0cc88-kube-api-access-vxpv4\") pod \"llmisvc-controller-manager-777c6bd7d5-8mn2j\" (UID: \"cfbcec46-30a2-4b6e-846f-a95c74b0cc88\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"
Sep 11 15:14:46.667544 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.667527    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlmp4\" (UniqueName: \"kubernetes.io/projected/d82d1815-29af-4e5d-8aec-6191e37c0282-kube-api-access-qlmp4\") pod \"kserve-controller-manager-d6f4b65b8-zs2fk\" (UID: \"d82d1815-29af-4e5d-8aec-6191e37c0282\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"
Sep 11 15:14:46.733862 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.733785    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"
Sep 11 15:14:46.741264 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.741240    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"
Sep 11 15:14:46.754433 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:46.754407    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"]
Sep 11 15:14:46.757645 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:14:46.757601    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e36c575_4d64_4153_9702_9636e4cd0dfd.slice/crio-e6c96c2bdd87512c8403576ab2a6fd2210ea5a3ab86b0f07021f336dd4b42fc6 WatchSource:0}: Error finding container e6c96c2bdd87512c8403576ab2a6fd2210ea5a3ab86b0f07021f336dd4b42fc6: Status 404 returned error can't find the container with id e6c96c2bdd87512c8403576ab2a6fd2210ea5a3ab86b0f07021f336dd4b42fc6
Sep 11 15:14:47.020649 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:47.020605    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"]
Sep 11 15:14:47.021716 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:14:47.021689    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82d1815_29af_4e5d_8aec_6191e37c0282.slice/crio-ae3f9989ce7fa4246ae46cf2832707f80b690c53445ebd680563c1c460100049 WatchSource:0}: Error finding container ae3f9989ce7fa4246ae46cf2832707f80b690c53445ebd680563c1c460100049: Status 404 returned error can't find the container with id ae3f9989ce7fa4246ae46cf2832707f80b690c53445ebd680563c1c460100049
Sep 11 15:14:47.037120 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:47.037099    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"]
Sep 11 15:14:47.042316 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:14:47.042297    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcfbcec46_30a2_4b6e_846f_a95c74b0cc88.slice/crio-694deffbd2e825b56a20b1c6e8663343fc9fe4f1cafb1329277d5cd515c25ad2 WatchSource:0}: Error finding container 694deffbd2e825b56a20b1c6e8663343fc9fe4f1cafb1329277d5cd515c25ad2: Status 404 returned error can't find the container with id 694deffbd2e825b56a20b1c6e8663343fc9fe4f1cafb1329277d5cd515c25ad2
Sep 11 15:14:47.435595 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:47.435556    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc" event={"ID":"1e36c575-4d64-4153-9702-9636e4cd0dfd","Type":"ContainerStarted","Data":"e6c96c2bdd87512c8403576ab2a6fd2210ea5a3ab86b0f07021f336dd4b42fc6"}
Sep 11 15:14:47.436721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:47.436699    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j" event={"ID":"cfbcec46-30a2-4b6e-846f-a95c74b0cc88","Type":"ContainerStarted","Data":"694deffbd2e825b56a20b1c6e8663343fc9fe4f1cafb1329277d5cd515c25ad2"}
Sep 11 15:14:47.437909 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:47.437890    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk" event={"ID":"d82d1815-29af-4e5d-8aec-6191e37c0282","Type":"ContainerStarted","Data":"ae3f9989ce7fa4246ae46cf2832707f80b690c53445ebd680563c1c460100049"}
Sep 11 15:14:48.081067 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.081028    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"]
Sep 11 15:14:48.081310 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.081255    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh" podUID="bb4c9f90-935b-4550-a3b6-939228ccd587" containerName="discovery" containerID="cri-o://2ec8eb3586d218b7cb441e1ed99eb2628a2c860ca99874a786b8395186481392" gracePeriod=30
Sep 11 15:14:48.083558 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.083532    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:48.447000 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.446959    2574 generic.go:356] "Generic (PLEG): container finished" podID="bb4c9f90-935b-4550-a3b6-939228ccd587" containerID="2ec8eb3586d218b7cb441e1ed99eb2628a2c860ca99874a786b8395186481392" exitCode=0
Sep 11 15:14:48.447441 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.447027    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh" event={"ID":"bb4c9f90-935b-4550-a3b6-939228ccd587","Type":"ContainerDied","Data":"2ec8eb3586d218b7cb441e1ed99eb2628a2c860ca99874a786b8395186481392"}
Sep 11 15:14:48.484166 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.484139    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:48.558782 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.558756    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-cacerts\") pod \"bb4c9f90-935b-4550-a3b6-939228ccd587\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") "
Sep 11 15:14:48.558940 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.558805    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-kubeconfig\") pod \"bb4c9f90-935b-4550-a3b6-939228ccd587\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") "
Sep 11 15:14:48.558940 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.558851    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-csr-ca-configmap\") pod \"bb4c9f90-935b-4550-a3b6-939228ccd587\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") "
Sep 11 15:14:48.558940 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.558890    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-token\") pod \"bb4c9f90-935b-4550-a3b6-939228ccd587\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") "
Sep 11 15:14:48.558940 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.558910    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb4c9f90-935b-4550-a3b6-939228ccd587-local-certs\") pod \"bb4c9f90-935b-4550-a3b6-939228ccd587\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") "
Sep 11 15:14:48.559155 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.558957    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfh74\" (UniqueName: \"kubernetes.io/projected/bb4c9f90-935b-4550-a3b6-939228ccd587-kube-api-access-vfh74\") pod \"bb4c9f90-935b-4550-a3b6-939228ccd587\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") "
Sep 11 15:14:48.559155 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.559007    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-csr-dns-cert\") pod \"bb4c9f90-935b-4550-a3b6-939228ccd587\" (UID: \"bb4c9f90-935b-4550-a3b6-939228ccd587\") "
Sep 11 15:14:48.560068 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.559955    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "bb4c9f90-935b-4550-a3b6-939228ccd587" (UID: "bb4c9f90-935b-4550-a3b6-939228ccd587"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:14:48.563991 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.563961    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-cacerts" (OuterVolumeSpecName: "cacerts") pod "bb4c9f90-935b-4550-a3b6-939228ccd587" (UID: "bb4c9f90-935b-4550-a3b6-939228ccd587"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:14:48.564843 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.564806    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-token" (OuterVolumeSpecName: "istio-token") pod "bb4c9f90-935b-4550-a3b6-939228ccd587" (UID: "bb4c9f90-935b-4550-a3b6-939228ccd587"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:14:48.565518 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.565469    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "bb4c9f90-935b-4550-a3b6-939228ccd587" (UID: "bb4c9f90-935b-4550-a3b6-939228ccd587"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:14:48.565823 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.565799    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "bb4c9f90-935b-4550-a3b6-939228ccd587" (UID: "bb4c9f90-935b-4550-a3b6-939228ccd587"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:14:48.565911 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.565851    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb4c9f90-935b-4550-a3b6-939228ccd587-local-certs" (OuterVolumeSpecName: "local-certs") pod "bb4c9f90-935b-4550-a3b6-939228ccd587" (UID: "bb4c9f90-935b-4550-a3b6-939228ccd587"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:14:48.566081 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.566054    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb4c9f90-935b-4550-a3b6-939228ccd587-kube-api-access-vfh74" (OuterVolumeSpecName: "kube-api-access-vfh74") pod "bb4c9f90-935b-4550-a3b6-939228ccd587" (UID: "bb4c9f90-935b-4550-a3b6-939228ccd587"). InnerVolumeSpecName "kube-api-access-vfh74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:14:48.660134 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.660101    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-csr-dns-cert\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:14:48.660134 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.660132    2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-cacerts\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:14:48.660353 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.660164    2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-kubeconfig\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:14:48.660353 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.660174    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-csr-ca-configmap\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:14:48.660353 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.660183    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb4c9f90-935b-4550-a3b6-939228ccd587-istio-token\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:14:48.660353 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.660191    2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb4c9f90-935b-4550-a3b6-939228ccd587-local-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:14:48.660353 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:48.660198    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfh74\" (UniqueName: \"kubernetes.io/projected/bb4c9f90-935b-4550-a3b6-939228ccd587-kube-api-access-vfh74\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:14:49.454389 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:49.454360    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"
Sep 11 15:14:49.454927 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:49.454359    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh" event={"ID":"bb4c9f90-935b-4550-a3b6-939228ccd587","Type":"ContainerDied","Data":"660da33bd5dc67d3339d73ad64eecabbd1d91a1e6cfc028023db1826a4889837"}
Sep 11 15:14:49.454927 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:49.454504    2574 scope.go:117] "RemoveContainer" containerID="2ec8eb3586d218b7cb441e1ed99eb2628a2c860ca99874a786b8395186481392"
Sep 11 15:14:49.485761 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:49.485734    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"]
Sep 11 15:14:49.487862 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:49.487841    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bd6hh"]
Sep 11 15:14:49.995198 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:49.995166    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb4c9f90-935b-4550-a3b6-939228ccd587" path="/var/lib/kubelet/pods/bb4c9f90-935b-4550-a3b6-939228ccd587/volumes"
Sep 11 15:14:51.246856 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:51.246812    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:14:51.247118 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:51.246893    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:14:51.247118 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:51.246920    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:14:51.467016 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:51.466972    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j" event={"ID":"cfbcec46-30a2-4b6e-846f-a95c74b0cc88","Type":"ContainerStarted","Data":"abdd55f334330ad78db1e189e7db93707e89e6b550b930688a3698bf0e21e912"}
Sep 11 15:14:51.467195 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:51.467108    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"
Sep 11 15:14:51.468881 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:51.468855    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk" event={"ID":"d82d1815-29af-4e5d-8aec-6191e37c0282","Type":"ContainerStarted","Data":"61f33e03fc6664175d9f92f3a25a59dce76499814bfab1d8151a78e2b35a9aa3"}
Sep 11 15:14:51.469009 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:51.468949    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"
Sep 11 15:14:51.471426 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:51.471408    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc" event={"ID":"1e36c575-4d64-4153-9702-9636e4cd0dfd","Type":"ContainerStarted","Data":"c7136053ad6c0b843f980d713f965afda5ebc32a459d094f270639249b8b8e4d"}
Sep 11 15:14:51.485983 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:51.485900    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j" podStartSLOduration=1.280624988 podStartE2EDuration="5.485881857s" totalImagesPullingTime="4.205256869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:14:51.482845414 +0000 UTC m=+365.942562413" watchObservedRunningTime="2026-09-11 15:14:51.485881857 +0000 UTC m=+365.945598856"
Sep 11 15:14:51.503625 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:51.503572    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc" podStartSLOduration=1.0174739289999999 podStartE2EDuration="5.503556988s" totalImagesPullingTime="4.486083059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:14:51.502942314 +0000 UTC m=+365.962659315" watchObservedRunningTime="2026-09-11 15:14:51.503556988 +0000 UTC m=+365.963273987"
Sep 11 15:14:51.519558 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:51.519511    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk" podStartSLOduration=1.291190892 podStartE2EDuration="5.519497188s" totalImagesPullingTime="4.228306296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:14:51.517895169 +0000 UTC m=+365.977612170" watchObservedRunningTime="2026-09-11 15:14:51.519497188 +0000 UTC m=+365.979214187"
Sep 11 15:14:52.468998 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:52.468960    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:52.473493 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:52.473471    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:52.476470 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:52.476452    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:14:52.476974 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:14:52.476956    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cstcvc"
Sep 11 15:15:22.478779 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:22.478745    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mn2j"
Sep 11 15:15:22.481594 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:22.481574    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs2fk"
Sep 11 15:15:56.783873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:56.783838    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"]
Sep 11 15:15:56.784253 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:56.784116    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb4c9f90-935b-4550-a3b6-939228ccd587" containerName="discovery"
Sep 11 15:15:56.784253 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:56.784126    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb4c9f90-935b-4550-a3b6-939228ccd587" containerName="discovery"
Sep 11 15:15:56.784253 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:56.784185    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb4c9f90-935b-4550-a3b6-939228ccd587" containerName="discovery"
Sep 11 15:15:56.786687 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:56.786672    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:15:56.789531 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:56.789508    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wrj9z\""
Sep 11 15:15:56.789789 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:56.789774    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 15:15:56.789864 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:56.789847    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 15:15:56.799485 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:56.799466    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"]
Sep 11 15:15:56.899745 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:56.899715    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxmlb\" (UniqueName: \"kubernetes.io/projected/7dfca9c4-82ac-4c10-b387-25513bfadb61-kube-api-access-gxmlb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wdpvc\" (UID: \"7dfca9c4-82ac-4c10-b387-25513bfadb61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:15:56.899872 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:56.899761    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dfca9c4-82ac-4c10-b387-25513bfadb61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wdpvc\" (UID: \"7dfca9c4-82ac-4c10-b387-25513bfadb61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:15:57.001012 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:57.000984    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dfca9c4-82ac-4c10-b387-25513bfadb61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wdpvc\" (UID: \"7dfca9c4-82ac-4c10-b387-25513bfadb61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:15:57.001123 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:57.001048    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxmlb\" (UniqueName: \"kubernetes.io/projected/7dfca9c4-82ac-4c10-b387-25513bfadb61-kube-api-access-gxmlb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wdpvc\" (UID: \"7dfca9c4-82ac-4c10-b387-25513bfadb61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:15:57.001351 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:57.001332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dfca9c4-82ac-4c10-b387-25513bfadb61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wdpvc\" (UID: \"7dfca9c4-82ac-4c10-b387-25513bfadb61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:15:57.010469 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:57.010445    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxmlb\" (UniqueName: \"kubernetes.io/projected/7dfca9c4-82ac-4c10-b387-25513bfadb61-kube-api-access-gxmlb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wdpvc\" (UID: \"7dfca9c4-82ac-4c10-b387-25513bfadb61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:15:57.096498 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:57.096436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:15:57.372040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:57.372017    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"]
Sep 11 15:15:57.375414 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:15:57.375370    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfca9c4_82ac_4c10_b387_25513bfadb61.slice/crio-fc32da823e3620b547113e8c672f55cfebd236f51383af7798336e43ca851dfb WatchSource:0}: Error finding container fc32da823e3620b547113e8c672f55cfebd236f51383af7798336e43ca851dfb: Status 404 returned error can't find the container with id fc32da823e3620b547113e8c672f55cfebd236f51383af7798336e43ca851dfb
Sep 11 15:15:57.738195 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:57.738124    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc" event={"ID":"7dfca9c4-82ac-4c10-b387-25513bfadb61","Type":"ContainerStarted","Data":"fc32da823e3620b547113e8c672f55cfebd236f51383af7798336e43ca851dfb"}
Sep 11 15:15:59.313982 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:59.313943    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-jkfs4"]
Sep 11 15:15:59.321126 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:59.321100    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-jkfs4"
Sep 11 15:15:59.332220 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:59.331664    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lmkwg\""
Sep 11 15:15:59.332447 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:59.332385    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-jkfs4"]
Sep 11 15:15:59.423835 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:59.423796    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxw6k\" (UniqueName: \"kubernetes.io/projected/6885e70b-8735-4dcf-a209-9ea73d422e55-kube-api-access-bxw6k\") pod \"authorino-operator-76b478bd78-jkfs4\" (UID: \"6885e70b-8735-4dcf-a209-9ea73d422e55\") " pod="kuadrant-system/authorino-operator-76b478bd78-jkfs4"
Sep 11 15:15:59.524685 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:59.524646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxw6k\" (UniqueName: \"kubernetes.io/projected/6885e70b-8735-4dcf-a209-9ea73d422e55-kube-api-access-bxw6k\") pod \"authorino-operator-76b478bd78-jkfs4\" (UID: \"6885e70b-8735-4dcf-a209-9ea73d422e55\") " pod="kuadrant-system/authorino-operator-76b478bd78-jkfs4"
Sep 11 15:15:59.537260 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:59.537222    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxw6k\" (UniqueName: \"kubernetes.io/projected/6885e70b-8735-4dcf-a209-9ea73d422e55-kube-api-access-bxw6k\") pod \"authorino-operator-76b478bd78-jkfs4\" (UID: \"6885e70b-8735-4dcf-a209-9ea73d422e55\") " pod="kuadrant-system/authorino-operator-76b478bd78-jkfs4"
Sep 11 15:15:59.636874 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:59.636844    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-jkfs4"
Sep 11 15:15:59.924019 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:15:59.923945    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-jkfs4"]
Sep 11 15:16:00.978005 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:16:00.977974    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6885e70b_8735_4dcf_a209_9ea73d422e55.slice/crio-498b3502cae80566dc62716012a6546bd7870561cc0ae8701ebb49eb63c95f75 WatchSource:0}: Error finding container 498b3502cae80566dc62716012a6546bd7870561cc0ae8701ebb49eb63c95f75: Status 404 returned error can't find the container with id 498b3502cae80566dc62716012a6546bd7870561cc0ae8701ebb49eb63c95f75
Sep 11 15:16:01.758179 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:01.758122    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc" event={"ID":"7dfca9c4-82ac-4c10-b387-25513bfadb61","Type":"ContainerStarted","Data":"814c0619d59bbb1d76921bb1a813dd1ee0ca23bab3594c0761c3316abe582154"}
Sep 11 15:16:01.758370 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:01.758226    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:16:01.759494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:01.759470    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-jkfs4" event={"ID":"6885e70b-8735-4dcf-a209-9ea73d422e55","Type":"ContainerStarted","Data":"498b3502cae80566dc62716012a6546bd7870561cc0ae8701ebb49eb63c95f75"}
Sep 11 15:16:01.818733 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:01.818684    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc" podStartSLOduration=2.150519862 podStartE2EDuration="5.81867054s" totalImagesPullingTime="3.668150678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:16:01.815308861 +0000 UTC m=+436.275025871" watchObservedRunningTime="2026-09-11 15:16:01.81867054 +0000 UTC m=+436.278387538"
Sep 11 15:16:01.948080 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:01.948050    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv"]
Sep 11 15:16:01.951360 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:01.951345    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv"
Sep 11 15:16:01.954594 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:01.954571    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 15:16:01.954866 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:01.954839    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-sdvc6\""
Sep 11 15:16:01.984178 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:01.984150    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv"]
Sep 11 15:16:02.049053 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:02.048982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24prr\" (UniqueName: \"kubernetes.io/projected/85e26c9f-1b35-4352-81bb-4463f2c8697a-kube-api-access-24prr\") pod \"dns-operator-controller-manager-7b84cd7c9c-bh4bv\" (UID: \"85e26c9f-1b35-4352-81bb-4463f2c8697a\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv"
Sep 11 15:16:02.149649 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:02.149596    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24prr\" (UniqueName: \"kubernetes.io/projected/85e26c9f-1b35-4352-81bb-4463f2c8697a-kube-api-access-24prr\") pod \"dns-operator-controller-manager-7b84cd7c9c-bh4bv\" (UID: \"85e26c9f-1b35-4352-81bb-4463f2c8697a\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv"
Sep 11 15:16:02.160879 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:02.160853    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24prr\" (UniqueName: \"kubernetes.io/projected/85e26c9f-1b35-4352-81bb-4463f2c8697a-kube-api-access-24prr\") pod \"dns-operator-controller-manager-7b84cd7c9c-bh4bv\" (UID: \"85e26c9f-1b35-4352-81bb-4463f2c8697a\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv"
Sep 11 15:16:02.260920 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:02.260885    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv"
Sep 11 15:16:02.561694 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:02.561566    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv"]
Sep 11 15:16:02.565006 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:16:02.564978    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e26c9f_1b35_4352_81bb_4463f2c8697a.slice/crio-62b38a89d14bcded749ac76225153ef5bfe79b8a0486656b362ba4a81f1da332 WatchSource:0}: Error finding container 62b38a89d14bcded749ac76225153ef5bfe79b8a0486656b362ba4a81f1da332: Status 404 returned error can't find the container with id 62b38a89d14bcded749ac76225153ef5bfe79b8a0486656b362ba4a81f1da332
Sep 11 15:16:02.765441 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:02.765407    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv" event={"ID":"85e26c9f-1b35-4352-81bb-4463f2c8697a","Type":"ContainerStarted","Data":"62b38a89d14bcded749ac76225153ef5bfe79b8a0486656b362ba4a81f1da332"}
Sep 11 15:16:03.688084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.688047    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"]
Sep 11 15:16:03.691555 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.691527    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"
Sep 11 15:16:03.695399 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.695347    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 15:16:03.695526 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.695513    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j4wv2\""
Sep 11 15:16:03.697582 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.697562    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 15:16:03.706085 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.706067    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"]
Sep 11 15:16:03.866805 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.866769    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpmk7\" (UniqueName: \"kubernetes.io/projected/2177d6e5-86a2-46b6-b2f4-016e45011b19-kube-api-access-kpmk7\") pod \"kuadrant-console-plugin-fbdd4f445-b2kvd\" (UID: \"2177d6e5-86a2-46b6-b2f4-016e45011b19\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"
Sep 11 15:16:03.866972 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.866846    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2177d6e5-86a2-46b6-b2f4-016e45011b19-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-b2kvd\" (UID: \"2177d6e5-86a2-46b6-b2f4-016e45011b19\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"
Sep 11 15:16:03.866972 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.866912    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2177d6e5-86a2-46b6-b2f4-016e45011b19-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-b2kvd\" (UID: \"2177d6e5-86a2-46b6-b2f4-016e45011b19\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"
Sep 11 15:16:03.968388 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.968315    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpmk7\" (UniqueName: \"kubernetes.io/projected/2177d6e5-86a2-46b6-b2f4-016e45011b19-kube-api-access-kpmk7\") pod \"kuadrant-console-plugin-fbdd4f445-b2kvd\" (UID: \"2177d6e5-86a2-46b6-b2f4-016e45011b19\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"
Sep 11 15:16:03.968544 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.968401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2177d6e5-86a2-46b6-b2f4-016e45011b19-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-b2kvd\" (UID: \"2177d6e5-86a2-46b6-b2f4-016e45011b19\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"
Sep 11 15:16:03.968544 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.968437    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2177d6e5-86a2-46b6-b2f4-016e45011b19-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-b2kvd\" (UID: \"2177d6e5-86a2-46b6-b2f4-016e45011b19\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"
Sep 11 15:16:03.969211 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.969163    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2177d6e5-86a2-46b6-b2f4-016e45011b19-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-b2kvd\" (UID: \"2177d6e5-86a2-46b6-b2f4-016e45011b19\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"
Sep 11 15:16:03.971299 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.971275    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2177d6e5-86a2-46b6-b2f4-016e45011b19-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-b2kvd\" (UID: \"2177d6e5-86a2-46b6-b2f4-016e45011b19\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"
Sep 11 15:16:03.981161 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:03.981138    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpmk7\" (UniqueName: \"kubernetes.io/projected/2177d6e5-86a2-46b6-b2f4-016e45011b19-kube-api-access-kpmk7\") pod \"kuadrant-console-plugin-fbdd4f445-b2kvd\" (UID: \"2177d6e5-86a2-46b6-b2f4-016e45011b19\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"
Sep 11 15:16:04.002285 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:04.002263    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"
Sep 11 15:16:04.458693 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:16:04.458667    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2177d6e5_86a2_46b6_b2f4_016e45011b19.slice/crio-fde9290ce4dd001a0b5465da852a2c76362b94dab644445bc99cac86fdc1d696 WatchSource:0}: Error finding container fde9290ce4dd001a0b5465da852a2c76362b94dab644445bc99cac86fdc1d696: Status 404 returned error can't find the container with id fde9290ce4dd001a0b5465da852a2c76362b94dab644445bc99cac86fdc1d696
Sep 11 15:16:04.471163 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:04.471133    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd"]
Sep 11 15:16:04.776304 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:04.776266    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv" event={"ID":"85e26c9f-1b35-4352-81bb-4463f2c8697a","Type":"ContainerStarted","Data":"774ab0c26f97a7dc211cf89b85d4c63c9d10872de2377267750b78d3ed7be550"}
Sep 11 15:16:04.776804 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:04.776383    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv"
Sep 11 15:16:04.777488 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:04.777465    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd" event={"ID":"2177d6e5-86a2-46b6-b2f4-016e45011b19","Type":"ContainerStarted","Data":"fde9290ce4dd001a0b5465da852a2c76362b94dab644445bc99cac86fdc1d696"}
Sep 11 15:16:04.805430 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:04.805391    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv" podStartSLOduration=2.137682189 podStartE2EDuration="3.805378299s" totalImagesPullingTime="1.66769611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:16:04.805060334 +0000 UTC m=+439.264777333" watchObservedRunningTime="2026-09-11 15:16:04.805378299 +0000 UTC m=+439.265095297"
Sep 11 15:16:08.796858 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:08.796824    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd" event={"ID":"2177d6e5-86a2-46b6-b2f4-016e45011b19","Type":"ContainerStarted","Data":"816eadd89cf036b6f765aa5a3e1dbd1ec7dded77639417f834bbfc521fa60d95"}
Sep 11 15:16:12.768091 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:12.768056    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:16:12.840403 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:12.840351    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b2kvd" podStartSLOduration=5.592895083 podStartE2EDuration="9.840335853s" totalImagesPullingTime="4.24744077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:16:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:16:08.822747052 +0000 UTC m=+443.282464047" watchObservedRunningTime="2026-09-11 15:16:12.840335853 +0000 UTC m=+447.300052885"
Sep 11 15:16:14.829140 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:14.829058    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-jkfs4" event={"ID":"6885e70b-8735-4dcf-a209-9ea73d422e55","Type":"ContainerStarted","Data":"777a3d322a495aa5f288f984158ffd0d67a23e177959548ae0b3f1d3c8bc86ad"}
Sep 11 15:16:14.829471 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:14.829213    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-jkfs4"
Sep 11 15:16:14.945988 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:14.945940    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-jkfs4" podStartSLOduration=2.366130923 podStartE2EDuration="15.945924886s" totalImagesPullingTime="13.579793963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:15:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:16:14.944552679 +0000 UTC m=+449.404269678" watchObservedRunningTime="2026-09-11 15:16:14.945924886 +0000 UTC m=+449.405641884"
Sep 11 15:16:15.658648 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.658600    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"]
Sep 11 15:16:15.658825 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.658806    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc" podUID="7dfca9c4-82ac-4c10-b387-25513bfadb61" containerName="manager" containerID="cri-o://814c0619d59bbb1d76921bb1a813dd1ee0ca23bab3594c0761c3316abe582154" gracePeriod=2
Sep 11 15:16:15.672554 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.672532    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"]
Sep 11 15:16:15.742968 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.742941    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"]
Sep 11 15:16:15.743508 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.743485    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfca9c4-82ac-4c10-b387-25513bfadb61" containerName="manager"
Sep 11 15:16:15.743668 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.743517    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfca9c4-82ac-4c10-b387-25513bfadb61" containerName="manager"
Sep 11 15:16:15.743731 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.743691    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfca9c4-82ac-4c10-b387-25513bfadb61" containerName="manager"
Sep 11 15:16:15.746583 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.746564    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"
Sep 11 15:16:15.748759 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:16:15.748731    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wdpvc\" is forbidden: User \"system:node:ip-10-0-138-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-215.ec2.internal' and this object" podUID="7dfca9c4-82ac-4c10-b387-25513bfadb61" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:16:15.767418 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.767388    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhnzg\" (UniqueName: \"kubernetes.io/projected/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359-kube-api-access-dhnzg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k4rll\" (UID: \"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"
Sep 11 15:16:15.767508 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.767436    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k4rll\" (UID: \"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"
Sep 11 15:16:15.784899 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.784876    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bh4bv"
Sep 11 15:16:15.832412 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.832382    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"]
Sep 11 15:16:15.838050 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.838024    2574 generic.go:356] "Generic (PLEG): container finished" podID="7dfca9c4-82ac-4c10-b387-25513bfadb61" containerID="814c0619d59bbb1d76921bb1a813dd1ee0ca23bab3594c0761c3316abe582154" exitCode=0
Sep 11 15:16:15.868300 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.868274    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhnzg\" (UniqueName: \"kubernetes.io/projected/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359-kube-api-access-dhnzg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k4rll\" (UID: \"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"
Sep 11 15:16:15.868429 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.868311    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k4rll\" (UID: \"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"
Sep 11 15:16:15.868818 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.868797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k4rll\" (UID: \"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"
Sep 11 15:16:15.905577 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.905555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhnzg\" (UniqueName: \"kubernetes.io/projected/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359-kube-api-access-dhnzg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k4rll\" (UID: \"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"
Sep 11 15:16:15.920126 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.920081    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:16:15.949638 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:16:15.948226    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wdpvc\" is forbidden: User \"system:node:ip-10-0-138-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-215.ec2.internal' and this object" podUID="7dfca9c4-82ac-4c10-b387-25513bfadb61" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:16:15.969416 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.969393    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dfca9c4-82ac-4c10-b387-25513bfadb61-extensions-socket-volume\") pod \"7dfca9c4-82ac-4c10-b387-25513bfadb61\" (UID: \"7dfca9c4-82ac-4c10-b387-25513bfadb61\") "
Sep 11 15:16:15.969547 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.969434    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxmlb\" (UniqueName: \"kubernetes.io/projected/7dfca9c4-82ac-4c10-b387-25513bfadb61-kube-api-access-gxmlb\") pod \"7dfca9c4-82ac-4c10-b387-25513bfadb61\" (UID: \"7dfca9c4-82ac-4c10-b387-25513bfadb61\") "
Sep 11 15:16:15.969903 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.969878    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfca9c4-82ac-4c10-b387-25513bfadb61-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7dfca9c4-82ac-4c10-b387-25513bfadb61" (UID: "7dfca9c4-82ac-4c10-b387-25513bfadb61"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:16:15.971895 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.971871    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfca9c4-82ac-4c10-b387-25513bfadb61-kube-api-access-gxmlb" (OuterVolumeSpecName: "kube-api-access-gxmlb") pod "7dfca9c4-82ac-4c10-b387-25513bfadb61" (UID: "7dfca9c4-82ac-4c10-b387-25513bfadb61"). InnerVolumeSpecName "kube-api-access-gxmlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:16:15.993581 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:15.993559    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dfca9c4-82ac-4c10-b387-25513bfadb61" path="/var/lib/kubelet/pods/7dfca9c4-82ac-4c10-b387-25513bfadb61/volumes"
Sep 11 15:16:16.056240 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:16.056217    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"
Sep 11 15:16:16.070917 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:16.070892    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dfca9c4-82ac-4c10-b387-25513bfadb61-extensions-socket-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:16:16.070917 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:16.070918    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxmlb\" (UniqueName: \"kubernetes.io/projected/7dfca9c4-82ac-4c10-b387-25513bfadb61-kube-api-access-gxmlb\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:16:16.383318 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:16.383294    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"]
Sep 11 15:16:16.385952 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:16:16.385929    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb0cdc7_b2bd_43e5_ac04_13840aaa3359.slice/crio-62b898668c5674f144b0539572c58f8e755a8154e9d331e52f7111d2ebe803bc WatchSource:0}: Error finding container 62b898668c5674f144b0539572c58f8e755a8154e9d331e52f7111d2ebe803bc: Status 404 returned error can't find the container with id 62b898668c5674f144b0539572c58f8e755a8154e9d331e52f7111d2ebe803bc
Sep 11 15:16:16.844151 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:16.844071    2574 scope.go:117] "RemoveContainer" containerID="814c0619d59bbb1d76921bb1a813dd1ee0ca23bab3594c0761c3316abe582154"
Sep 11 15:16:16.844151 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:16.844071    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:16:16.846307 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:16.846246    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll" event={"ID":"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359","Type":"ContainerStarted","Data":"d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd"}
Sep 11 15:16:16.846307 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:16.846298    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll" event={"ID":"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359","Type":"ContainerStarted","Data":"62b898668c5674f144b0539572c58f8e755a8154e9d331e52f7111d2ebe803bc"}
Sep 11 15:16:16.846448 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:16.846361    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"
Sep 11 15:16:16.851082 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:16:16.851050    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wdpvc\" is forbidden: User \"system:node:ip-10-0-138-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-215.ec2.internal' and this object" podUID="7dfca9c4-82ac-4c10-b387-25513bfadb61" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:16:16.857698 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:16:16.857669    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wdpvc\" is forbidden: User \"system:node:ip-10-0-138-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-215.ec2.internal' and this object" podUID="7dfca9c4-82ac-4c10-b387-25513bfadb61" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wdpvc"
Sep 11 15:16:16.923504 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:16.923455    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll" podStartSLOduration=1.92343935 podStartE2EDuration="1.92343935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:16:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:16:16.91980089 +0000 UTC m=+451.379517899" watchObservedRunningTime="2026-09-11 15:16:16.92343935 +0000 UTC m=+451.383156349"
Sep 11 15:16:20.844955 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:20.844918    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"]
Sep 11 15:16:20.849651 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:20.849601    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"
Sep 11 15:16:20.895706 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:20.895676    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"]
Sep 11 15:16:20.909118 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:20.909092    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a1e8af0-5ec9-440a-b029-1040d301e12b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-svxfr\" (UID: \"6a1e8af0-5ec9-440a-b029-1040d301e12b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"
Sep 11 15:16:20.909282 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:20.909144    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzbt6\" (UniqueName: \"kubernetes.io/projected/6a1e8af0-5ec9-440a-b029-1040d301e12b-kube-api-access-pzbt6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-svxfr\" (UID: \"6a1e8af0-5ec9-440a-b029-1040d301e12b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"
Sep 11 15:16:21.010458 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:21.010420    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzbt6\" (UniqueName: \"kubernetes.io/projected/6a1e8af0-5ec9-440a-b029-1040d301e12b-kube-api-access-pzbt6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-svxfr\" (UID: \"6a1e8af0-5ec9-440a-b029-1040d301e12b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"
Sep 11 15:16:21.010672 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:21.010485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a1e8af0-5ec9-440a-b029-1040d301e12b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-svxfr\" (UID: \"6a1e8af0-5ec9-440a-b029-1040d301e12b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"
Sep 11 15:16:21.010835 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:21.010818    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a1e8af0-5ec9-440a-b029-1040d301e12b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-svxfr\" (UID: \"6a1e8af0-5ec9-440a-b029-1040d301e12b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"
Sep 11 15:16:21.025660 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:21.025638    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzbt6\" (UniqueName: \"kubernetes.io/projected/6a1e8af0-5ec9-440a-b029-1040d301e12b-kube-api-access-pzbt6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-svxfr\" (UID: \"6a1e8af0-5ec9-440a-b029-1040d301e12b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"
Sep 11 15:16:21.158905 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:21.158872    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"
Sep 11 15:16:21.463352 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:16:21.463324    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1e8af0_5ec9_440a_b029_1040d301e12b.slice/crio-e76de28a88582861a98a3886e326691fdb1dd0534c65bd85f87f1715cdc334f4 WatchSource:0}: Error finding container e76de28a88582861a98a3886e326691fdb1dd0534c65bd85f87f1715cdc334f4: Status 404 returned error can't find the container with id e76de28a88582861a98a3886e326691fdb1dd0534c65bd85f87f1715cdc334f4
Sep 11 15:16:21.475964 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:21.475942    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"]
Sep 11 15:16:21.872037 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:21.872001    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr" event={"ID":"6a1e8af0-5ec9-440a-b029-1040d301e12b","Type":"ContainerStarted","Data":"bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306"}
Sep 11 15:16:21.872455 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:21.872053    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr" event={"ID":"6a1e8af0-5ec9-440a-b029-1040d301e12b","Type":"ContainerStarted","Data":"e76de28a88582861a98a3886e326691fdb1dd0534c65bd85f87f1715cdc334f4"}
Sep 11 15:16:21.872455 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:21.872089    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"
Sep 11 15:16:21.926242 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:21.926200    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr" podStartSLOduration=1.926181099 podStartE2EDuration="1.926181099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:16:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:16:21.925148573 +0000 UTC m=+456.384865573" watchObservedRunningTime="2026-09-11 15:16:21.926181099 +0000 UTC m=+456.385898098"
Sep 11 15:16:25.840479 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:25.840446    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-jkfs4"
Sep 11 15:16:27.854107 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:27.854079    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"
Sep 11 15:16:32.879445 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:32.879413    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"
Sep 11 15:16:32.937869 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:32.937824    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"]
Sep 11 15:16:32.938066 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:32.938024    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll" podUID="5fb0cdc7-b2bd-43e5-ac04-13840aaa3359" containerName="manager" containerID="cri-o://d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd" gracePeriod=10
Sep 11 15:16:33.213869 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.213842    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"
Sep 11 15:16:33.305670 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.305636    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhnzg\" (UniqueName: \"kubernetes.io/projected/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359-kube-api-access-dhnzg\") pod \"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359\" (UID: \"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359\") "
Sep 11 15:16:33.305848 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.305750    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359-extensions-socket-volume\") pod \"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359\" (UID: \"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359\") "
Sep 11 15:16:33.306092 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.306068    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5fb0cdc7-b2bd-43e5-ac04-13840aaa3359" (UID: "5fb0cdc7-b2bd-43e5-ac04-13840aaa3359"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:16:33.307698 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.307675    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359-kube-api-access-dhnzg" (OuterVolumeSpecName: "kube-api-access-dhnzg") pod "5fb0cdc7-b2bd-43e5-ac04-13840aaa3359" (UID: "5fb0cdc7-b2bd-43e5-ac04-13840aaa3359"). InnerVolumeSpecName "kube-api-access-dhnzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:16:33.406398 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.406318    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359-extensions-socket-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:16:33.406398 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.406347    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhnzg\" (UniqueName: \"kubernetes.io/projected/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359-kube-api-access-dhnzg\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:16:33.926451 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.926419    2574 generic.go:356] "Generic (PLEG): container finished" podID="5fb0cdc7-b2bd-43e5-ac04-13840aaa3359" containerID="d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd" exitCode=0
Sep 11 15:16:33.926875 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.926462    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"
Sep 11 15:16:33.926875 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.926511    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll" event={"ID":"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359","Type":"ContainerDied","Data":"d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd"}
Sep 11 15:16:33.926875 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.926560    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll" event={"ID":"5fb0cdc7-b2bd-43e5-ac04-13840aaa3359","Type":"ContainerDied","Data":"62b898668c5674f144b0539572c58f8e755a8154e9d331e52f7111d2ebe803bc"}
Sep 11 15:16:33.926875 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.926582    2574 scope.go:117] "RemoveContainer" containerID="d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd"
Sep 11 15:16:33.934948 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.934935    2574 scope.go:117] "RemoveContainer" containerID="d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd"
Sep 11 15:16:33.935210 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:16:33.935191    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd\": container with ID starting with d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd not found: ID does not exist" containerID="d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd"
Sep 11 15:16:33.935272 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.935218    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd"} err="failed to get container status \"d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd\": rpc error: code = NotFound desc = could not find container \"d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd\": container with ID starting with d60a101127baa95b92bb04d32d858536845b246999f377c833616da9d90656bd not found: ID does not exist"
Sep 11 15:16:33.958850 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.958826    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"]
Sep 11 15:16:33.975226 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.975202    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k4rll"]
Sep 11 15:16:33.993609 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:33.993584    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fb0cdc7-b2bd-43e5-ac04-13840aaa3359" path="/var/lib/kubelet/pods/5fb0cdc7-b2bd-43e5-ac04-13840aaa3359/volumes"
Sep 11 15:16:49.265143 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.265111    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"]
Sep 11 15:16:49.265603 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.265582    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb0cdc7-b2bd-43e5-ac04-13840aaa3359" containerName="manager"
Sep 11 15:16:49.265689 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.265606    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb0cdc7-b2bd-43e5-ac04-13840aaa3359" containerName="manager"
Sep 11 15:16:49.265765 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.265752    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fb0cdc7-b2bd-43e5-ac04-13840aaa3359" containerName="manager"
Sep 11 15:16:49.282518 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.282486    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.283598 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.283572    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"]
Sep 11 15:16:49.284822 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.284801    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-p8khd\""
Sep 11 15:16:49.444585 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.444554    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.444585 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.444590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.444804 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.444635    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.444804 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.444687    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsnvl\" (UniqueName: \"kubernetes.io/projected/5b2702f2-528f-4c94-8a00-cf65bbf8031d-kube-api-access-jsnvl\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.444804 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.444718    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.444804 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.444768    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.444804 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.444802    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.445012 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.444845    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.445012 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.444909    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.545777 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.545678    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.545777 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.545722    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.545993 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.545845    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.545993 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.545881    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.545993 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.545902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.545993 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.545925    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsnvl\" (UniqueName: \"kubernetes.io/projected/5b2702f2-528f-4c94-8a00-cf65bbf8031d-kube-api-access-jsnvl\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.545993 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.545944    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.545993 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.545973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.546290 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.546016    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.546340 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.546291    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.546340 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.546321    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.546448 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.546408    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.546559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.546536    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.546651 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.546558    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.548193 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.548170    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.548388 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.548370    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.555462 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.555413    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b2702f2-528f-4c94-8a00-cf65bbf8031d-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.555462 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.555450    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsnvl\" (UniqueName: \"kubernetes.io/projected/5b2702f2-528f-4c94-8a00-cf65bbf8031d-kube-api-access-jsnvl\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wgwc4\" (UID: \"5b2702f2-528f-4c94-8a00-cf65bbf8031d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.593003 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.592973    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:49.865581 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.865555    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"]
Sep 11 15:16:49.867543 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:16:49.867514    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b2702f2_528f_4c94_8a00_cf65bbf8031d.slice/crio-c856dffd088e056c231bcac39d5b6e72864971acebacd12303e46948a79fce77 WatchSource:0}: Error finding container c856dffd088e056c231bcac39d5b6e72864971acebacd12303e46948a79fce77: Status 404 returned error can't find the container with id c856dffd088e056c231bcac39d5b6e72864971acebacd12303e46948a79fce77
Sep 11 15:16:49.869795 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.869761    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:16:49.869864 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.869842    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:16:49.869915 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.869881    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:16:49.999468 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.999431    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4" event={"ID":"5b2702f2-528f-4c94-8a00-cf65bbf8031d","Type":"ContainerStarted","Data":"1d0498cb530239fe042d35bbb94b161a33b05ec31d484afef7a023260523c253"}
Sep 11 15:16:49.999657 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:49.999490    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4" event={"ID":"5b2702f2-528f-4c94-8a00-cf65bbf8031d","Type":"ContainerStarted","Data":"c856dffd088e056c231bcac39d5b6e72864971acebacd12303e46948a79fce77"}
Sep 11 15:16:50.019726 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:50.019668    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4" podStartSLOduration=1.019646159 podStartE2EDuration="1.019646159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:16:50.017585765 +0000 UTC m=+484.477302765" watchObservedRunningTime="2026-09-11 15:16:50.019646159 +0000 UTC m=+484.479363156"
Sep 11 15:16:50.593254 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:50.593134    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:50.597783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:50.597757    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:50.998700 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:50.998671    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-79mnk"]
Sep 11 15:16:51.001033 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.001006    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-79mnk"
Sep 11 15:16:51.003414 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.003394    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 15:16:51.004541 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.004527    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:51.005385 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.005367    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:16:51.010827 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.010808    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-79mnk"]
Sep 11 15:16:51.097687 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.097650    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-79mnk"]
Sep 11 15:16:51.161334 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.161302    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8zzz\" (UniqueName: \"kubernetes.io/projected/99408082-a1e3-4493-a0f9-22a07b8f8f7b-kube-api-access-p8zzz\") pod \"limitador-limitador-8588749977-79mnk\" (UID: \"99408082-a1e3-4493-a0f9-22a07b8f8f7b\") " pod="kuadrant-system/limitador-limitador-8588749977-79mnk"
Sep 11 15:16:51.161334 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.161340    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99408082-a1e3-4493-a0f9-22a07b8f8f7b-config-file\") pod \"limitador-limitador-8588749977-79mnk\" (UID: \"99408082-a1e3-4493-a0f9-22a07b8f8f7b\") " pod="kuadrant-system/limitador-limitador-8588749977-79mnk"
Sep 11 15:16:51.262852 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.262765    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8zzz\" (UniqueName: \"kubernetes.io/projected/99408082-a1e3-4493-a0f9-22a07b8f8f7b-kube-api-access-p8zzz\") pod \"limitador-limitador-8588749977-79mnk\" (UID: \"99408082-a1e3-4493-a0f9-22a07b8f8f7b\") " pod="kuadrant-system/limitador-limitador-8588749977-79mnk"
Sep 11 15:16:51.262852 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.262807    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99408082-a1e3-4493-a0f9-22a07b8f8f7b-config-file\") pod \"limitador-limitador-8588749977-79mnk\" (UID: \"99408082-a1e3-4493-a0f9-22a07b8f8f7b\") " pod="kuadrant-system/limitador-limitador-8588749977-79mnk"
Sep 11 15:16:51.263401 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.263382    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99408082-a1e3-4493-a0f9-22a07b8f8f7b-config-file\") pod \"limitador-limitador-8588749977-79mnk\" (UID: \"99408082-a1e3-4493-a0f9-22a07b8f8f7b\") " pod="kuadrant-system/limitador-limitador-8588749977-79mnk"
Sep 11 15:16:51.271916 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.271887    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8zzz\" (UniqueName: \"kubernetes.io/projected/99408082-a1e3-4493-a0f9-22a07b8f8f7b-kube-api-access-p8zzz\") pod \"limitador-limitador-8588749977-79mnk\" (UID: \"99408082-a1e3-4493-a0f9-22a07b8f8f7b\") " pod="kuadrant-system/limitador-limitador-8588749977-79mnk"
Sep 11 15:16:51.312115 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.312081    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-79mnk"
Sep 11 15:16:51.585131 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.585105    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-79mnk"]
Sep 11 15:16:51.587554 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:16:51.587526    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99408082_a1e3_4493_a0f9_22a07b8f8f7b.slice/crio-158c09a0ca468a9cac5bf50d7be87bcc991c66bd62cc7f7175b13e4e064fe76f WatchSource:0}: Error finding container 158c09a0ca468a9cac5bf50d7be87bcc991c66bd62cc7f7175b13e4e064fe76f: Status 404 returned error can't find the container with id 158c09a0ca468a9cac5bf50d7be87bcc991c66bd62cc7f7175b13e4e064fe76f
Sep 11 15:16:51.914419 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.914384    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-7c6s5"]
Sep 11 15:16:51.917253 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.917232    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7c6s5"
Sep 11 15:16:51.919971 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.919951    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9k82x\""
Sep 11 15:16:51.925168 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:51.925146    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7c6s5"]
Sep 11 15:16:52.009963 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:52.009930    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-79mnk" event={"ID":"99408082-a1e3-4493-a0f9-22a07b8f8f7b","Type":"ContainerStarted","Data":"158c09a0ca468a9cac5bf50d7be87bcc991c66bd62cc7f7175b13e4e064fe76f"}
Sep 11 15:16:52.071353 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:52.071317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wd52\" (UniqueName: \"kubernetes.io/projected/34b22c66-e39e-413c-86a8-f93d34785b1a-kube-api-access-6wd52\") pod \"authorino-59c974bd48-7c6s5\" (UID: \"34b22c66-e39e-413c-86a8-f93d34785b1a\") " pod="kuadrant-system/authorino-59c974bd48-7c6s5"
Sep 11 15:16:52.172382 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:52.172284    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wd52\" (UniqueName: \"kubernetes.io/projected/34b22c66-e39e-413c-86a8-f93d34785b1a-kube-api-access-6wd52\") pod \"authorino-59c974bd48-7c6s5\" (UID: \"34b22c66-e39e-413c-86a8-f93d34785b1a\") " pod="kuadrant-system/authorino-59c974bd48-7c6s5"
Sep 11 15:16:52.181033 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:52.181005    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wd52\" (UniqueName: \"kubernetes.io/projected/34b22c66-e39e-413c-86a8-f93d34785b1a-kube-api-access-6wd52\") pod \"authorino-59c974bd48-7c6s5\" (UID: \"34b22c66-e39e-413c-86a8-f93d34785b1a\") " pod="kuadrant-system/authorino-59c974bd48-7c6s5"
Sep 11 15:16:52.228085 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:52.228053    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7c6s5"
Sep 11 15:16:52.496572 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:52.496503    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7c6s5"]
Sep 11 15:16:52.499737 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:16:52.499712    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34b22c66_e39e_413c_86a8_f93d34785b1a.slice/crio-39d0dbf3b0403f63915a31f01f6a74fbc41a3afd3c9f521852962c8f52f2355d WatchSource:0}: Error finding container 39d0dbf3b0403f63915a31f01f6a74fbc41a3afd3c9f521852962c8f52f2355d: Status 404 returned error can't find the container with id 39d0dbf3b0403f63915a31f01f6a74fbc41a3afd3c9f521852962c8f52f2355d
Sep 11 15:16:53.016678 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:53.016645    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7c6s5" event={"ID":"34b22c66-e39e-413c-86a8-f93d34785b1a","Type":"ContainerStarted","Data":"39d0dbf3b0403f63915a31f01f6a74fbc41a3afd3c9f521852962c8f52f2355d"}
Sep 11 15:16:54.023010 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:54.022971    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-79mnk" event={"ID":"99408082-a1e3-4493-a0f9-22a07b8f8f7b","Type":"ContainerStarted","Data":"744cb90af0d87d18e01ee711d54936582f0d7df9c1058a463173f5206e7c4b31"}
Sep 11 15:16:54.023464 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:54.023049    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-79mnk"
Sep 11 15:16:54.045965 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:54.045920    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-79mnk" podStartSLOduration=2.505872649 podStartE2EDuration="4.045905802s" totalImagesPullingTime="1.540033153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:16:54.044780374 +0000 UTC m=+488.504497373" watchObservedRunningTime="2026-09-11 15:16:54.045905802 +0000 UTC m=+488.505622824"
Sep 11 15:16:57.037464 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:57.037432    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7c6s5" event={"ID":"34b22c66-e39e-413c-86a8-f93d34785b1a","Type":"ContainerStarted","Data":"5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d"}
Sep 11 15:16:57.052745 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:16:57.052699    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-7c6s5" podStartSLOduration=2.569571926 podStartE2EDuration="6.052683504s" totalImagesPullingTime="3.483111578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:16:57.051537075 +0000 UTC m=+491.511254073" watchObservedRunningTime="2026-09-11 15:16:57.052683504 +0000 UTC m=+491.512400503"
Sep 11 15:17:05.028960 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:05.028928    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-79mnk"
Sep 11 15:17:06.626310 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:06.626272    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-79mnk"]
Sep 11 15:17:06.626728 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:06.626481    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-79mnk" podUID="99408082-a1e3-4493-a0f9-22a07b8f8f7b" containerName="limitador" containerID="cri-o://744cb90af0d87d18e01ee711d54936582f0d7df9c1058a463173f5206e7c4b31" gracePeriod=30
Sep 11 15:17:07.088143 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:07.088106    2574 generic.go:356] "Generic (PLEG): container finished" podID="99408082-a1e3-4493-a0f9-22a07b8f8f7b" containerID="744cb90af0d87d18e01ee711d54936582f0d7df9c1058a463173f5206e7c4b31" exitCode=0
Sep 11 15:17:07.088282 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:07.088177    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-79mnk" event={"ID":"99408082-a1e3-4493-a0f9-22a07b8f8f7b","Type":"ContainerDied","Data":"744cb90af0d87d18e01ee711d54936582f0d7df9c1058a463173f5206e7c4b31"}
Sep 11 15:17:07.167784 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:07.167759    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-79mnk"
Sep 11 15:17:07.195880 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:07.195810    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99408082-a1e3-4493-a0f9-22a07b8f8f7b-config-file\") pod \"99408082-a1e3-4493-a0f9-22a07b8f8f7b\" (UID: \"99408082-a1e3-4493-a0f9-22a07b8f8f7b\") "
Sep 11 15:17:07.195880 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:07.195860    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8zzz\" (UniqueName: \"kubernetes.io/projected/99408082-a1e3-4493-a0f9-22a07b8f8f7b-kube-api-access-p8zzz\") pod \"99408082-a1e3-4493-a0f9-22a07b8f8f7b\" (UID: \"99408082-a1e3-4493-a0f9-22a07b8f8f7b\") "
Sep 11 15:17:07.196257 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:07.196230    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99408082-a1e3-4493-a0f9-22a07b8f8f7b-config-file" (OuterVolumeSpecName: "config-file") pod "99408082-a1e3-4493-a0f9-22a07b8f8f7b" (UID: "99408082-a1e3-4493-a0f9-22a07b8f8f7b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:17:07.198072 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:07.198047    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99408082-a1e3-4493-a0f9-22a07b8f8f7b-kube-api-access-p8zzz" (OuterVolumeSpecName: "kube-api-access-p8zzz") pod "99408082-a1e3-4493-a0f9-22a07b8f8f7b" (UID: "99408082-a1e3-4493-a0f9-22a07b8f8f7b"). InnerVolumeSpecName "kube-api-access-p8zzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:17:07.296789 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:07.296758    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8zzz\" (UniqueName: \"kubernetes.io/projected/99408082-a1e3-4493-a0f9-22a07b8f8f7b-kube-api-access-p8zzz\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:17:07.296789 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:07.296787    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99408082-a1e3-4493-a0f9-22a07b8f8f7b-config-file\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:17:08.099214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:08.099172    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-79mnk" event={"ID":"99408082-a1e3-4493-a0f9-22a07b8f8f7b","Type":"ContainerDied","Data":"158c09a0ca468a9cac5bf50d7be87bcc991c66bd62cc7f7175b13e4e064fe76f"}
Sep 11 15:17:08.099214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:08.099210    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-79mnk"
Sep 11 15:17:08.099723 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:08.099263    2574 scope.go:117] "RemoveContainer" containerID="744cb90af0d87d18e01ee711d54936582f0d7df9c1058a463173f5206e7c4b31"
Sep 11 15:17:08.115143 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:08.115114    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-79mnk"]
Sep 11 15:17:08.120671 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:08.120651    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-79mnk"]
Sep 11 15:17:09.994102 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:09.994061    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99408082-a1e3-4493-a0f9-22a07b8f8f7b" path="/var/lib/kubelet/pods/99408082-a1e3-4493-a0f9-22a07b8f8f7b/volumes"
Sep 11 15:17:12.620476 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.620441    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"]
Sep 11 15:17:12.620881 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.620819    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99408082-a1e3-4493-a0f9-22a07b8f8f7b" containerName="limitador"
Sep 11 15:17:12.620881 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.620831    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="99408082-a1e3-4493-a0f9-22a07b8f8f7b" containerName="limitador"
Sep 11 15:17:12.620958 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.620897    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="99408082-a1e3-4493-a0f9-22a07b8f8f7b" containerName="limitador"
Sep 11 15:17:12.622973 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.622957    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"
Sep 11 15:17:12.625552 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.625531    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-k2skb\""
Sep 11 15:17:12.625552 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.625547    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 15:17:12.626469 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.626443    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 15:17:12.626469 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.626463    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 15:17:12.631538 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.631517    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"]
Sep 11 15:17:12.637381 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.637361    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6ded728e-7824-4eab-8503-5e327b86ebb2-data\") pod \"postgres-69fb4594cf-v4zkc\" (UID: \"6ded728e-7824-4eab-8503-5e327b86ebb2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"
Sep 11 15:17:12.637476 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.637425    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj64l\" (UniqueName: \"kubernetes.io/projected/6ded728e-7824-4eab-8503-5e327b86ebb2-kube-api-access-xj64l\") pod \"postgres-69fb4594cf-v4zkc\" (UID: \"6ded728e-7824-4eab-8503-5e327b86ebb2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"
Sep 11 15:17:12.738131 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.738099    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj64l\" (UniqueName: \"kubernetes.io/projected/6ded728e-7824-4eab-8503-5e327b86ebb2-kube-api-access-xj64l\") pod \"postgres-69fb4594cf-v4zkc\" (UID: \"6ded728e-7824-4eab-8503-5e327b86ebb2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"
Sep 11 15:17:12.738311 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.738196    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6ded728e-7824-4eab-8503-5e327b86ebb2-data\") pod \"postgres-69fb4594cf-v4zkc\" (UID: \"6ded728e-7824-4eab-8503-5e327b86ebb2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"
Sep 11 15:17:12.738671 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.738653    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6ded728e-7824-4eab-8503-5e327b86ebb2-data\") pod \"postgres-69fb4594cf-v4zkc\" (UID: \"6ded728e-7824-4eab-8503-5e327b86ebb2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"
Sep 11 15:17:12.746800 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.746771    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj64l\" (UniqueName: \"kubernetes.io/projected/6ded728e-7824-4eab-8503-5e327b86ebb2-kube-api-access-xj64l\") pod \"postgres-69fb4594cf-v4zkc\" (UID: \"6ded728e-7824-4eab-8503-5e327b86ebb2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"
Sep 11 15:17:12.934484 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:12.934394    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"
Sep 11 15:17:13.202635 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:13.202416    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"]
Sep 11 15:17:13.205216 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:17:13.205194    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ded728e_7824_4eab_8503_5e327b86ebb2.slice/crio-25c5f9bf5013a6771e595a921f5a4f56b842196f665b7c6f87c9878dd953a915 WatchSource:0}: Error finding container 25c5f9bf5013a6771e595a921f5a4f56b842196f665b7c6f87c9878dd953a915: Status 404 returned error can't find the container with id 25c5f9bf5013a6771e595a921f5a4f56b842196f665b7c6f87c9878dd953a915
Sep 11 15:17:14.130936 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:14.130898    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc" event={"ID":"6ded728e-7824-4eab-8503-5e327b86ebb2","Type":"ContainerStarted","Data":"25c5f9bf5013a6771e595a921f5a4f56b842196f665b7c6f87c9878dd953a915"}
Sep 11 15:17:16.142483 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:16.142445    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc" event={"ID":"6ded728e-7824-4eab-8503-5e327b86ebb2","Type":"ContainerStarted","Data":"48407240b49d9a9d5cc077dfaddc84fb43b367727c5de6cd3d1bdb8c54939ed4"}
Sep 11 15:17:16.142934 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:16.142569    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"
Sep 11 15:17:16.159569 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:16.159521    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc" podStartSLOduration=1.685986255 podStartE2EDuration="4.159508074s" totalImagesPullingTime="2.473521819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:17:16.158046366 +0000 UTC m=+510.617763367" watchObservedRunningTime="2026-09-11 15:17:16.159508074 +0000 UTC m=+510.619225073"
Sep 11 15:17:22.177055 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:22.177025    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-v4zkc"
Sep 11 15:17:23.003960 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:23.003929    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c7cfcbfc-d2pkg"]
Sep 11 15:17:23.008949 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:23.008925    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c7cfcbfc-d2pkg"
Sep 11 15:17:23.019312 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:23.019288    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c7cfcbfc-d2pkg"]
Sep 11 15:17:23.024274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:23.024249    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swjgh\" (UniqueName: \"kubernetes.io/projected/2c0cbf16-0225-4f05-8665-c518292c2f7c-kube-api-access-swjgh\") pod \"authorino-6c7cfcbfc-d2pkg\" (UID: \"2c0cbf16-0225-4f05-8665-c518292c2f7c\") " pod="kuadrant-system/authorino-6c7cfcbfc-d2pkg"
Sep 11 15:17:23.044496 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:23.044463    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c7cfcbfc-d2pkg"]
Sep 11 15:17:23.044765 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:17:23.044746    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-swjgh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6c7cfcbfc-d2pkg" podUID="2c0cbf16-0225-4f05-8665-c518292c2f7c"
Sep 11 15:17:23.124835 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:23.124800    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swjgh\" (UniqueName: \"kubernetes.io/projected/2c0cbf16-0225-4f05-8665-c518292c2f7c-kube-api-access-swjgh\") pod \"authorino-6c7cfcbfc-d2pkg\" (UID: \"2c0cbf16-0225-4f05-8665-c518292c2f7c\") " pod="kuadrant-system/authorino-6c7cfcbfc-d2pkg"
Sep 11 15:17:23.133843 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:23.133806    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swjgh\" (UniqueName: \"kubernetes.io/projected/2c0cbf16-0225-4f05-8665-c518292c2f7c-kube-api-access-swjgh\") pod \"authorino-6c7cfcbfc-d2pkg\" (UID: \"2c0cbf16-0225-4f05-8665-c518292c2f7c\") " pod="kuadrant-system/authorino-6c7cfcbfc-d2pkg"
Sep 11 15:17:23.176313 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:23.176280    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c7cfcbfc-d2pkg"
Sep 11 15:17:23.183594 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:23.183568    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c7cfcbfc-d2pkg"
Sep 11 15:17:23.225143 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:23.225108    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swjgh\" (UniqueName: \"kubernetes.io/projected/2c0cbf16-0225-4f05-8665-c518292c2f7c-kube-api-access-swjgh\") pod \"2c0cbf16-0225-4f05-8665-c518292c2f7c\" (UID: \"2c0cbf16-0225-4f05-8665-c518292c2f7c\") "
Sep 11 15:17:23.227391 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:23.227358    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c0cbf16-0225-4f05-8665-c518292c2f7c-kube-api-access-swjgh" (OuterVolumeSpecName: "kube-api-access-swjgh") pod "2c0cbf16-0225-4f05-8665-c518292c2f7c" (UID: "2c0cbf16-0225-4f05-8665-c518292c2f7c"). InnerVolumeSpecName "kube-api-access-swjgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:17:23.325988 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:23.325898    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swjgh\" (UniqueName: \"kubernetes.io/projected/2c0cbf16-0225-4f05-8665-c518292c2f7c-kube-api-access-swjgh\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:17:24.181774 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:24.181745    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c7cfcbfc-d2pkg"
Sep 11 15:17:24.206600 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:24.206568    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c7cfcbfc-d2pkg"]
Sep 11 15:17:24.208564 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:24.208544    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c7cfcbfc-d2pkg"]
Sep 11 15:17:24.882980 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:24.882945    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7c6s5"]
Sep 11 15:17:24.883163 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:24.883130    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-7c6s5" podUID="34b22c66-e39e-413c-86a8-f93d34785b1a" containerName="authorino" containerID="cri-o://5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d" gracePeriod=30
Sep 11 15:17:25.125176 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.125154    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7c6s5"
Sep 11 15:17:25.187110 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.187076    2574 generic.go:356] "Generic (PLEG): container finished" podID="34b22c66-e39e-413c-86a8-f93d34785b1a" containerID="5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d" exitCode=0
Sep 11 15:17:25.187289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.187119    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7c6s5"
Sep 11 15:17:25.187289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.187150    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7c6s5" event={"ID":"34b22c66-e39e-413c-86a8-f93d34785b1a","Type":"ContainerDied","Data":"5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d"}
Sep 11 15:17:25.187289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.187192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7c6s5" event={"ID":"34b22c66-e39e-413c-86a8-f93d34785b1a","Type":"ContainerDied","Data":"39d0dbf3b0403f63915a31f01f6a74fbc41a3afd3c9f521852962c8f52f2355d"}
Sep 11 15:17:25.187289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.187209    2574 scope.go:117] "RemoveContainer" containerID="5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d"
Sep 11 15:17:25.195098 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.195082    2574 scope.go:117] "RemoveContainer" containerID="5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d"
Sep 11 15:17:25.195364 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:17:25.195344    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d\": container with ID starting with 5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d not found: ID does not exist" containerID="5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d"
Sep 11 15:17:25.195422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.195374    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d"} err="failed to get container status \"5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d\": rpc error: code = NotFound desc = could not find container \"5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d\": container with ID starting with 5c831f0770be77cd1210bf5769c0e36efa977ff58eb84fa8b4bcd9d3d2d2842d not found: ID does not exist"
Sep 11 15:17:25.243980 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.243951    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wd52\" (UniqueName: \"kubernetes.io/projected/34b22c66-e39e-413c-86a8-f93d34785b1a-kube-api-access-6wd52\") pod \"34b22c66-e39e-413c-86a8-f93d34785b1a\" (UID: \"34b22c66-e39e-413c-86a8-f93d34785b1a\") "
Sep 11 15:17:25.246136 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.246113    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34b22c66-e39e-413c-86a8-f93d34785b1a-kube-api-access-6wd52" (OuterVolumeSpecName: "kube-api-access-6wd52") pod "34b22c66-e39e-413c-86a8-f93d34785b1a" (UID: "34b22c66-e39e-413c-86a8-f93d34785b1a"). InnerVolumeSpecName "kube-api-access-6wd52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:17:25.345337 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.345310    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wd52\" (UniqueName: \"kubernetes.io/projected/34b22c66-e39e-413c-86a8-f93d34785b1a-kube-api-access-6wd52\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:17:25.507712 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.507685    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7c6s5"]
Sep 11 15:17:25.511324 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.511301    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7c6s5"]
Sep 11 15:17:25.994448 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.994417    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c0cbf16-0225-4f05-8665-c518292c2f7c" path="/var/lib/kubelet/pods/2c0cbf16-0225-4f05-8665-c518292c2f7c/volumes"
Sep 11 15:17:25.994669 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:25.994656    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34b22c66-e39e-413c-86a8-f93d34785b1a" path="/var/lib/kubelet/pods/34b22c66-e39e-413c-86a8-f93d34785b1a/volumes"
Sep 11 15:17:29.715661 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.715624    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b8b95dc75-c49jg"]
Sep 11 15:17:29.716163 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.716142    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b22c66-e39e-413c-86a8-f93d34785b1a" containerName="authorino"
Sep 11 15:17:29.716236 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.716168    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b22c66-e39e-413c-86a8-f93d34785b1a" containerName="authorino"
Sep 11 15:17:29.716292 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.716266    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="34b22c66-e39e-413c-86a8-f93d34785b1a" containerName="authorino"
Sep 11 15:17:29.720633 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.720595    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:29.723338 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.723318    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 15:17:29.723459 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.723381    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w92cs\""
Sep 11 15:17:29.724559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.724537    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 15:17:29.724663 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.724560    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 15:17:29.735055 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.735024    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8b95dc75-c49jg"]
Sep 11 15:17:29.785034 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.785001    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm8nm\" (UniqueName: \"kubernetes.io/projected/f25d9053-db50-4dbb-ab4f-1d93676e28e3-kube-api-access-vm8nm\") pod \"maas-controller-5b8b95dc75-c49jg\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") " pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:29.785034 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.785042    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-metrics-certs\") pod \"maas-controller-5b8b95dc75-c49jg\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") " pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:29.785248 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.785104    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-webhook-cert\") pod \"maas-controller-5b8b95dc75-c49jg\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") " pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:29.886089 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.886051    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm8nm\" (UniqueName: \"kubernetes.io/projected/f25d9053-db50-4dbb-ab4f-1d93676e28e3-kube-api-access-vm8nm\") pod \"maas-controller-5b8b95dc75-c49jg\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") " pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:29.886089 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.886088    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-metrics-certs\") pod \"maas-controller-5b8b95dc75-c49jg\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") " pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:29.886340 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.886116    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-webhook-cert\") pod \"maas-controller-5b8b95dc75-c49jg\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") " pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:29.886340 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:17:29.886199    2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 11 15:17:29.886340 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:17:29.886255    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-webhook-cert podName:f25d9053-db50-4dbb-ab4f-1d93676e28e3 nodeName:}" failed. No retries permitted until 2026-09-11 15:17:30.386239544 +0000 UTC m=+524.845956522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-webhook-cert") pod "maas-controller-5b8b95dc75-c49jg" (UID: "f25d9053-db50-4dbb-ab4f-1d93676e28e3") : secret "maas-controller-webhook-cert" not found
Sep 11 15:17:29.888729 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.888706    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-metrics-certs\") pod \"maas-controller-5b8b95dc75-c49jg\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") " pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:29.896530 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.896504    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm8nm\" (UniqueName: \"kubernetes.io/projected/f25d9053-db50-4dbb-ab4f-1d93676e28e3-kube-api-access-vm8nm\") pod \"maas-controller-5b8b95dc75-c49jg\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") " pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:29.933734 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.933697    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-89f8bdf64-p4cpg"]
Sep 11 15:17:29.937241 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.937219    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:29.947303 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.947279    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-89f8bdf64-p4cpg"]
Sep 11 15:17:29.987097 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.987012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-metrics-certs\") pod \"maas-controller-89f8bdf64-p4cpg\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") " pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:29.987097 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.987069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-webhook-cert\") pod \"maas-controller-89f8bdf64-p4cpg\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") " pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:29.987267 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:29.987180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24vbl\" (UniqueName: \"kubernetes.io/projected/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-kube-api-access-24vbl\") pod \"maas-controller-89f8bdf64-p4cpg\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") " pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:30.087974 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:30.087921    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24vbl\" (UniqueName: \"kubernetes.io/projected/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-kube-api-access-24vbl\") pod \"maas-controller-89f8bdf64-p4cpg\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") " pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:30.088182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:30.088001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-metrics-certs\") pod \"maas-controller-89f8bdf64-p4cpg\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") " pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:30.088182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:30.088060    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-webhook-cert\") pod \"maas-controller-89f8bdf64-p4cpg\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") " pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:30.088182 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:17:30.088162    2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 11 15:17:30.088321 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:17:30.088216    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-webhook-cert podName:3dde0fcb-dbd3-4786-83f4-dafbdf75bea8 nodeName:}" failed. No retries permitted until 2026-09-11 15:17:30.588197093 +0000 UTC m=+525.047914098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-webhook-cert") pod "maas-controller-89f8bdf64-p4cpg" (UID: "3dde0fcb-dbd3-4786-83f4-dafbdf75bea8") : secret "maas-controller-webhook-cert" not found
Sep 11 15:17:30.090568 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:30.090541    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-metrics-certs\") pod \"maas-controller-89f8bdf64-p4cpg\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") " pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:30.096380 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:30.096352    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24vbl\" (UniqueName: \"kubernetes.io/projected/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-kube-api-access-24vbl\") pod \"maas-controller-89f8bdf64-p4cpg\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") " pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:30.390042 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:30.390011    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-webhook-cert\") pod \"maas-controller-5b8b95dc75-c49jg\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") " pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:30.392574 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:30.392556    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-webhook-cert\") pod \"maas-controller-5b8b95dc75-c49jg\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") " pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:30.591191 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:30.591148    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-webhook-cert\") pod \"maas-controller-89f8bdf64-p4cpg\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") " pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:30.593781 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:30.593746    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-webhook-cert\") pod \"maas-controller-89f8bdf64-p4cpg\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") " pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:30.631350 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:30.631309    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:30.847604 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:30.847564    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:30.903510 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:30.903477    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8b95dc75-c49jg"]
Sep 11 15:17:30.915250 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:17:30.913467    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25d9053_db50_4dbb_ab4f_1d93676e28e3.slice/crio-0aa8f5839f71c78e42708bdc95949a1770e30e235a364d7eb0e57657f5a95f5c WatchSource:0}: Error finding container 0aa8f5839f71c78e42708bdc95949a1770e30e235a364d7eb0e57657f5a95f5c: Status 404 returned error can't find the container with id 0aa8f5839f71c78e42708bdc95949a1770e30e235a364d7eb0e57657f5a95f5c
Sep 11 15:17:31.120288 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:31.120170    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-89f8bdf64-p4cpg"]
Sep 11 15:17:31.122387 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:17:31.122358    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dde0fcb_dbd3_4786_83f4_dafbdf75bea8.slice/crio-54d21aca35830a1a6a39f853c3e951ec240b0de5135dede36b6578047496f471 WatchSource:0}: Error finding container 54d21aca35830a1a6a39f853c3e951ec240b0de5135dede36b6578047496f471: Status 404 returned error can't find the container with id 54d21aca35830a1a6a39f853c3e951ec240b0de5135dede36b6578047496f471
Sep 11 15:17:31.216154 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:31.216060    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89f8bdf64-p4cpg" event={"ID":"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8","Type":"ContainerStarted","Data":"54d21aca35830a1a6a39f853c3e951ec240b0de5135dede36b6578047496f471"}
Sep 11 15:17:31.217237 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:31.217214    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8b95dc75-c49jg" event={"ID":"f25d9053-db50-4dbb-ab4f-1d93676e28e3","Type":"ContainerStarted","Data":"0aa8f5839f71c78e42708bdc95949a1770e30e235a364d7eb0e57657f5a95f5c"}
Sep 11 15:17:34.237835 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:34.237792    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89f8bdf64-p4cpg" event={"ID":"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8","Type":"ContainerStarted","Data":"0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30"}
Sep 11 15:17:34.238319 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:34.237920    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:34.239518 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:34.239494    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8b95dc75-c49jg" event={"ID":"f25d9053-db50-4dbb-ab4f-1d93676e28e3","Type":"ContainerStarted","Data":"9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4"}
Sep 11 15:17:34.239650 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:34.239608    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:34.365485 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:34.365433    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-89f8bdf64-p4cpg" podStartSLOduration=2.675997256 podStartE2EDuration="5.365414707s" totalImagesPullingTime="2.689417451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:17:34.291284928 +0000 UTC m=+528.751001927" watchObservedRunningTime="2026-09-11 15:17:34.365414707 +0000 UTC m=+528.825131707"
Sep 11 15:17:45.248490 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.248409    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:45.248490 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.248478    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:17:45.266538 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.266482    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b8b95dc75-c49jg" podStartSLOduration=13.379644505 podStartE2EDuration="16.266466903s" totalImagesPullingTime="2.886822398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:17:34.366042514 +0000 UTC m=+528.825759513" watchObservedRunningTime="2026-09-11 15:17:45.266466903 +0000 UTC m=+539.726183918"
Sep 11 15:17:45.308316 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.308281    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8b95dc75-c49jg"]
Sep 11 15:17:45.308547 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.308508    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b8b95dc75-c49jg" podUID="f25d9053-db50-4dbb-ab4f-1d93676e28e3" containerName="manager" containerID="cri-o://9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4" gracePeriod=30
Sep 11 15:17:45.567930 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.567895    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:45.638541 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.638493    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-webhook-cert\") pod \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") "
Sep 11 15:17:45.638745 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.638591    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm8nm\" (UniqueName: \"kubernetes.io/projected/f25d9053-db50-4dbb-ab4f-1d93676e28e3-kube-api-access-vm8nm\") pod \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") "
Sep 11 15:17:45.638745 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.638694    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-metrics-certs\") pod \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\" (UID: \"f25d9053-db50-4dbb-ab4f-1d93676e28e3\") "
Sep 11 15:17:45.641035 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.641005    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f25d9053-db50-4dbb-ab4f-1d93676e28e3-kube-api-access-vm8nm" (OuterVolumeSpecName: "kube-api-access-vm8nm") pod "f25d9053-db50-4dbb-ab4f-1d93676e28e3" (UID: "f25d9053-db50-4dbb-ab4f-1d93676e28e3"). InnerVolumeSpecName "kube-api-access-vm8nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:17:45.641035 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.641020    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f25d9053-db50-4dbb-ab4f-1d93676e28e3" (UID: "f25d9053-db50-4dbb-ab4f-1d93676e28e3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:17:45.641182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.641004    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f25d9053-db50-4dbb-ab4f-1d93676e28e3" (UID: "f25d9053-db50-4dbb-ab4f-1d93676e28e3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:17:45.739375 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.739328    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-webhook-cert\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:17:45.739375 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.739366    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm8nm\" (UniqueName: \"kubernetes.io/projected/f25d9053-db50-4dbb-ab4f-1d93676e28e3-kube-api-access-vm8nm\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:17:45.739375 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:45.739378    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f25d9053-db50-4dbb-ab4f-1d93676e28e3-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:17:46.300691 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:46.300567    2574 generic.go:356] "Generic (PLEG): container finished" podID="f25d9053-db50-4dbb-ab4f-1d93676e28e3" containerID="9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4" exitCode=0
Sep 11 15:17:46.300691 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:46.300642    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8b95dc75-c49jg"
Sep 11 15:17:46.300691 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:46.300657    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8b95dc75-c49jg" event={"ID":"f25d9053-db50-4dbb-ab4f-1d93676e28e3","Type":"ContainerDied","Data":"9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4"}
Sep 11 15:17:46.301210 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:46.300723    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8b95dc75-c49jg" event={"ID":"f25d9053-db50-4dbb-ab4f-1d93676e28e3","Type":"ContainerDied","Data":"0aa8f5839f71c78e42708bdc95949a1770e30e235a364d7eb0e57657f5a95f5c"}
Sep 11 15:17:46.301210 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:46.300752    2574 scope.go:117] "RemoveContainer" containerID="9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4"
Sep 11 15:17:46.309745 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:46.309537    2574 scope.go:117] "RemoveContainer" containerID="9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4"
Sep 11 15:17:46.309944 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:17:46.309925    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4\": container with ID starting with 9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4 not found: ID does not exist" containerID="9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4"
Sep 11 15:17:46.309991 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:46.309951    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4"} err="failed to get container status \"9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4\": rpc error: code = NotFound desc = could not find container \"9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4\": container with ID starting with 9382f862a79bba790818db6332ca1bfed43665aee989a7f17e87f5b7202790e4 not found: ID does not exist"
Sep 11 15:17:46.318213 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:46.318181    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8b95dc75-c49jg"]
Sep 11 15:17:46.321937 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:46.321907    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b8b95dc75-c49jg"]
Sep 11 15:17:47.994656 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:17:47.994597    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f25d9053-db50-4dbb-ab4f-1d93676e28e3" path="/var/lib/kubelet/pods/f25d9053-db50-4dbb-ab4f-1d93676e28e3/volumes"
Sep 11 15:18:07.516478 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.516442    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"]
Sep 11 15:18:07.516962 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.516874    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f25d9053-db50-4dbb-ab4f-1d93676e28e3" containerName="manager"
Sep 11 15:18:07.516962 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.516888    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f25d9053-db50-4dbb-ab4f-1d93676e28e3" containerName="manager"
Sep 11 15:18:07.516962 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.516955    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f25d9053-db50-4dbb-ab4f-1d93676e28e3" containerName="manager"
Sep 11 15:18:07.523082 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.523046    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.523994 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.523969    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0959529e-aa82-43b0-ab63-476d6bf6e6e7-maas-api-tls\") pod \"maas-api-6b6fb88c84-dbbmh\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") " pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.524120 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.524023    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0959529e-aa82-43b0-ab63-476d6bf6e6e7-metrics-certs\") pod \"maas-api-6b6fb88c84-dbbmh\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") " pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.524120 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.524075    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0959529e-aa82-43b0-ab63-476d6bf6e6e7-openshift-service-ca\") pod \"maas-api-6b6fb88c84-dbbmh\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") " pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.524120 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.524102    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwcrr\" (UniqueName: \"kubernetes.io/projected/0959529e-aa82-43b0-ab63-476d6bf6e6e7-kube-api-access-mwcrr\") pod \"maas-api-6b6fb88c84-dbbmh\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") " pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.526518 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.526499    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 15:18:07.526518 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.526512    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 15:18:07.526669 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.526501    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-79rjx\""
Sep 11 15:18:07.531851 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.531829    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"]
Sep 11 15:18:07.625030 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.624994    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0959529e-aa82-43b0-ab63-476d6bf6e6e7-maas-api-tls\") pod \"maas-api-6b6fb88c84-dbbmh\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") " pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.625235 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.625050    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0959529e-aa82-43b0-ab63-476d6bf6e6e7-metrics-certs\") pod \"maas-api-6b6fb88c84-dbbmh\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") " pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.625235 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.625070    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0959529e-aa82-43b0-ab63-476d6bf6e6e7-openshift-service-ca\") pod \"maas-api-6b6fb88c84-dbbmh\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") " pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.625235 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.625089    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwcrr\" (UniqueName: \"kubernetes.io/projected/0959529e-aa82-43b0-ab63-476d6bf6e6e7-kube-api-access-mwcrr\") pod \"maas-api-6b6fb88c84-dbbmh\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") " pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.625830 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.625811    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0959529e-aa82-43b0-ab63-476d6bf6e6e7-openshift-service-ca\") pod \"maas-api-6b6fb88c84-dbbmh\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") " pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.627789 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.627768    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0959529e-aa82-43b0-ab63-476d6bf6e6e7-metrics-certs\") pod \"maas-api-6b6fb88c84-dbbmh\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") " pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.627943 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.627920    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0959529e-aa82-43b0-ab63-476d6bf6e6e7-maas-api-tls\") pod \"maas-api-6b6fb88c84-dbbmh\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") " pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.635468 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.635442    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwcrr\" (UniqueName: \"kubernetes.io/projected/0959529e-aa82-43b0-ab63-476d6bf6e6e7-kube-api-access-mwcrr\") pod \"maas-api-6b6fb88c84-dbbmh\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") " pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:07.834734 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:07.834608    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:08.008954 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.008919    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"]
Sep 11 15:18:08.014549 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.014527    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"
Sep 11 15:18:08.018993 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.018969    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 15:18:08.019193 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.019020    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6tl98\""
Sep 11 15:18:08.028460 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.028428    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgg74\" (UniqueName: \"kubernetes.io/projected/1efdddb6-ee3c-4f1a-8474-2dc38031e665-kube-api-access-zgg74\") pod \"payload-processing-5b54b7fbb7-jdnwd\" (UID: \"1efdddb6-ee3c-4f1a-8474-2dc38031e665\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"
Sep 11 15:18:08.028576 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.028479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1efdddb6-ee3c-4f1a-8474-2dc38031e665-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-jdnwd\" (UID: \"1efdddb6-ee3c-4f1a-8474-2dc38031e665\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"
Sep 11 15:18:08.039632 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.039584    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"]
Sep 11 15:18:08.129395 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.129360    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgg74\" (UniqueName: \"kubernetes.io/projected/1efdddb6-ee3c-4f1a-8474-2dc38031e665-kube-api-access-zgg74\") pod \"payload-processing-5b54b7fbb7-jdnwd\" (UID: \"1efdddb6-ee3c-4f1a-8474-2dc38031e665\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"
Sep 11 15:18:08.129573 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.129404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1efdddb6-ee3c-4f1a-8474-2dc38031e665-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-jdnwd\" (UID: \"1efdddb6-ee3c-4f1a-8474-2dc38031e665\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"
Sep 11 15:18:08.130078 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.130059    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1efdddb6-ee3c-4f1a-8474-2dc38031e665-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-jdnwd\" (UID: \"1efdddb6-ee3c-4f1a-8474-2dc38031e665\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"
Sep 11 15:18:08.138249 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.138221    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"]
Sep 11 15:18:08.139472 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:18:08.139450    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0959529e_aa82_43b0_ab63_476d6bf6e6e7.slice/crio-142751dea7d5ba2832a344a0aa0276fbef35177c018b8e44f75dd58749beebdd WatchSource:0}: Error finding container 142751dea7d5ba2832a344a0aa0276fbef35177c018b8e44f75dd58749beebdd: Status 404 returned error can't find the container with id 142751dea7d5ba2832a344a0aa0276fbef35177c018b8e44f75dd58749beebdd
Sep 11 15:18:08.146530 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.146506    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgg74\" (UniqueName: \"kubernetes.io/projected/1efdddb6-ee3c-4f1a-8474-2dc38031e665-kube-api-access-zgg74\") pod \"payload-processing-5b54b7fbb7-jdnwd\" (UID: \"1efdddb6-ee3c-4f1a-8474-2dc38031e665\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"
Sep 11 15:18:08.325649 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.325596    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"
Sep 11 15:18:08.406843 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.406800    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh" event={"ID":"0959529e-aa82-43b0-ab63-476d6bf6e6e7","Type":"ContainerStarted","Data":"142751dea7d5ba2832a344a0aa0276fbef35177c018b8e44f75dd58749beebdd"}
Sep 11 15:18:08.607222 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:08.607111    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"]
Sep 11 15:18:08.609895 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:18:08.609856    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1efdddb6_ee3c_4f1a_8474_2dc38031e665.slice/crio-3bc2b4c2b5b8332d1b3afe62db19eb4b5ac53a5b867bd2d0f81b33bcaa629226 WatchSource:0}: Error finding container 3bc2b4c2b5b8332d1b3afe62db19eb4b5ac53a5b867bd2d0f81b33bcaa629226: Status 404 returned error can't find the container with id 3bc2b4c2b5b8332d1b3afe62db19eb4b5ac53a5b867bd2d0f81b33bcaa629226
Sep 11 15:18:09.419189 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:09.419144    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd" event={"ID":"1efdddb6-ee3c-4f1a-8474-2dc38031e665","Type":"ContainerStarted","Data":"3bc2b4c2b5b8332d1b3afe62db19eb4b5ac53a5b867bd2d0f81b33bcaa629226"}
Sep 11 15:18:11.435891 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:11.435842    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh" event={"ID":"0959529e-aa82-43b0-ab63-476d6bf6e6e7","Type":"ContainerStarted","Data":"993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40"}
Sep 11 15:18:11.438927 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:11.438895    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:11.441297 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:11.441259    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd" event={"ID":"1efdddb6-ee3c-4f1a-8474-2dc38031e665","Type":"ContainerStarted","Data":"99cf167576e8bd35a9bd31c40adfe2d1201b402893a280d808e57866774d0555"}
Sep 11 15:18:11.441785 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:11.441762    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"
Sep 11 15:18:11.459404 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:11.459353    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh" podStartSLOduration=2.124110684 podStartE2EDuration="4.459337498s" totalImagesPullingTime="2.335226814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:18:11.458562627 +0000 UTC m=+565.918279627" watchObservedRunningTime="2026-09-11 15:18:11.459337498 +0000 UTC m=+565.919054497"
Sep 11 15:18:11.478598 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:11.478544    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd" podStartSLOduration=2.105664824 podStartE2EDuration="4.478528585s" totalImagesPullingTime="2.372863761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:18:11.477278295 +0000 UTC m=+565.936995307" watchObservedRunningTime="2026-09-11 15:18:11.478528585 +0000 UTC m=+565.938245584"
Sep 11 15:18:18.461398 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:18.461367    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:18:18.483994 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:18.483963    2574 generic.go:356] "Generic (PLEG): container finished" podID="5b2702f2-528f-4c94-8a00-cf65bbf8031d" containerID="1d0498cb530239fe042d35bbb94b161a33b05ec31d484afef7a023260523c253" exitCode=0
Sep 11 15:18:18.484161 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:18.484039    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4" event={"ID":"5b2702f2-528f-4c94-8a00-cf65bbf8031d","Type":"ContainerDied","Data":"1d0498cb530239fe042d35bbb94b161a33b05ec31d484afef7a023260523c253"}
Sep 11 15:18:18.484457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:18.484443    2574 scope.go:117] "RemoveContainer" containerID="1d0498cb530239fe042d35bbb94b161a33b05ec31d484afef7a023260523c253"
Sep 11 15:18:18.485491 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:18.485467    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:18:18.485562 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:18.485549    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:18:18.485597 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:18.485586    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:18:19.491293 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:19.491258    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4" event={"ID":"5b2702f2-528f-4c94-8a00-cf65bbf8031d","Type":"ContainerStarted","Data":"8100d182631a4b01dcc66cb706af7d43b6ecd4063f92552dc686e94e49c7bc9a"}
Sep 11 15:18:19.594186 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:19.594148    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:18:19.595253 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:19.595228    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-wgwc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 11 15:18:19.595368 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:19.595276    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4" podUID="5b2702f2-528f-4c94-8a00-cf65bbf8031d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 11 15:18:20.594254 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:20.594213    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-wgwc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 11 15:18:20.594662 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:20.594270    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4" podUID="5b2702f2-528f-4c94-8a00-cf65bbf8031d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 11 15:18:21.004841 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:21.004799    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:18:21.594109 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:21.594072    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-wgwc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 11 15:18:21.594278 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:21.594130    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4" podUID="5b2702f2-528f-4c94-8a00-cf65bbf8031d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 11 15:18:22.452452 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:22.452422    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-jdnwd"
Sep 11 15:18:22.594196 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:22.594152    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-wgwc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 11 15:18:22.594386 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:22.594231    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4" podUID="5b2702f2-528f-4c94-8a00-cf65bbf8031d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 11 15:18:23.593761 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:23.593725    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-wgwc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 11 15:18:23.593923 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:23.593785    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4" podUID="5b2702f2-528f-4c94-8a00-cf65bbf8031d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 11 15:18:24.597672 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:24.597636    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:18:24.598599 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:24.598577    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wgwc4"
Sep 11 15:18:57.482277 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.482244    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"]
Sep 11 15:18:57.487841 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.487805    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.491293 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.491270    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gfk8t\""
Sep 11 15:18:57.491293 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.491289    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 15:18:57.491511 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.491279    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 15:18:57.491511 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.491325    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 15:18:57.495303 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.495277    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"]
Sep 11 15:18:57.587756 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.587723    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b74388a-f9ea-44de-a5dd-53c15b375e0f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.587926 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.587762    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl8sx\" (UniqueName: \"kubernetes.io/projected/2b74388a-f9ea-44de-a5dd-53c15b375e0f-kube-api-access-cl8sx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.587926 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.587837    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b74388a-f9ea-44de-a5dd-53c15b375e0f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.587926 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.587876    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b74388a-f9ea-44de-a5dd-53c15b375e0f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.587926 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.587906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b74388a-f9ea-44de-a5dd-53c15b375e0f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.588060 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.587932    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b74388a-f9ea-44de-a5dd-53c15b375e0f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.688963 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.688925    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b74388a-f9ea-44de-a5dd-53c15b375e0f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.688963 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.688967    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b74388a-f9ea-44de-a5dd-53c15b375e0f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.689208 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.688991    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b74388a-f9ea-44de-a5dd-53c15b375e0f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.689208 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.689014    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b74388a-f9ea-44de-a5dd-53c15b375e0f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.689208 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.689058    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b74388a-f9ea-44de-a5dd-53c15b375e0f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.689208 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.689078    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl8sx\" (UniqueName: \"kubernetes.io/projected/2b74388a-f9ea-44de-a5dd-53c15b375e0f-kube-api-access-cl8sx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.689434 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.689385    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b74388a-f9ea-44de-a5dd-53c15b375e0f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.689493 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.689469    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b74388a-f9ea-44de-a5dd-53c15b375e0f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.689529 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.689499    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b74388a-f9ea-44de-a5dd-53c15b375e0f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.691502 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.691481    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b74388a-f9ea-44de-a5dd-53c15b375e0f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.691712 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.691694    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b74388a-f9ea-44de-a5dd-53c15b375e0f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.697465 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.697441    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl8sx\" (UniqueName: \"kubernetes.io/projected/2b74388a-f9ea-44de-a5dd-53c15b375e0f-kube-api-access-cl8sx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dvzcm\" (UID: \"2b74388a-f9ea-44de-a5dd-53c15b375e0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:57.798733 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:57.798638    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:18:58.105488 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:58.105465    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"]
Sep 11 15:18:58.108336 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:18:58.108308    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b74388a_f9ea_44de_a5dd_53c15b375e0f.slice/crio-aa5e72fa9d8b171f43a826b3f28af7ea4e974411ef977b559436b051b22f47b8 WatchSource:0}: Error finding container aa5e72fa9d8b171f43a826b3f28af7ea4e974411ef977b559436b051b22f47b8: Status 404 returned error can't find the container with id aa5e72fa9d8b171f43a826b3f28af7ea4e974411ef977b559436b051b22f47b8
Sep 11 15:18:58.675195 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:58.675146    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm" event={"ID":"2b74388a-f9ea-44de-a5dd-53c15b375e0f","Type":"ContainerStarted","Data":"aa5e72fa9d8b171f43a826b3f28af7ea4e974411ef977b559436b051b22f47b8"}
Sep 11 15:18:59.681839 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:59.681806    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm" event={"ID":"2b74388a-f9ea-44de-a5dd-53c15b375e0f","Type":"ContainerStarted","Data":"cf5af5a499366dc408fe830d7433ee1a69a549ed05ea5ae22ee8da361546952e"}
Sep 11 15:18:59.702681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:18:59.702601    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm" podStartSLOduration=1.643481051 podStartE2EDuration="2.702583153s" totalImagesPullingTime="1.059102102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:18:59.70014812 +0000 UTC m=+614.159865141" watchObservedRunningTime="2026-09-11 15:18:59.702583153 +0000 UTC m=+614.162300152"
Sep 11 15:19:07.799254 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:07.799161    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:19:07.799254 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:07.799241    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:19:07.811947 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:07.811923    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:19:08.738474 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:08.738444    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dvzcm"
Sep 11 15:19:49.289123 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.289091    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"]
Sep 11 15:19:49.292811 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.292779    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.295361 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.295333    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 11 15:19:49.303960 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.303933    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"]
Sep 11 15:19:49.424840 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.424800    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.424840 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.424850    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj2sd\" (UniqueName: \"kubernetes.io/projected/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-kube-api-access-tj2sd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.425108 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.424916    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.425108 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.424955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.425108 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.424978    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.425108 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.425069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.525665 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.525604    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.525665 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.525673    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj2sd\" (UniqueName: \"kubernetes.io/projected/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-kube-api-access-tj2sd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.525918 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.525698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.525918 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.525717    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.525918 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.525732    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.525918 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.525790    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.526224 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.526195    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.526429 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.526245    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.526429 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.526425    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.528263 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.528222    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.528440 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.528420    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.534129 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.534105    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj2sd\" (UniqueName: \"kubernetes.io/projected/bbcfbd0b-4e75-49f6-ae04-702671ee6d78-kube-api-access-tj2sd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv\" (UID: \"bbcfbd0b-4e75-49f6-ae04-702671ee6d78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.602792 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.602706    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:49.875024 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.874999    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"]
Sep 11 15:19:49.877803 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:19:49.877777    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbcfbd0b_4e75_49f6_ae04_702671ee6d78.slice/crio-0c41c2197a6b9cc94c56c404882e5138a12f000bc5dcc2b4e1cba9bf03ccd4bb WatchSource:0}: Error finding container 0c41c2197a6b9cc94c56c404882e5138a12f000bc5dcc2b4e1cba9bf03ccd4bb: Status 404 returned error can't find the container with id 0c41c2197a6b9cc94c56c404882e5138a12f000bc5dcc2b4e1cba9bf03ccd4bb
Sep 11 15:19:49.879564 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.879548    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 15:19:49.930350 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:49.930319    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv" event={"ID":"bbcfbd0b-4e75-49f6-ae04-702671ee6d78","Type":"ContainerStarted","Data":"0c41c2197a6b9cc94c56c404882e5138a12f000bc5dcc2b4e1cba9bf03ccd4bb"}
Sep 11 15:19:50.937311 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:50.937278    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv" event={"ID":"bbcfbd0b-4e75-49f6-ae04-702671ee6d78","Type":"ContainerStarted","Data":"ff6da854adec21784c01d19ccf1bfcb33198efa939a4a02f2403f13824d43eae"}
Sep 11 15:19:50.954584 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:50.954525    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv" podStartSLOduration=1.755266583 podStartE2EDuration="1.9545071s" totalImagesPullingTime="199.240517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:19:50.952520925 +0000 UTC m=+665.412237924" watchObservedRunningTime="2026-09-11 15:19:50.9545071 +0000 UTC m=+665.414224097"
Sep 11 15:19:59.603294 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:59.603261    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:59.603795 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:59.603304    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:59.615473 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:59.615444    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:19:59.994111 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:19:59.994084    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv"
Sep 11 15:21:09.170007 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.169929    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c844bc58-dhspd"]
Sep 11 15:21:09.173486 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.173465    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c844bc58-dhspd"
Sep 11 15:21:09.176958 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.176938    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9k82x\""
Sep 11 15:21:09.177079 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.176995    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 15:21:09.180969 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.180943    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c844bc58-dhspd"]
Sep 11 15:21:09.292989 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.292943    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/47185cc0-91ac-43e1-9be4-f750489d71df-tls-cert\") pod \"authorino-5c844bc58-dhspd\" (UID: \"47185cc0-91ac-43e1-9be4-f750489d71df\") " pod="kuadrant-system/authorino-5c844bc58-dhspd"
Sep 11 15:21:09.293146 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.293038    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bm9c\" (UniqueName: \"kubernetes.io/projected/47185cc0-91ac-43e1-9be4-f750489d71df-kube-api-access-8bm9c\") pod \"authorino-5c844bc58-dhspd\" (UID: \"47185cc0-91ac-43e1-9be4-f750489d71df\") " pod="kuadrant-system/authorino-5c844bc58-dhspd"
Sep 11 15:21:09.394332 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.394292    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/47185cc0-91ac-43e1-9be4-f750489d71df-tls-cert\") pod \"authorino-5c844bc58-dhspd\" (UID: \"47185cc0-91ac-43e1-9be4-f750489d71df\") " pod="kuadrant-system/authorino-5c844bc58-dhspd"
Sep 11 15:21:09.394498 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.394349    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bm9c\" (UniqueName: \"kubernetes.io/projected/47185cc0-91ac-43e1-9be4-f750489d71df-kube-api-access-8bm9c\") pod \"authorino-5c844bc58-dhspd\" (UID: \"47185cc0-91ac-43e1-9be4-f750489d71df\") " pod="kuadrant-system/authorino-5c844bc58-dhspd"
Sep 11 15:21:09.396919 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.396890    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/47185cc0-91ac-43e1-9be4-f750489d71df-tls-cert\") pod \"authorino-5c844bc58-dhspd\" (UID: \"47185cc0-91ac-43e1-9be4-f750489d71df\") " pod="kuadrant-system/authorino-5c844bc58-dhspd"
Sep 11 15:21:09.402642 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.402590    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bm9c\" (UniqueName: \"kubernetes.io/projected/47185cc0-91ac-43e1-9be4-f750489d71df-kube-api-access-8bm9c\") pod \"authorino-5c844bc58-dhspd\" (UID: \"47185cc0-91ac-43e1-9be4-f750489d71df\") " pod="kuadrant-system/authorino-5c844bc58-dhspd"
Sep 11 15:21:09.482695 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.482575    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c844bc58-dhspd"
Sep 11 15:21:09.753834 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:09.753801    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c844bc58-dhspd"]
Sep 11 15:21:09.756332 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:21:09.756301    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47185cc0_91ac_43e1_9be4_f750489d71df.slice/crio-000c372fe72a29b3194331ed4597ffde348c5a82075f00750259802a5d337fbb WatchSource:0}: Error finding container 000c372fe72a29b3194331ed4597ffde348c5a82075f00750259802a5d337fbb: Status 404 returned error can't find the container with id 000c372fe72a29b3194331ed4597ffde348c5a82075f00750259802a5d337fbb
Sep 11 15:21:10.302349 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:10.302318    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c844bc58-dhspd" event={"ID":"47185cc0-91ac-43e1-9be4-f750489d71df","Type":"ContainerStarted","Data":"000c372fe72a29b3194331ed4597ffde348c5a82075f00750259802a5d337fbb"}
Sep 11 15:21:11.309144 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:11.309097    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c844bc58-dhspd" event={"ID":"47185cc0-91ac-43e1-9be4-f750489d71df","Type":"ContainerStarted","Data":"66f6712e2711b84071e389341fcb9d62cdf49690a141e25ead3b7ca435213f59"}
Sep 11 15:21:11.328128 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:11.328043    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c844bc58-dhspd" podStartSLOduration=1.692550905 podStartE2EDuration="2.328021055s" totalImagesPullingTime="635.47015ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:21:11.327445343 +0000 UTC m=+745.787162357" watchObservedRunningTime="2026-09-11 15:21:11.328021055 +0000 UTC m=+745.787738048"
Sep 11 15:21:29.753330 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.753298    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"]
Sep 11 15:21:29.757597 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.757574    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.760161 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.760136    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-778341-openshift-default-dockercfg-46f6m\""
Sep 11 15:21:29.769636 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.769598    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"]
Sep 11 15:21:29.886028 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.885990    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-data\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.886188 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.886069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-token\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.886188 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.886163    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-workload-certs\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.886281 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.886194    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6b28\" (UniqueName: \"kubernetes.io/projected/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-kube-api-access-f6b28\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.886281 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.886214    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-envoy\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.886281 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.886231    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istiod-ca-cert\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.886396 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.886311    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-workload-socket\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.886396 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.886363    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-credential-socket\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.886396 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.886381    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-podinfo\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.986836 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.986805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-token\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.987023 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.986878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-workload-certs\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.987023 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.986903    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6b28\" (UniqueName: \"kubernetes.io/projected/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-kube-api-access-f6b28\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.987023 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.986927    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-envoy\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.987023 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.986950    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istiod-ca-cert\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.987023 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.987015    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-workload-socket\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.987290 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.987044    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-credential-socket\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.987290 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.987071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-podinfo\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.987290 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.987099    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-data\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.987438 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.987331    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-workload-certs\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.987627 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.987593    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-data\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.987761 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.987733    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-credential-socket\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.987829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.987786    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-workload-socket\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.988322 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.988286    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istiod-ca-cert\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.990241 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.990043    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-envoy\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.990479 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.990460    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-podinfo\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.995339 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.995305    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-token\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:29.995675 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:29.995651    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6b28\" (UniqueName: \"kubernetes.io/projected/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-kube-api-access-f6b28\") pod \"e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") " pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:30.070593 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:30.070506    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:30.359746 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:30.359718    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"]
Sep 11 15:21:30.361507 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:21:30.361471    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249f71f1_dc73_45e7_ac3f_3e65fdcd1c96.slice/crio-99f908450ecf469310ef3794e928fdb6284ddaee4093d14f4a735db2279a67b4 WatchSource:0}: Error finding container 99f908450ecf469310ef3794e928fdb6284ddaee4093d14f4a735db2279a67b4: Status 404 returned error can't find the container with id 99f908450ecf469310ef3794e928fdb6284ddaee4093d14f4a735db2279a67b4
Sep 11 15:21:30.363791 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:30.363760    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:21:30.363859 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:30.363822    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:21:30.363859 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:30.363850    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:21:30.404163 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:30.404137    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" event={"ID":"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96","Type":"ContainerStarted","Data":"99f908450ecf469310ef3794e928fdb6284ddaee4093d14f4a735db2279a67b4"}
Sep 11 15:21:31.410461 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:31.410423    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" event={"ID":"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96","Type":"ContainerStarted","Data":"ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e"}
Sep 11 15:21:31.434918 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:31.434862    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" podStartSLOduration=2.43484518 podStartE2EDuration="2.43484518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:21:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:21:31.433123578 +0000 UTC m=+765.892840578" watchObservedRunningTime="2026-09-11 15:21:31.43484518 +0000 UTC m=+765.894562179"
Sep 11 15:21:32.071659 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:32.071608    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:32.077099 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:32.077070    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:32.415483 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:32.415453    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:32.416579 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:32.416557    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:34.786315 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:34.786276    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"]
Sep 11 15:21:34.790847 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:34.790819    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:34.793969 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:34.793951    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-778341-serving-cert\""
Sep 11 15:21:34.804030 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:34.804009    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"]
Sep 11 15:21:34.941630 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:34.941579    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-maas-api-tls\") pod \"maas-api-e2e-inf-a-778341-58976b547d-j28z6\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:34.941848 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:34.941665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-778341-58976b547d-j28z6\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:34.941848 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:34.941792    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-metrics-certs\") pod \"maas-api-e2e-inf-a-778341-58976b547d-j28z6\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:34.941848 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:34.941828    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpn4w\" (UniqueName: \"kubernetes.io/projected/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-kube-api-access-tpn4w\") pod \"maas-api-e2e-inf-a-778341-58976b547d-j28z6\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:35.043182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:35.043105    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-maas-api-tls\") pod \"maas-api-e2e-inf-a-778341-58976b547d-j28z6\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:35.043182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:35.043148    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-778341-58976b547d-j28z6\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:35.043369 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:35.043335    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-metrics-certs\") pod \"maas-api-e2e-inf-a-778341-58976b547d-j28z6\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:35.043414 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:35.043380    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpn4w\" (UniqueName: \"kubernetes.io/projected/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-kube-api-access-tpn4w\") pod \"maas-api-e2e-inf-a-778341-58976b547d-j28z6\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:35.043904 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:35.043883    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-778341-58976b547d-j28z6\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:35.045951 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:35.045928    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-maas-api-tls\") pod \"maas-api-e2e-inf-a-778341-58976b547d-j28z6\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:35.046059 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:35.045951    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-metrics-certs\") pod \"maas-api-e2e-inf-a-778341-58976b547d-j28z6\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:35.052669 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:35.052644    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpn4w\" (UniqueName: \"kubernetes.io/projected/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-kube-api-access-tpn4w\") pod \"maas-api-e2e-inf-a-778341-58976b547d-j28z6\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:35.104745 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:35.104714    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:35.391830 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:35.390941    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"]
Sep 11 15:21:35.395967 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:21:35.395916    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2128f383_ce3f_4644_92a2_c8aa7bc4ecc0.slice/crio-e11292b079b9276304953a932adf8ff3587ccf503950bd315f78e0312dc834b0 WatchSource:0}: Error finding container e11292b079b9276304953a932adf8ff3587ccf503950bd315f78e0312dc834b0: Status 404 returned error can't find the container with id e11292b079b9276304953a932adf8ff3587ccf503950bd315f78e0312dc834b0
Sep 11 15:21:35.434383 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:35.434348    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6" event={"ID":"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0","Type":"ContainerStarted","Data":"e11292b079b9276304953a932adf8ff3587ccf503950bd315f78e0312dc834b0"}
Sep 11 15:21:36.441492 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:36.441453    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6" event={"ID":"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0","Type":"ContainerStarted","Data":"e45028524168825920a3270925a3437ea1dbe64d0e3f13df14e3322e06f371d6"}
Sep 11 15:21:36.441911 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:36.441573    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:36.458821 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:36.458774    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6" podStartSLOduration=2.091635036 podStartE2EDuration="2.458758736s" totalImagesPullingTime="367.1237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:21:36.457811433 +0000 UTC m=+770.917528433" watchObservedRunningTime="2026-09-11 15:21:36.458758736 +0000 UTC m=+770.918475735"
Sep 11 15:21:37.778728 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.778700    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"]
Sep 11 15:21:37.782736 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.782712    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.785123 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.785100    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6e6b7dd7-openshift-default-dockercfg-zhn8n\""
Sep 11 15:21:37.794934 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.794912    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"]
Sep 11 15:21:37.869814 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.869778    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-credential-socket\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.869814 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.869822    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vprs\" (UniqueName: \"kubernetes.io/projected/e9123a55-0624-4594-a085-d97cd3de5fc6-kube-api-access-6vprs\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.870065 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.869943    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9123a55-0624-4594-a085-d97cd3de5fc6-istiod-ca-cert\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.870065 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.869984    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-token\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.870065 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.870017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-workload-socket\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.870065 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.870045    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-data\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.870278 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.870098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-envoy\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.870278 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.870124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-workload-certs\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.870278 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.870147    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-podinfo\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.970716 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.970688    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-credential-socket\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.970716 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.970719    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vprs\" (UniqueName: \"kubernetes.io/projected/e9123a55-0624-4594-a085-d97cd3de5fc6-kube-api-access-6vprs\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.970932 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.970754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9123a55-0624-4594-a085-d97cd3de5fc6-istiod-ca-cert\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.970932 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.970777    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-token\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.970932 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.970808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-workload-socket\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.970932 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.970832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-data\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.970932 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.970874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-envoy\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.971182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.971017    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-workload-certs\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.971182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.971068    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-podinfo\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.971182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.971085    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-credential-socket\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.971338 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.971257    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-workload-socket\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.971383 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.971363    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-workload-certs\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.971467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.971441    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-data\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.971566 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.971447    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9123a55-0624-4594-a085-d97cd3de5fc6-istiod-ca-cert\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.973274 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.973255    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-envoy\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.973421 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.973407    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-podinfo\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.982695 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.982678    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vprs\" (UniqueName: \"kubernetes.io/projected/e9123a55-0624-4594-a085-d97cd3de5fc6-kube-api-access-6vprs\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:37.982959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:37.982942    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-token\") pod \"e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") " pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:38.093136 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:38.093061    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:38.375399 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:38.375375    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"]
Sep 11 15:21:38.376825 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:21:38.376796    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9123a55_0624_4594_a085_d97cd3de5fc6.slice/crio-41c0ebee663cc3a83dbc43ebc6846ffd92ce1386a2082d2abd908df13eb892a6 WatchSource:0}: Error finding container 41c0ebee663cc3a83dbc43ebc6846ffd92ce1386a2082d2abd908df13eb892a6: Status 404 returned error can't find the container with id 41c0ebee663cc3a83dbc43ebc6846ffd92ce1386a2082d2abd908df13eb892a6
Sep 11 15:21:38.378961 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:38.378929    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:21:38.379055 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:38.378992    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:21:38.379055 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:38.379018    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:21:38.455069 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:38.455021    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" event={"ID":"e9123a55-0624-4594-a085-d97cd3de5fc6","Type":"ContainerStarted","Data":"4f3cb8eb7472737462327bc6e60bcd5700219aa4d923eaf14f0bda0359320b24"}
Sep 11 15:21:38.455217 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:38.455099    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" event={"ID":"e9123a55-0624-4594-a085-d97cd3de5fc6","Type":"ContainerStarted","Data":"41c0ebee663cc3a83dbc43ebc6846ffd92ce1386a2082d2abd908df13eb892a6"}
Sep 11 15:21:38.481216 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:38.480970    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" podStartSLOduration=1.480950378 podStartE2EDuration="1.480950378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:21:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:21:38.477172715 +0000 UTC m=+772.936889716" watchObservedRunningTime="2026-09-11 15:21:38.480950378 +0000 UTC m=+772.940667378"
Sep 11 15:21:39.093430 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:39.093392    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:39.098225 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:39.098201    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:39.460146 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:39.460116    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:39.461162 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:39.461136    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:21:42.456780 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:42.456744    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:21:46.546550 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.546498    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"]
Sep 11 15:21:46.551024 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.550991    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:46.564054 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.562531    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-34c71e-serving-cert\""
Sep 11 15:21:46.567862 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.566957    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"]
Sep 11 15:21:46.661724 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.661689    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-metrics-certs\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:46.661916 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.661758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38a6a73e-b372-49cf-9974-f69c1fbcfd98-openshift-service-ca\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:46.661916 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.661843    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-maas-api-tls\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:46.661916 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.661898    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qbkt\" (UniqueName: \"kubernetes.io/projected/38a6a73e-b372-49cf-9974-f69c1fbcfd98-kube-api-access-7qbkt\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:46.762762 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.762730    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38a6a73e-b372-49cf-9974-f69c1fbcfd98-openshift-service-ca\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:46.762946 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.762784    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-maas-api-tls\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:46.762946 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.762809    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qbkt\" (UniqueName: \"kubernetes.io/projected/38a6a73e-b372-49cf-9974-f69c1fbcfd98-kube-api-access-7qbkt\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:46.762946 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.762838    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-metrics-certs\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:46.763121 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:21:46.762943    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-serving-cert: secret "maas-api-e2e-autores-34c71e-serving-cert" not found
Sep 11 15:21:46.763121 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:21:46.763033    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-maas-api-tls podName:38a6a73e-b372-49cf-9974-f69c1fbcfd98 nodeName:}" failed. No retries permitted until 2026-09-11 15:21:47.263001051 +0000 UTC m=+781.722718048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-maas-api-tls") pod "maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q" (UID: "38a6a73e-b372-49cf-9974-f69c1fbcfd98") : secret "maas-api-e2e-autores-34c71e-serving-cert" not found
Sep 11 15:21:46.763485 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.763464    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38a6a73e-b372-49cf-9974-f69c1fbcfd98-openshift-service-ca\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:46.765854 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.765828    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-metrics-certs\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:46.772866 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:46.772844    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qbkt\" (UniqueName: \"kubernetes.io/projected/38a6a73e-b372-49cf-9974-f69c1fbcfd98-kube-api-access-7qbkt\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:47.268668 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:47.268558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-maas-api-tls\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:47.282247 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:47.282213    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-maas-api-tls\") pod \"maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:47.473075 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:47.473031    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:47.756949 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:47.756823    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"]
Sep 11 15:21:47.760086 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:21:47.760055    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a6a73e_b372_49cf_9974_f69c1fbcfd98.slice/crio-80ade7860c214065b44edc26906c091f2a9d8dd9d5a8aeca7e8e1ecd0c7f78d5 WatchSource:0}: Error finding container 80ade7860c214065b44edc26906c091f2a9d8dd9d5a8aeca7e8e1ecd0c7f78d5: Status 404 returned error can't find the container with id 80ade7860c214065b44edc26906c091f2a9d8dd9d5a8aeca7e8e1ecd0c7f78d5
Sep 11 15:21:48.457770 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.457727    2574 patch_prober.go:28] interesting pod/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 15:21:48.457956 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.457783    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 15:21:48.508438 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.508402    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q" event={"ID":"38a6a73e-b372-49cf-9974-f69c1fbcfd98","Type":"ContainerStarted","Data":"9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3"}
Sep 11 15:21:48.508598 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.508469    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q" event={"ID":"38a6a73e-b372-49cf-9974-f69c1fbcfd98","Type":"ContainerStarted","Data":"80ade7860c214065b44edc26906c091f2a9d8dd9d5a8aeca7e8e1ecd0c7f78d5"}
Sep 11 15:21:48.508683 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.508630    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:48.526463 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.526408    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q" podStartSLOduration=2.193862624 podStartE2EDuration="2.526388381s" totalImagesPullingTime="332.525757ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:21:48.524354975 +0000 UTC m=+782.984071998" watchObservedRunningTime="2026-09-11 15:21:48.526388381 +0000 UTC m=+782.986105385"
Sep 11 15:21:48.842951 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.842872    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"]
Sep 11 15:21:48.846363 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.846343    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.849542 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.849525    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-9f08bd-openshift-default-dockercfg-49j26\""
Sep 11 15:21:48.872000 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.871971    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"]
Sep 11 15:21:48.887922 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.887881    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f16852ae-5793-486f-9f29-915f964b146c-istio-token\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.887922 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.887914    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f16852ae-5793-486f-9f29-915f964b146c-istiod-ca-cert\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.888209 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.887942    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-istio-data\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.888209 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.887965    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-credential-socket\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.888209 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.888021    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-istio-envoy\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.888209 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.888054    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-workload-socket\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.888209 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.888070    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f16852ae-5793-486f-9f29-915f964b146c-istio-podinfo\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.888209 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.888102    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wj6s\" (UniqueName: \"kubernetes.io/projected/f16852ae-5793-486f-9f29-915f964b146c-kube-api-access-4wj6s\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.888209 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.888161    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-workload-certs\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.989065 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989026    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-workload-socket\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.989065 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f16852ae-5793-486f-9f29-915f964b146c-istio-podinfo\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.989312 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989090    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wj6s\" (UniqueName: \"kubernetes.io/projected/f16852ae-5793-486f-9f29-915f964b146c-kube-api-access-4wj6s\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.989312 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989155    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-workload-certs\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.989312 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989194    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f16852ae-5793-486f-9f29-915f964b146c-istio-token\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.989312 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989260    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f16852ae-5793-486f-9f29-915f964b146c-istiod-ca-cert\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.989312 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989306    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-istio-data\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.989578 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-credential-socket\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.989578 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-istio-envoy\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.989711 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989590    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-workload-certs\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.989711 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989647    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-workload-socket\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.989836 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989815    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-istio-data\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.990013 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.989944    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-credential-socket\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.990141 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.990119    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f16852ae-5793-486f-9f29-915f964b146c-istiod-ca-cert\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.991934 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.991909    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-istio-envoy\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:48.992228 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:48.992213    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f16852ae-5793-486f-9f29-915f964b146c-istio-podinfo\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:49.003388 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:49.003359    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f16852ae-5793-486f-9f29-915f964b146c-istio-token\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:49.003502 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:49.003451    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wj6s\" (UniqueName: \"kubernetes.io/projected/f16852ae-5793-486f-9f29-915f964b146c-kube-api-access-4wj6s\") pod \"e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") " pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:49.156677 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:49.156605    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:49.440071 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:49.439963    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"]
Sep 11 15:21:49.444524 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:21:49.444500    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16852ae_5793_486f_9f29_915f964b146c.slice/crio-1a3701d894bc0f2ae9e71eb706eb7a7310168f405124c7f135e0dc9fa809a50c WatchSource:0}: Error finding container 1a3701d894bc0f2ae9e71eb706eb7a7310168f405124c7f135e0dc9fa809a50c: Status 404 returned error can't find the container with id 1a3701d894bc0f2ae9e71eb706eb7a7310168f405124c7f135e0dc9fa809a50c
Sep 11 15:21:49.446919 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:49.446879    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:21:49.447002 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:49.446970    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:21:49.447056 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:49.447023    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:21:49.517270 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:49.517245    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" event={"ID":"f16852ae-5793-486f-9f29-915f964b146c","Type":"ContainerStarted","Data":"1a3701d894bc0f2ae9e71eb706eb7a7310168f405124c7f135e0dc9fa809a50c"}
Sep 11 15:21:50.529650 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:50.529534    2574 generic.go:356] "Generic (PLEG): container finished" podID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerID="ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e" exitCode=0
Sep 11 15:21:50.530137 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:50.529635    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" event={"ID":"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96","Type":"ContainerDied","Data":"ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e"}
Sep 11 15:21:50.530231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:50.530172    2574 scope.go:117] "RemoveContainer" containerID="ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e"
Sep 11 15:21:50.531500 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:50.531466    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:21:50.531641 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:50.531560    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:21:50.531709 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:50.531635    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:21:50.531822 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:50.531799    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" event={"ID":"f16852ae-5793-486f-9f29-915f964b146c","Type":"ContainerStarted","Data":"fbaa68f26a433642c169679167db64222f6ec04314c195c7fb95ff546a3ba3c5"}
Sep 11 15:21:50.572302 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:50.572144    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" podStartSLOduration=2.5721231209999997 podStartE2EDuration="2.572123121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:21:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:21:50.570226808 +0000 UTC m=+785.029943812" watchObservedRunningTime="2026-09-11 15:21:50.572123121 +0000 UTC m=+785.031840120"
Sep 11 15:21:51.158397 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:51.158351    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:51.164453 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:51.164411    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:51.568516 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:51.566889    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" event={"ID":"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96","Type":"ContainerStarted","Data":"01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed"}
Sep 11 15:21:51.568516 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:51.566957    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:51.571356 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:51.571151    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:21:52.071785 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:52.071751    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:52.072097 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:52.072049    2574 patch_prober.go:28] interesting pod/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 15:21:52.072229 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:52.072129    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 15:21:53.071544 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:53.071500    2574 patch_prober.go:28] interesting pod/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 15:21:53.072195 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:53.072137    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 15:21:54.071873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:54.071829    2574 patch_prober.go:28] interesting pod/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 15:21:54.072432 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:54.072378    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 15:21:54.523488 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:54.523458    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:21:55.070995 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:55.070959    2574 patch_prober.go:28] interesting pod/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 15:21:55.071329 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:55.071298    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 15:21:56.071426 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:56.071383    2574 patch_prober.go:28] interesting pod/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 15:21:56.072065 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:56.072030    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 15:21:57.074708 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:57.074674    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:57.075096 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:57.074955    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:21:57.075659 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:21:57.075641    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:22:01.636325 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:01.636291    2574 generic.go:356] "Generic (PLEG): container finished" podID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerID="4f3cb8eb7472737462327bc6e60bcd5700219aa4d923eaf14f0bda0359320b24" exitCode=0
Sep 11 15:22:01.636737 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:01.636373    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" event={"ID":"e9123a55-0624-4594-a085-d97cd3de5fc6","Type":"ContainerDied","Data":"4f3cb8eb7472737462327bc6e60bcd5700219aa4d923eaf14f0bda0359320b24"}
Sep 11 15:22:01.636987 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:01.636970    2574 scope.go:117] "RemoveContainer" containerID="4f3cb8eb7472737462327bc6e60bcd5700219aa4d923eaf14f0bda0359320b24"
Sep 11 15:22:01.638210 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:01.638180    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:22:01.638297 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:01.638247    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:22:01.638297 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:01.638280    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:22:02.647877 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:02.647109    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" event={"ID":"e9123a55-0624-4594-a085-d97cd3de5fc6","Type":"ContainerStarted","Data":"8772c104034782e765fae0f9ffb09b88c02892d3962c1fa1f551f57f4a6aaa1a"}
Sep 11 15:22:03.094263 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:03.094178    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:22:03.094399 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:03.094372    2574 patch_prober.go:28] interesting pod/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 15:22:03.094454 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:03.094420    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 15:22:04.093798 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:04.093760    2574 patch_prober.go:28] interesting pod/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 15:22:04.094168 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:04.093824    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 15:22:05.094161 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:05.094122    2574 patch_prober.go:28] interesting pod/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 15:22:05.094528 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:05.094178    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 15:22:06.094395 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:06.094358    2574 patch_prober.go:28] interesting pod/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 15:22:06.094793 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:06.094409    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 15:22:07.094034 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:07.093989    2574 patch_prober.go:28] interesting pod/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 15:22:07.094218 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:07.094064    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 15:22:08.179679 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:08.179578    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:22:08.180114 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:08.180093    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:22:08.180963 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:08.180942    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:22:11.582780 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:11.582741    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"]
Sep 11 15:22:11.583240 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:11.583044    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerName="istio-proxy" containerID="cri-o://8772c104034782e765fae0f9ffb09b88c02892d3962c1fa1f551f57f4a6aaa1a" gracePeriod=30
Sep 11 15:22:13.719397 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:13.719363    2574 generic.go:356] "Generic (PLEG): container finished" podID="f16852ae-5793-486f-9f29-915f964b146c" containerID="fbaa68f26a433642c169679167db64222f6ec04314c195c7fb95ff546a3ba3c5" exitCode=0
Sep 11 15:22:13.719855 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:13.719413    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" event={"ID":"f16852ae-5793-486f-9f29-915f964b146c","Type":"ContainerDied","Data":"fbaa68f26a433642c169679167db64222f6ec04314c195c7fb95ff546a3ba3c5"}
Sep 11 15:22:13.719855 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:13.719828    2574 scope.go:117] "RemoveContainer" containerID="fbaa68f26a433642c169679167db64222f6ec04314c195c7fb95ff546a3ba3c5"
Sep 11 15:22:13.720859 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:13.720828    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:22:13.720957 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:13.720910    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:22:13.721016 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:13.720959    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:22:14.728306 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:14.728270    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" event={"ID":"f16852ae-5793-486f-9f29-915f964b146c","Type":"ContainerStarted","Data":"35bf9e9a1f6c01ae1f69815cb687f1aa1e2f15a6416db83008b01c902bd9693f"}
Sep 11 15:22:15.157749 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:15.157717    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:22:15.157926 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:15.157904    2574 patch_prober.go:28] interesting pod/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 15:22:15.157994 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:15.157967    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" podUID="f16852ae-5793-486f-9f29-915f964b146c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 15:22:16.157094 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.157060    2574 patch_prober.go:28] interesting pod/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 15:22:16.157739 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.157119    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" podUID="f16852ae-5793-486f-9f29-915f964b146c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 15:22:16.753640 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.750682    2574 generic.go:356] "Generic (PLEG): container finished" podID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerID="8772c104034782e765fae0f9ffb09b88c02892d3962c1fa1f551f57f4a6aaa1a" exitCode=0
Sep 11 15:22:16.753640 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.750781    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" event={"ID":"e9123a55-0624-4594-a085-d97cd3de5fc6","Type":"ContainerDied","Data":"8772c104034782e765fae0f9ffb09b88c02892d3962c1fa1f551f57f4a6aaa1a"}
Sep 11 15:22:16.753640 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.750840    2574 scope.go:117] "RemoveContainer" containerID="4f3cb8eb7472737462327bc6e60bcd5700219aa4d923eaf14f0bda0359320b24"
Sep 11 15:22:16.883059 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.883030    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:22:16.922331 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.922300    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-token\") pod \"e9123a55-0624-4594-a085-d97cd3de5fc6\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") "
Sep 11 15:22:16.922686 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.922664    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vprs\" (UniqueName: \"kubernetes.io/projected/e9123a55-0624-4594-a085-d97cd3de5fc6-kube-api-access-6vprs\") pod \"e9123a55-0624-4594-a085-d97cd3de5fc6\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") "
Sep 11 15:22:16.922830 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.922815    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-workload-socket\") pod \"e9123a55-0624-4594-a085-d97cd3de5fc6\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") "
Sep 11 15:22:16.922966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.922952    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-envoy\") pod \"e9123a55-0624-4594-a085-d97cd3de5fc6\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") "
Sep 11 15:22:16.923161 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.923097    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e9123a55-0624-4594-a085-d97cd3de5fc6" (UID: "e9123a55-0624-4594-a085-d97cd3de5fc6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:22:16.923161 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.923125    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-data\") pod \"e9123a55-0624-4594-a085-d97cd3de5fc6\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") "
Sep 11 15:22:16.923674 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.923158    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-podinfo\") pod \"e9123a55-0624-4594-a085-d97cd3de5fc6\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") "
Sep 11 15:22:16.923674 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.923202    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-credential-socket\") pod \"e9123a55-0624-4594-a085-d97cd3de5fc6\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") "
Sep 11 15:22:16.923674 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.923301    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-data" (OuterVolumeSpecName: "istio-data") pod "e9123a55-0624-4594-a085-d97cd3de5fc6" (UID: "e9123a55-0624-4594-a085-d97cd3de5fc6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:22:16.923674 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.923435    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-workload-certs\") pod \"e9123a55-0624-4594-a085-d97cd3de5fc6\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") "
Sep 11 15:22:16.923674 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.923537    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e9123a55-0624-4594-a085-d97cd3de5fc6" (UID: "e9123a55-0624-4594-a085-d97cd3de5fc6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:22:16.923674 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.923576    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9123a55-0624-4594-a085-d97cd3de5fc6-istiod-ca-cert\") pod \"e9123a55-0624-4594-a085-d97cd3de5fc6\" (UID: \"e9123a55-0624-4594-a085-d97cd3de5fc6\") "
Sep 11 15:22:16.924008 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.923685    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e9123a55-0624-4594-a085-d97cd3de5fc6" (UID: "e9123a55-0624-4594-a085-d97cd3de5fc6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:22:16.924008 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.923907    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9123a55-0624-4594-a085-d97cd3de5fc6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e9123a55-0624-4594-a085-d97cd3de5fc6" (UID: "e9123a55-0624-4594-a085-d97cd3de5fc6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:22:16.924113 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.924022    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-data\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:22:16.924113 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.924063    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-credential-socket\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:22:16.924273 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.924132    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-workload-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:22:16.924273 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.924194    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-workload-socket\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:22:16.925313 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.925200    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e9123a55-0624-4594-a085-d97cd3de5fc6" (UID: "e9123a55-0624-4594-a085-d97cd3de5fc6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:22:16.925420 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.925397    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-token" (OuterVolumeSpecName: "istio-token") pod "e9123a55-0624-4594-a085-d97cd3de5fc6" (UID: "e9123a55-0624-4594-a085-d97cd3de5fc6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:22:16.938821 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.938742    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e9123a55-0624-4594-a085-d97cd3de5fc6" (UID: "e9123a55-0624-4594-a085-d97cd3de5fc6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 15:22:16.951821 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:16.951760    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9123a55-0624-4594-a085-d97cd3de5fc6-kube-api-access-6vprs" (OuterVolumeSpecName: "kube-api-access-6vprs") pod "e9123a55-0624-4594-a085-d97cd3de5fc6" (UID: "e9123a55-0624-4594-a085-d97cd3de5fc6"). InnerVolumeSpecName "kube-api-access-6vprs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:22:17.025447 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.025406    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-podinfo\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:22:17.025447 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.025444    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9123a55-0624-4594-a085-d97cd3de5fc6-istiod-ca-cert\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:22:17.025447 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.025453    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-token\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:22:17.025447 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.025461    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vprs\" (UniqueName: \"kubernetes.io/projected/e9123a55-0624-4594-a085-d97cd3de5fc6-kube-api-access-6vprs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:22:17.025855 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.025470    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9123a55-0624-4594-a085-d97cd3de5fc6-istio-envoy\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:22:17.157549 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.157459    2574 patch_prober.go:28] interesting pod/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 15:22:17.157549 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.157528    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" podUID="f16852ae-5793-486f-9f29-915f964b146c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 15:22:17.759222 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.759195    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"
Sep 11 15:22:17.759222 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.759205    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9" event={"ID":"e9123a55-0624-4594-a085-d97cd3de5fc6","Type":"ContainerDied","Data":"41c0ebee663cc3a83dbc43ebc6846ffd92ce1386a2082d2abd908df13eb892a6"}
Sep 11 15:22:17.759477 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.759269    2574 scope.go:117] "RemoveContainer" containerID="8772c104034782e765fae0f9ffb09b88c02892d3962c1fa1f551f57f4a6aaa1a"
Sep 11 15:22:17.785471 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.785433    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"]
Sep 11 15:22:17.787529 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.787500    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6e6b7dd7-openshift-default-7bb94d5f8b-2bwk9"]
Sep 11 15:22:17.995820 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:17.995776    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" path="/var/lib/kubelet/pods/e9123a55-0624-4594-a085-d97cd3de5fc6/volumes"
Sep 11 15:22:18.157950 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.157911    2574 patch_prober.go:28] interesting pod/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 15:22:18.158317 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.157974    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" podUID="f16852ae-5793-486f-9f29-915f964b146c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 15:22:18.668867 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.668828    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"]
Sep 11 15:22:18.669263 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.669248    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerName="istio-proxy"
Sep 11 15:22:18.669319 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.669267    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerName="istio-proxy"
Sep 11 15:22:18.669362 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.669351    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerName="istio-proxy"
Sep 11 15:22:18.669397 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.669365    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerName="istio-proxy"
Sep 11 15:22:18.671936 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.671920    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"
Sep 11 15:22:18.674719 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.674700    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-73b24789\""
Sep 11 15:22:18.674804 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.674784    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-73b24789-dockercfg-d6brd\""
Sep 11 15:22:18.681407 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.681380    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"]
Sep 11 15:22:18.752652 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.749168    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1274a25-b002-4331-b26a-1195f4ad2090-plugins-config-volume\") pod \"payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl\" (UID: \"f1274a25-b002-4331-b26a-1195f4ad2090\") " pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"
Sep 11 15:22:18.752652 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.749265    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8v6h\" (UniqueName: \"kubernetes.io/projected/f1274a25-b002-4331-b26a-1195f4ad2090-kube-api-access-z8v6h\") pod \"payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl\" (UID: \"f1274a25-b002-4331-b26a-1195f4ad2090\") " pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"
Sep 11 15:22:18.850389 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.850342    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8v6h\" (UniqueName: \"kubernetes.io/projected/f1274a25-b002-4331-b26a-1195f4ad2090-kube-api-access-z8v6h\") pod \"payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl\" (UID: \"f1274a25-b002-4331-b26a-1195f4ad2090\") " pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"
Sep 11 15:22:18.851219 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.851179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1274a25-b002-4331-b26a-1195f4ad2090-plugins-config-volume\") pod \"payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl\" (UID: \"f1274a25-b002-4331-b26a-1195f4ad2090\") " pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"
Sep 11 15:22:18.852118 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.852092    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1274a25-b002-4331-b26a-1195f4ad2090-plugins-config-volume\") pod \"payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl\" (UID: \"f1274a25-b002-4331-b26a-1195f4ad2090\") " pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"
Sep 11 15:22:18.858429 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.858407    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8v6h\" (UniqueName: \"kubernetes.io/projected/f1274a25-b002-4331-b26a-1195f4ad2090-kube-api-access-z8v6h\") pod \"payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl\" (UID: \"f1274a25-b002-4331-b26a-1195f4ad2090\") " pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"
Sep 11 15:22:18.983608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:18.983509    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"
Sep 11 15:22:19.157689 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:19.157646    2574 patch_prober.go:28] interesting pod/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 15:22:19.157878 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:19.157710    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" podUID="f16852ae-5793-486f-9f29-915f964b146c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 15:22:19.278607 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:19.278580    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"]
Sep 11 15:22:19.281004 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:22:19.280973    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1274a25_b002_4331_b26a_1195f4ad2090.slice/crio-f3d35e499acda36c5269fb075f3cd68c79ef51fc9cfa9f73127725fb2f095161 WatchSource:0}: Error finding container f3d35e499acda36c5269fb075f3cd68c79ef51fc9cfa9f73127725fb2f095161: Status 404 returned error can't find the container with id f3d35e499acda36c5269fb075f3cd68c79ef51fc9cfa9f73127725fb2f095161
Sep 11 15:22:19.785321 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:19.785279    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl" event={"ID":"f1274a25-b002-4331-b26a-1195f4ad2090","Type":"ContainerStarted","Data":"ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4"}
Sep 11 15:22:19.785540 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:19.785524    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"
Sep 11 15:22:19.785603 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:19.785548    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl" event={"ID":"f1274a25-b002-4331-b26a-1195f4ad2090","Type":"ContainerStarted","Data":"f3d35e499acda36c5269fb075f3cd68c79ef51fc9cfa9f73127725fb2f095161"}
Sep 11 15:22:19.802880 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:19.802824    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl" podStartSLOduration=1.8028028809999999 podStartE2EDuration="1.802802881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:22:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:22:19.800296743 +0000 UTC m=+814.260013744" watchObservedRunningTime="2026-09-11 15:22:19.802802881 +0000 UTC m=+814.262519882"
Sep 11 15:22:20.161192 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:20.161166    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:22:20.161462 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:20.161442    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:22:20.162132 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:20.162111    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:22:30.793116 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:30.793085    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"
Sep 11 15:22:47.869670 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:47.869630    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"]
Sep 11 15:22:47.870254 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:47.869927    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl" podUID="f1274a25-b002-4331-b26a-1195f4ad2090" containerName="payload-processing" containerID="cri-o://ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4" gracePeriod=30
Sep 11 15:22:48.139314 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.139275    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"
Sep 11 15:22:48.144455 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.144425    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1274a25-b002-4331-b26a-1195f4ad2090-plugins-config-volume\") pod \"f1274a25-b002-4331-b26a-1195f4ad2090\" (UID: \"f1274a25-b002-4331-b26a-1195f4ad2090\") "
Sep 11 15:22:48.144601 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.144489    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8v6h\" (UniqueName: \"kubernetes.io/projected/f1274a25-b002-4331-b26a-1195f4ad2090-kube-api-access-z8v6h\") pod \"f1274a25-b002-4331-b26a-1195f4ad2090\" (UID: \"f1274a25-b002-4331-b26a-1195f4ad2090\") "
Sep 11 15:22:48.144792 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.144767    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1274a25-b002-4331-b26a-1195f4ad2090-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f1274a25-b002-4331-b26a-1195f4ad2090" (UID: "f1274a25-b002-4331-b26a-1195f4ad2090"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:22:48.146905 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.146879    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1274a25-b002-4331-b26a-1195f4ad2090-kube-api-access-z8v6h" (OuterVolumeSpecName: "kube-api-access-z8v6h") pod "f1274a25-b002-4331-b26a-1195f4ad2090" (UID: "f1274a25-b002-4331-b26a-1195f4ad2090"). InnerVolumeSpecName "kube-api-access-z8v6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:22:48.245675 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.245637    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1274a25-b002-4331-b26a-1195f4ad2090-plugins-config-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:22:48.245675 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.245677    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8v6h\" (UniqueName: \"kubernetes.io/projected/f1274a25-b002-4331-b26a-1195f4ad2090-kube-api-access-z8v6h\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:22:48.954738 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.954707    2574 generic.go:356] "Generic (PLEG): container finished" podID="f1274a25-b002-4331-b26a-1195f4ad2090" containerID="ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4" exitCode=0
Sep 11 15:22:48.955170 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.954754    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"
Sep 11 15:22:48.955170 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.954771    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl" event={"ID":"f1274a25-b002-4331-b26a-1195f4ad2090","Type":"ContainerDied","Data":"ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4"}
Sep 11 15:22:48.955170 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.954813    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl" event={"ID":"f1274a25-b002-4331-b26a-1195f4ad2090","Type":"ContainerDied","Data":"f3d35e499acda36c5269fb075f3cd68c79ef51fc9cfa9f73127725fb2f095161"}
Sep 11 15:22:48.955170 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.954836    2574 scope.go:117] "RemoveContainer" containerID="ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4"
Sep 11 15:22:48.964574 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.964550    2574 scope.go:117] "RemoveContainer" containerID="ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4"
Sep 11 15:22:48.964899 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:22:48.964879    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4\": container with ID starting with ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4 not found: ID does not exist" containerID="ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4"
Sep 11 15:22:48.964956 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.964907    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4"} err="failed to get container status \"ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4\": rpc error: code = NotFound desc = could not find container \"ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4\": container with ID starting with ba888723a2377fe920868220501b2101c9b970217ba57b468f17e8ca7c5360f4 not found: ID does not exist"
Sep 11 15:22:48.986076 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.986043    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"]
Sep 11 15:22:48.991583 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:48.991560    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-73b24789-66c8dccd74-w85hl"]
Sep 11 15:22:49.174770 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.174732    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"]
Sep 11 15:22:49.175393 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.175368    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerName="istio-proxy"
Sep 11 15:22:49.175393 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.175396    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9123a55-0624-4594-a085-d97cd3de5fc6" containerName="istio-proxy"
Sep 11 15:22:49.175586 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.175415    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1274a25-b002-4331-b26a-1195f4ad2090" containerName="payload-processing"
Sep 11 15:22:49.175586 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.175425    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1274a25-b002-4331-b26a-1195f4ad2090" containerName="payload-processing"
Sep 11 15:22:49.175586 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.175544    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1274a25-b002-4331-b26a-1195f4ad2090" containerName="payload-processing"
Sep 11 15:22:49.179085 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.179064    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.181781 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.181750    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-34c71e\"/\"kube-root-ca.crt\""
Sep 11 15:22:49.181781 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.181770    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-34c71e\"/\"default-dockercfg-5w9v5\""
Sep 11 15:22:49.181968 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.181885    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-34c71e\"/\"openshift-service-ca.crt\""
Sep 11 15:22:49.182053 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.182036    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-34c71e\"/\"autores-model-34c71e-kserve-self-signed-certs\""
Sep 11 15:22:49.188017 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.187906    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"]
Sep 11 15:22:49.252988 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.252900    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnt8z\" (UniqueName: \"kubernetes.io/projected/7a7500f2-8896-48df-b991-cb19b1904727-kube-api-access-mnt8z\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.252988 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.252936    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-dshm\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.252988 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.252953    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-model-cache\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.253232 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.253050    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-home\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.253232 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.253105    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-tmp-dir\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.253232 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.253130    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a7500f2-8896-48df-b991-cb19b1904727-tls-certs\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.354373 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.354342    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnt8z\" (UniqueName: \"kubernetes.io/projected/7a7500f2-8896-48df-b991-cb19b1904727-kube-api-access-mnt8z\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.354564 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.354382    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-dshm\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.354564 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.354408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-model-cache\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.354564 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.354452    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-home\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.354564 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.354502    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-tmp-dir\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.354564 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.354522    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a7500f2-8896-48df-b991-cb19b1904727-tls-certs\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.354912 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.354892    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-tmp-dir\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.354979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.354919    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-model-cache\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.355027 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.354972    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-home\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.356921 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.356896    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-dshm\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.357224 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.357206    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a7500f2-8896-48df-b991-cb19b1904727-tls-certs\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.361907 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.361882    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnt8z\" (UniqueName: \"kubernetes.io/projected/7a7500f2-8896-48df-b991-cb19b1904727-kube-api-access-mnt8z\") pod \"autores-model-34c71e-kserve-779d68667f-7vfgk\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") " pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.491608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.491558    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:49.770299 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.770270    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"]
Sep 11 15:22:49.771609 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:22:49.771579    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a7500f2_8896_48df_b991_cb19b1904727.slice/crio-76b7b8a7c02e8f7ae866d5dd3ad039a3fa1664490557f240978e08edefbab734 WatchSource:0}: Error finding container 76b7b8a7c02e8f7ae866d5dd3ad039a3fa1664490557f240978e08edefbab734: Status 404 returned error can't find the container with id 76b7b8a7c02e8f7ae866d5dd3ad039a3fa1664490557f240978e08edefbab734
Sep 11 15:22:49.962755 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.962642    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk" event={"ID":"7a7500f2-8896-48df-b991-cb19b1904727","Type":"ContainerStarted","Data":"135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8"}
Sep 11 15:22:49.962755 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.962704    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk" event={"ID":"7a7500f2-8896-48df-b991-cb19b1904727","Type":"ContainerStarted","Data":"76b7b8a7c02e8f7ae866d5dd3ad039a3fa1664490557f240978e08edefbab734"}
Sep 11 15:22:49.978422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.978362    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk" podStartSLOduration=0.978343526 podStartE2EDuration="978.343526ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:22:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:22:49.977949354 +0000 UTC m=+844.437666376" watchObservedRunningTime="2026-09-11 15:22:49.978343526 +0000 UTC m=+844.438060525"
Sep 11 15:22:49.995121 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:49.995083    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1274a25-b002-4331-b26a-1195f4ad2090" path="/var/lib/kubelet/pods/f1274a25-b002-4331-b26a-1195f4ad2090/volumes"
Sep 11 15:22:56.247429 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.247393    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"]
Sep 11 15:22:56.250113 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.250096    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"
Sep 11 15:22:56.253217 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.253187    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8c097d73\""
Sep 11 15:22:56.253217 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.253192    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8c097d73-dockercfg-nrnhz\""
Sep 11 15:22:56.267667 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.267599    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"]
Sep 11 15:22:56.323975 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.323940    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzjvt\" (UniqueName: \"kubernetes.io/projected/5e1edf4b-f304-4ffe-b43e-32ccccda364f-kube-api-access-lzjvt\") pod \"payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm\" (UID: \"5e1edf4b-f304-4ffe-b43e-32ccccda364f\") " pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"
Sep 11 15:22:56.324152 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.324025    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1edf4b-f304-4ffe-b43e-32ccccda364f-plugins-config-volume\") pod \"payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm\" (UID: \"5e1edf4b-f304-4ffe-b43e-32ccccda364f\") " pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"
Sep 11 15:22:56.425290 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.425249    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1edf4b-f304-4ffe-b43e-32ccccda364f-plugins-config-volume\") pod \"payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm\" (UID: \"5e1edf4b-f304-4ffe-b43e-32ccccda364f\") " pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"
Sep 11 15:22:56.425493 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.425329    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzjvt\" (UniqueName: \"kubernetes.io/projected/5e1edf4b-f304-4ffe-b43e-32ccccda364f-kube-api-access-lzjvt\") pod \"payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm\" (UID: \"5e1edf4b-f304-4ffe-b43e-32ccccda364f\") " pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"
Sep 11 15:22:56.426017 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.425994    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1edf4b-f304-4ffe-b43e-32ccccda364f-plugins-config-volume\") pod \"payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm\" (UID: \"5e1edf4b-f304-4ffe-b43e-32ccccda364f\") " pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"
Sep 11 15:22:56.433290 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.433264    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzjvt\" (UniqueName: \"kubernetes.io/projected/5e1edf4b-f304-4ffe-b43e-32ccccda364f-kube-api-access-lzjvt\") pod \"payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm\" (UID: \"5e1edf4b-f304-4ffe-b43e-32ccccda364f\") " pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"
Sep 11 15:22:56.571763 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.571666    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"
Sep 11 15:22:56.849102 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:56.849070    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"]
Sep 11 15:22:56.851736 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:22:56.851702    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1edf4b_f304_4ffe_b43e_32ccccda364f.slice/crio-fc243ae3a9f1cd7e1a28dc925ace4ef5aeb18323d0174bf9c572937a0cf739c6 WatchSource:0}: Error finding container fc243ae3a9f1cd7e1a28dc925ace4ef5aeb18323d0174bf9c572937a0cf739c6: Status 404 returned error can't find the container with id fc243ae3a9f1cd7e1a28dc925ace4ef5aeb18323d0174bf9c572937a0cf739c6
Sep 11 15:22:57.002753 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:57.002718    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm" event={"ID":"5e1edf4b-f304-4ffe-b43e-32ccccda364f","Type":"ContainerStarted","Data":"4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8"}
Sep 11 15:22:57.002955 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:57.002775    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm" event={"ID":"5e1edf4b-f304-4ffe-b43e-32ccccda364f","Type":"ContainerStarted","Data":"fc243ae3a9f1cd7e1a28dc925ace4ef5aeb18323d0174bf9c572937a0cf739c6"}
Sep 11 15:22:57.002955 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:57.002854    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"
Sep 11 15:22:57.022348 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:57.022290    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm" podStartSLOduration=1.022271664 podStartE2EDuration="1.022271664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:22:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:22:57.02152608 +0000 UTC m=+851.481243093" watchObservedRunningTime="2026-09-11 15:22:57.022271664 +0000 UTC m=+851.481988667"
Sep 11 15:22:59.491937 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:59.491901    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:59.492385 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:59.491958    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:22:59.504455 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:22:59.504430    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:23:00.030029 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:00.029993    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:23:08.009603 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:08.009566    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"
Sep 11 15:23:32.872041 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:32.872003    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"]
Sep 11 15:23:32.872554 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:32.872258    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q" podUID="38a6a73e-b372-49cf-9974-f69c1fbcfd98" containerName="maas-api" containerID="cri-o://9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3" gracePeriod=30
Sep 11 15:23:33.149997 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.149972    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:23:33.202221 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.202187    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-metrics-certs\") pod \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") "
Sep 11 15:23:33.202402 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.202262    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qbkt\" (UniqueName: \"kubernetes.io/projected/38a6a73e-b372-49cf-9974-f69c1fbcfd98-kube-api-access-7qbkt\") pod \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") "
Sep 11 15:23:33.202402 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.202311    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38a6a73e-b372-49cf-9974-f69c1fbcfd98-openshift-service-ca\") pod \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") "
Sep 11 15:23:33.202402 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.202331    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-maas-api-tls\") pod \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\" (UID: \"38a6a73e-b372-49cf-9974-f69c1fbcfd98\") "
Sep 11 15:23:33.202694 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.202667    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38a6a73e-b372-49cf-9974-f69c1fbcfd98-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38a6a73e-b372-49cf-9974-f69c1fbcfd98" (UID: "38a6a73e-b372-49cf-9974-f69c1fbcfd98"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:23:33.204886 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.204859    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38a6a73e-b372-49cf-9974-f69c1fbcfd98" (UID: "38a6a73e-b372-49cf-9974-f69c1fbcfd98"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:23:33.205110 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.205086    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "38a6a73e-b372-49cf-9974-f69c1fbcfd98" (UID: "38a6a73e-b372-49cf-9974-f69c1fbcfd98"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:23:33.205184 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.205121    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38a6a73e-b372-49cf-9974-f69c1fbcfd98-kube-api-access-7qbkt" (OuterVolumeSpecName: "kube-api-access-7qbkt") pod "38a6a73e-b372-49cf-9974-f69c1fbcfd98" (UID: "38a6a73e-b372-49cf-9974-f69c1fbcfd98"). InnerVolumeSpecName "kube-api-access-7qbkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:23:33.209962 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.209935    2574 generic.go:356] "Generic (PLEG): container finished" podID="38a6a73e-b372-49cf-9974-f69c1fbcfd98" containerID="9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3" exitCode=0
Sep 11 15:23:33.210091 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.209995    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"
Sep 11 15:23:33.210091 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.210020    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q" event={"ID":"38a6a73e-b372-49cf-9974-f69c1fbcfd98","Type":"ContainerDied","Data":"9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3"}
Sep 11 15:23:33.210220 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.210101    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q" event={"ID":"38a6a73e-b372-49cf-9974-f69c1fbcfd98","Type":"ContainerDied","Data":"80ade7860c214065b44edc26906c091f2a9d8dd9d5a8aeca7e8e1ecd0c7f78d5"}
Sep 11 15:23:33.210220 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.210133    2574 scope.go:117] "RemoveContainer" containerID="9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3"
Sep 11 15:23:33.219579 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.219555    2574 scope.go:117] "RemoveContainer" containerID="9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3"
Sep 11 15:23:33.219923 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:23:33.219903    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3\": container with ID starting with 9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3 not found: ID does not exist" containerID="9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3"
Sep 11 15:23:33.219992 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.219932    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3"} err="failed to get container status \"9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3\": rpc error: code = NotFound desc = could not find container \"9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3\": container with ID starting with 9096705553cd5f8105bf7772cd4658056dec7a64993111eb99ea4869a24702e3 not found: ID does not exist"
Sep 11 15:23:33.237145 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.237109    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"]
Sep 11 15:23:33.240489 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.240459    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-34c71e-699cff4cc7-sqr6q"]
Sep 11 15:23:33.303531 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.303493    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qbkt\" (UniqueName: \"kubernetes.io/projected/38a6a73e-b372-49cf-9974-f69c1fbcfd98-kube-api-access-7qbkt\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:23:33.303531 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.303524    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38a6a73e-b372-49cf-9974-f69c1fbcfd98-openshift-service-ca\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:23:33.303796 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.303538    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-maas-api-tls\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:23:33.303796 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.303553    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a6a73e-b372-49cf-9974-f69c1fbcfd98-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:23:33.994822 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:33.994779    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38a6a73e-b372-49cf-9974-f69c1fbcfd98" path="/var/lib/kubelet/pods/38a6a73e-b372-49cf-9974-f69c1fbcfd98/volumes"
Sep 11 15:23:35.836671 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:35.836634    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"]
Sep 11 15:23:35.837460 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:35.837425    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm" podUID="5e1edf4b-f304-4ffe-b43e-32ccccda364f" containerName="payload-processing" containerID="cri-o://4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8" gracePeriod=30
Sep 11 15:23:36.105397 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.105367    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"
Sep 11 15:23:36.231526 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.231487    2574 generic.go:356] "Generic (PLEG): container finished" podID="5e1edf4b-f304-4ffe-b43e-32ccccda364f" containerID="4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8" exitCode=0
Sep 11 15:23:36.231774 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.231553    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"
Sep 11 15:23:36.231774 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.231579    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm" event={"ID":"5e1edf4b-f304-4ffe-b43e-32ccccda364f","Type":"ContainerDied","Data":"4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8"}
Sep 11 15:23:36.231774 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.231649    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm" event={"ID":"5e1edf4b-f304-4ffe-b43e-32ccccda364f","Type":"ContainerDied","Data":"fc243ae3a9f1cd7e1a28dc925ace4ef5aeb18323d0174bf9c572937a0cf739c6"}
Sep 11 15:23:36.231774 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.231683    2574 scope.go:117] "RemoveContainer" containerID="4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8"
Sep 11 15:23:36.234295 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.234266    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1edf4b-f304-4ffe-b43e-32ccccda364f-plugins-config-volume\") pod \"5e1edf4b-f304-4ffe-b43e-32ccccda364f\" (UID: \"5e1edf4b-f304-4ffe-b43e-32ccccda364f\") "
Sep 11 15:23:36.234460 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.234434    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzjvt\" (UniqueName: \"kubernetes.io/projected/5e1edf4b-f304-4ffe-b43e-32ccccda364f-kube-api-access-lzjvt\") pod \"5e1edf4b-f304-4ffe-b43e-32ccccda364f\" (UID: \"5e1edf4b-f304-4ffe-b43e-32ccccda364f\") "
Sep 11 15:23:36.234859 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.234834    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e1edf4b-f304-4ffe-b43e-32ccccda364f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5e1edf4b-f304-4ffe-b43e-32ccccda364f" (UID: "5e1edf4b-f304-4ffe-b43e-32ccccda364f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:23:36.237151 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.237123    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e1edf4b-f304-4ffe-b43e-32ccccda364f-kube-api-access-lzjvt" (OuterVolumeSpecName: "kube-api-access-lzjvt") pod "5e1edf4b-f304-4ffe-b43e-32ccccda364f" (UID: "5e1edf4b-f304-4ffe-b43e-32ccccda364f"). InnerVolumeSpecName "kube-api-access-lzjvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:23:36.253872 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.253844    2574 scope.go:117] "RemoveContainer" containerID="4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8"
Sep 11 15:23:36.254292 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:23:36.254266    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8\": container with ID starting with 4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8 not found: ID does not exist" containerID="4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8"
Sep 11 15:23:36.254365 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.254303    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8"} err="failed to get container status \"4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8\": rpc error: code = NotFound desc = could not find container \"4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8\": container with ID starting with 4b4c74c85b9170327ba28f9b321a388f32348b4cdfdcb242718fffbe09b834b8 not found: ID does not exist"
Sep 11 15:23:36.336232 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.336187    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1edf4b-f304-4ffe-b43e-32ccccda364f-plugins-config-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:23:36.336232 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.336218    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzjvt\" (UniqueName: \"kubernetes.io/projected/5e1edf4b-f304-4ffe-b43e-32ccccda364f-kube-api-access-lzjvt\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:23:36.553047 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.553013    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"]
Sep 11 15:23:36.558371 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:36.558341    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8c097d73-695bbd9449-nqqdm"]
Sep 11 15:23:37.995598 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:37.995492    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e1edf4b-f304-4ffe-b43e-32ccccda364f" path="/var/lib/kubelet/pods/5e1edf4b-f304-4ffe-b43e-32ccccda364f/volumes"
Sep 11 15:23:38.442877 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:38.442842    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"]
Sep 11 15:23:42.497291 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.497258    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"]
Sep 11 15:23:42.497877 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.497857    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e1edf4b-f304-4ffe-b43e-32ccccda364f" containerName="payload-processing"
Sep 11 15:23:42.497963 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.497881    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e1edf4b-f304-4ffe-b43e-32ccccda364f" containerName="payload-processing"
Sep 11 15:23:42.497963 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.497904    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a6a73e-b372-49cf-9974-f69c1fbcfd98" containerName="maas-api"
Sep 11 15:23:42.497963 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.497913    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a6a73e-b372-49cf-9974-f69c1fbcfd98" containerName="maas-api"
Sep 11 15:23:42.498173 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.498027    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e1edf4b-f304-4ffe-b43e-32ccccda364f" containerName="payload-processing"
Sep 11 15:23:42.498173 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.498048    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="38a6a73e-b372-49cf-9974-f69c1fbcfd98" containerName="maas-api"
Sep 11 15:23:42.500391 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.500368    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"
Sep 11 15:23:42.503096 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.503071    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-df3af038-dockercfg-fpvmk\""
Sep 11 15:23:42.503212 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.503071    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-df3af038\""
Sep 11 15:23:42.512318 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.512293    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"]
Sep 11 15:23:42.602342 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.602298    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t7kr\" (UniqueName: \"kubernetes.io/projected/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab-kube-api-access-7t7kr\") pod \"payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k\" (UID: \"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"
Sep 11 15:23:42.602543 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.602401    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k\" (UID: \"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"
Sep 11 15:23:42.703501 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.703454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t7kr\" (UniqueName: \"kubernetes.io/projected/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab-kube-api-access-7t7kr\") pod \"payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k\" (UID: \"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"
Sep 11 15:23:42.703731 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.703518    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k\" (UID: \"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"
Sep 11 15:23:42.704252 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.704229    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k\" (UID: \"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"
Sep 11 15:23:42.711967 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.711941    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t7kr\" (UniqueName: \"kubernetes.io/projected/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab-kube-api-access-7t7kr\") pod \"payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k\" (UID: \"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"
Sep 11 15:23:42.811205 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:42.811082    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"
Sep 11 15:23:43.094701 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:43.094594    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"]
Sep 11 15:23:43.097714 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:23:43.097687    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cea2cc7_6ede_4eaa_a56e_3e7f618e1aab.slice/crio-c223b9d7fcace3c9c0fd3b84978859a9b910332cc9b2005ed09886c144f1390b WatchSource:0}: Error finding container c223b9d7fcace3c9c0fd3b84978859a9b910332cc9b2005ed09886c144f1390b: Status 404 returned error can't find the container with id c223b9d7fcace3c9c0fd3b84978859a9b910332cc9b2005ed09886c144f1390b
Sep 11 15:23:43.279164 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:43.279126    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k" event={"ID":"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab","Type":"ContainerStarted","Data":"557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa"}
Sep 11 15:23:43.279332 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:43.279183    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k" event={"ID":"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab","Type":"ContainerStarted","Data":"c223b9d7fcace3c9c0fd3b84978859a9b910332cc9b2005ed09886c144f1390b"}
Sep 11 15:23:43.279332 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:43.279206    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"
Sep 11 15:23:43.294056 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:43.293996    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k" podStartSLOduration=1.293976695 podStartE2EDuration="1.293976695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:23:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:23:43.293275392 +0000 UTC m=+897.752992393" watchObservedRunningTime="2026-09-11 15:23:43.293976695 +0000 UTC m=+897.753693696"
Sep 11 15:23:53.465547 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.465506    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk" podUID="7a7500f2-8896-48df-b991-cb19b1904727" containerName="main" containerID="cri-o://135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8" gracePeriod=45
Sep 11 15:23:53.724585 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.724520    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:23:53.823639 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.823590    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-dshm\") pod \"7a7500f2-8896-48df-b991-cb19b1904727\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") "
Sep 11 15:23:53.823829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.823656    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-tmp-dir\") pod \"7a7500f2-8896-48df-b991-cb19b1904727\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") "
Sep 11 15:23:53.823829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.823673    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-home\") pod \"7a7500f2-8896-48df-b991-cb19b1904727\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") "
Sep 11 15:23:53.823829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.823709    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a7500f2-8896-48df-b991-cb19b1904727-tls-certs\") pod \"7a7500f2-8896-48df-b991-cb19b1904727\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") "
Sep 11 15:23:53.823829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.823734    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnt8z\" (UniqueName: \"kubernetes.io/projected/7a7500f2-8896-48df-b991-cb19b1904727-kube-api-access-mnt8z\") pod \"7a7500f2-8896-48df-b991-cb19b1904727\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") "
Sep 11 15:23:53.823829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.823768    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-model-cache\") pod \"7a7500f2-8896-48df-b991-cb19b1904727\" (UID: \"7a7500f2-8896-48df-b991-cb19b1904727\") "
Sep 11 15:23:53.824094 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.823991    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-home" (OuterVolumeSpecName: "home") pod "7a7500f2-8896-48df-b991-cb19b1904727" (UID: "7a7500f2-8896-48df-b991-cb19b1904727"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:23:53.824094 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.824004    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7a7500f2-8896-48df-b991-cb19b1904727" (UID: "7a7500f2-8896-48df-b991-cb19b1904727"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:23:53.824174 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.824092    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-model-cache" (OuterVolumeSpecName: "model-cache") pod "7a7500f2-8896-48df-b991-cb19b1904727" (UID: "7a7500f2-8896-48df-b991-cb19b1904727"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:23:53.824238 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.824219    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-tmp-dir\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:23:53.824289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.824244    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-home\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:23:53.824289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.824261    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-model-cache\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:23:53.826231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.826110    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a7500f2-8896-48df-b991-cb19b1904727-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7a7500f2-8896-48df-b991-cb19b1904727" (UID: "7a7500f2-8896-48df-b991-cb19b1904727"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:23:53.826231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.826199    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-dshm" (OuterVolumeSpecName: "dshm") pod "7a7500f2-8896-48df-b991-cb19b1904727" (UID: "7a7500f2-8896-48df-b991-cb19b1904727"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:23:53.826382 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.826250    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a7500f2-8896-48df-b991-cb19b1904727-kube-api-access-mnt8z" (OuterVolumeSpecName: "kube-api-access-mnt8z") pod "7a7500f2-8896-48df-b991-cb19b1904727" (UID: "7a7500f2-8896-48df-b991-cb19b1904727"). InnerVolumeSpecName "kube-api-access-mnt8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:23:53.925311 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.925273    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a7500f2-8896-48df-b991-cb19b1904727-dshm\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:23:53.925311 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.925306    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a7500f2-8896-48df-b991-cb19b1904727-tls-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:23:53.925311 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:53.925318    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnt8z\" (UniqueName: \"kubernetes.io/projected/7a7500f2-8896-48df-b991-cb19b1904727-kube-api-access-mnt8z\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:23:54.286596 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:54.286511    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"
Sep 11 15:23:54.341849 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:54.341814    2574 generic.go:356] "Generic (PLEG): container finished" podID="7a7500f2-8896-48df-b991-cb19b1904727" containerID="135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8" exitCode=0
Sep 11 15:23:54.342013 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:54.341867    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"
Sep 11 15:23:54.342013 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:54.341898    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk" event={"ID":"7a7500f2-8896-48df-b991-cb19b1904727","Type":"ContainerDied","Data":"135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8"}
Sep 11 15:23:54.342013 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:54.341966    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk" event={"ID":"7a7500f2-8896-48df-b991-cb19b1904727","Type":"ContainerDied","Data":"76b7b8a7c02e8f7ae866d5dd3ad039a3fa1664490557f240978e08edefbab734"}
Sep 11 15:23:54.342013 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:54.341992    2574 scope.go:117] "RemoveContainer" containerID="135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8"
Sep 11 15:23:54.351359 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:54.351340    2574 scope.go:117] "RemoveContainer" containerID="135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8"
Sep 11 15:23:54.351747 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:23:54.351719    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8\": container with ID starting with 135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8 not found: ID does not exist" containerID="135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8"
Sep 11 15:23:54.351819 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:54.351759    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8"} err="failed to get container status \"135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8\": rpc error: code = NotFound desc = could not find container \"135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8\": container with ID starting with 135af0621b20e808542f7ad3181ee83933fafefcc67d4cc294db29225703a7e8 not found: ID does not exist"
Sep 11 15:23:54.358387 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:54.358357    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"]
Sep 11 15:23:54.364751 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:54.364722    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-34c71e/autores-model-34c71e-kserve-779d68667f-7vfgk"]
Sep 11 15:23:55.996344 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:55.996308    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a7500f2-8896-48df-b991-cb19b1904727" path="/var/lib/kubelet/pods/7a7500f2-8896-48df-b991-cb19b1904727/volumes"
Sep 11 15:23:56.569628 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.569580    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"]
Sep 11 15:23:56.570180 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.570158    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a7500f2-8896-48df-b991-cb19b1904727" containerName="main"
Sep 11 15:23:56.570180 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.570181    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a7500f2-8896-48df-b991-cb19b1904727" containerName="main"
Sep 11 15:23:56.570352 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.570270    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a7500f2-8896-48df-b991-cb19b1904727" containerName="main"
Sep 11 15:23:56.577116 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.577081    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.581193 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.581153    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-778341\"/\"default-dockercfg-9xkzt\""
Sep 11 15:23:56.581572 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.581153    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-778341\"/\"test-model-778341-kserve-self-signed-certs\""
Sep 11 15:23:56.581763 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.581174    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-778341\"/\"kube-root-ca.crt\""
Sep 11 15:23:56.581923 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.581192    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-778341\"/\"openshift-service-ca.crt\""
Sep 11 15:23:56.584762 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.584741    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"]
Sep 11 15:23:56.648488 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.648453    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-home\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.648716 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.648510    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-model-cache\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.648716 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.648566    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-dshm\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.648716 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.648644    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-tmp-dir\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.648716 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.648694    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlttv\" (UniqueName: \"kubernetes.io/projected/85645556-34a6-4e92-a724-2a87fe7d0216-kube-api-access-rlttv\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.648889 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.648758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85645556-34a6-4e92-a724-2a87fe7d0216-tls-certs\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.749781 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.749736    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85645556-34a6-4e92-a724-2a87fe7d0216-tls-certs\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.749781 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.749791    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-home\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.750036 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.749827    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-model-cache\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.750036 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.749845    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-dshm\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.750036 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.749874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-tmp-dir\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.750036 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.749905    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlttv\" (UniqueName: \"kubernetes.io/projected/85645556-34a6-4e92-a724-2a87fe7d0216-kube-api-access-rlttv\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.750337 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.750301    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-home\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.750337 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.750336    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-model-cache\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.750515 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.750337    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-tmp-dir\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.752434 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.752415    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-dshm\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.752635 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.752600    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85645556-34a6-4e92-a724-2a87fe7d0216-tls-certs\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.757760 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.757737    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlttv\" (UniqueName: \"kubernetes.io/projected/85645556-34a6-4e92-a724-2a87fe7d0216-kube-api-access-rlttv\") pod \"test-model-778341-kserve-7cf7649cc-bkf5j\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") " pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:56.887971 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:56.887936    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:23:57.162770 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:57.162744    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"]
Sep 11 15:23:57.165008 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:23:57.164978    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85645556_34a6_4e92_a724_2a87fe7d0216.slice/crio-485df445d81d57102e16f7f8b604d779ab907780919781e07edb68ff1ef1bebe WatchSource:0}: Error finding container 485df445d81d57102e16f7f8b604d779ab907780919781e07edb68ff1ef1bebe: Status 404 returned error can't find the container with id 485df445d81d57102e16f7f8b604d779ab907780919781e07edb68ff1ef1bebe
Sep 11 15:23:57.360302 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:57.360265    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j" event={"ID":"85645556-34a6-4e92-a724-2a87fe7d0216","Type":"ContainerStarted","Data":"942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31"}
Sep 11 15:23:57.360302 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:57.360307    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j" event={"ID":"85645556-34a6-4e92-a724-2a87fe7d0216","Type":"ContainerStarted","Data":"485df445d81d57102e16f7f8b604d779ab907780919781e07edb68ff1ef1bebe"}
Sep 11 15:23:57.379373 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:23:57.379321    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j" podStartSLOduration=1.379306747 podStartE2EDuration="1.379306747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:23:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:23:57.377462197 +0000 UTC m=+911.837179197" watchObservedRunningTime="2026-09-11 15:23:57.379306747 +0000 UTC m=+911.839023747"
Sep 11 15:24:06.889113 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:06.889072    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:24:06.889633 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:06.889134    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:24:06.904887 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:06.904857    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:24:07.426187 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:07.426154    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:24:12.334589 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:12.334547    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"]
Sep 11 15:24:12.335088 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:12.334892    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k" podUID="3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab" containerName="payload-pre-processing" containerID="cri-o://557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa" gracePeriod=30
Sep 11 15:24:12.621415 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:12.621386    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"
Sep 11 15:24:12.702360 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:12.702323    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t7kr\" (UniqueName: \"kubernetes.io/projected/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab-kube-api-access-7t7kr\") pod \"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab\" (UID: \"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab\") "
Sep 11 15:24:12.702543 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:12.702455    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab-plugins-config-volume\") pod \"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab\" (UID: \"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab\") "
Sep 11 15:24:12.702865 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:12.702835    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab" (UID: "3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:24:12.704903 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:12.704874    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab-kube-api-access-7t7kr" (OuterVolumeSpecName: "kube-api-access-7t7kr") pod "3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab" (UID: "3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab"). InnerVolumeSpecName "kube-api-access-7t7kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:24:12.803756 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:12.803714    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t7kr\" (UniqueName: \"kubernetes.io/projected/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab-kube-api-access-7t7kr\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:24:12.803756 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:12.803747    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab-plugins-config-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:24:13.449438 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:13.449402    2574 generic.go:356] "Generic (PLEG): container finished" podID="3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab" containerID="557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa" exitCode=0
Sep 11 15:24:13.449855 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:13.449450    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"
Sep 11 15:24:13.449855 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:13.449489    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k" event={"ID":"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab","Type":"ContainerDied","Data":"557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa"}
Sep 11 15:24:13.449855 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:13.449551    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k" event={"ID":"3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab","Type":"ContainerDied","Data":"c223b9d7fcace3c9c0fd3b84978859a9b910332cc9b2005ed09886c144f1390b"}
Sep 11 15:24:13.449855 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:13.449582    2574 scope.go:117] "RemoveContainer" containerID="557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa"
Sep 11 15:24:13.459977 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:13.459952    2574 scope.go:117] "RemoveContainer" containerID="557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa"
Sep 11 15:24:13.460378 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:24:13.460351    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa\": container with ID starting with 557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa not found: ID does not exist" containerID="557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa"
Sep 11 15:24:13.460452 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:13.460388    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa"} err="failed to get container status \"557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa\": rpc error: code = NotFound desc = could not find container \"557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa\": container with ID starting with 557cd7403ee3b9dd791ada87fd241ab5689d065cb4aaa03e0205392beab7a1aa not found: ID does not exist"
Sep 11 15:24:13.474840 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:13.474805    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"]
Sep 11 15:24:13.479264 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:13.479235    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-df3af038-77cb8bc5d-fjn4k"]
Sep 11 15:24:13.995379 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:13.995342    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab" path="/var/lib/kubelet/pods/3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab/volumes"
Sep 11 15:24:36.934591 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:36.934555    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"]
Sep 11 15:24:36.935205 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:36.935178    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab" containerName="payload-pre-processing"
Sep 11 15:24:36.935252 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:36.935208    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab" containerName="payload-pre-processing"
Sep 11 15:24:36.935357 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:36.935346    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cea2cc7-6ede-4eaa-a56e-3e7f618e1aab" containerName="payload-pre-processing"
Sep 11 15:24:36.939931 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:36.939910    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"
Sep 11 15:24:36.942363 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:36.942339    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-ca78ef\""
Sep 11 15:24:36.944367 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:36.944339    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwbsl\" (UniqueName: \"kubernetes.io/projected/f5094e1f-ea63-4233-bc64-dc92594748b2-kube-api-access-bwbsl\") pod \"payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d\" (UID: \"f5094e1f-ea63-4233-bc64-dc92594748b2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"
Sep 11 15:24:36.944508 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:36.944459    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5094e1f-ea63-4233-bc64-dc92594748b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d\" (UID: \"f5094e1f-ea63-4233-bc64-dc92594748b2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"
Sep 11 15:24:36.947124 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:36.947097    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"]
Sep 11 15:24:37.044918 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:37.044876    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwbsl\" (UniqueName: \"kubernetes.io/projected/f5094e1f-ea63-4233-bc64-dc92594748b2-kube-api-access-bwbsl\") pod \"payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d\" (UID: \"f5094e1f-ea63-4233-bc64-dc92594748b2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"
Sep 11 15:24:37.045122 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:37.044999    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5094e1f-ea63-4233-bc64-dc92594748b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d\" (UID: \"f5094e1f-ea63-4233-bc64-dc92594748b2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"
Sep 11 15:24:37.045743 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:37.045726    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5094e1f-ea63-4233-bc64-dc92594748b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d\" (UID: \"f5094e1f-ea63-4233-bc64-dc92594748b2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"
Sep 11 15:24:37.053705 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:37.053677    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwbsl\" (UniqueName: \"kubernetes.io/projected/f5094e1f-ea63-4233-bc64-dc92594748b2-kube-api-access-bwbsl\") pod \"payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d\" (UID: \"f5094e1f-ea63-4233-bc64-dc92594748b2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"
Sep 11 15:24:37.253203 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:37.253116    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"
Sep 11 15:24:37.525362 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:37.525334    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"]
Sep 11 15:24:37.529195 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:24:37.529160    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5094e1f_ea63_4233_bc64_dc92594748b2.slice/crio-d19dd516f15ffa717a23d432933571fb71250dcd0501491f0172b0e4196b76e3 WatchSource:0}: Error finding container d19dd516f15ffa717a23d432933571fb71250dcd0501491f0172b0e4196b76e3: Status 404 returned error can't find the container with id d19dd516f15ffa717a23d432933571fb71250dcd0501491f0172b0e4196b76e3
Sep 11 15:24:37.581014 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:37.580981    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d" event={"ID":"f5094e1f-ea63-4233-bc64-dc92594748b2","Type":"ContainerStarted","Data":"d19dd516f15ffa717a23d432933571fb71250dcd0501491f0172b0e4196b76e3"}
Sep 11 15:24:38.587804 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:38.587760    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d" event={"ID":"f5094e1f-ea63-4233-bc64-dc92594748b2","Type":"ContainerStarted","Data":"8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35"}
Sep 11 15:24:38.588299 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:38.587877    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"
Sep 11 15:24:38.605869 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:38.605813    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d" podStartSLOduration=2.605796426 podStartE2EDuration="2.605796426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:24:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:24:38.603948429 +0000 UTC m=+953.063665430" watchObservedRunningTime="2026-09-11 15:24:38.605796426 +0000 UTC m=+953.065513425"
Sep 11 15:24:49.595366 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:24:49.595335    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"
Sep 11 15:25:28.417975 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.417939    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"]
Sep 11 15:25:28.418502 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.418176    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d" podUID="f5094e1f-ea63-4233-bc64-dc92594748b2" containerName="payload-pre-processing" containerID="cri-o://8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35" gracePeriod=30
Sep 11 15:25:28.681104 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.681052    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"
Sep 11 15:25:28.765492 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.765397    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5094e1f-ea63-4233-bc64-dc92594748b2-plugins-config-volume\") pod \"f5094e1f-ea63-4233-bc64-dc92594748b2\" (UID: \"f5094e1f-ea63-4233-bc64-dc92594748b2\") "
Sep 11 15:25:28.765492 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.765486    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwbsl\" (UniqueName: \"kubernetes.io/projected/f5094e1f-ea63-4233-bc64-dc92594748b2-kube-api-access-bwbsl\") pod \"f5094e1f-ea63-4233-bc64-dc92594748b2\" (UID: \"f5094e1f-ea63-4233-bc64-dc92594748b2\") "
Sep 11 15:25:28.765957 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.765923    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5094e1f-ea63-4233-bc64-dc92594748b2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5094e1f-ea63-4233-bc64-dc92594748b2" (UID: "f5094e1f-ea63-4233-bc64-dc92594748b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:25:28.768426 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.768397    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5094e1f-ea63-4233-bc64-dc92594748b2-kube-api-access-bwbsl" (OuterVolumeSpecName: "kube-api-access-bwbsl") pod "f5094e1f-ea63-4233-bc64-dc92594748b2" (UID: "f5094e1f-ea63-4233-bc64-dc92594748b2"). InnerVolumeSpecName "kube-api-access-bwbsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:25:28.861141 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.861107    2574 generic.go:356] "Generic (PLEG): container finished" podID="f5094e1f-ea63-4233-bc64-dc92594748b2" containerID="8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35" exitCode=0
Sep 11 15:25:28.861331 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.861158    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"
Sep 11 15:25:28.861331 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.861181    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d" event={"ID":"f5094e1f-ea63-4233-bc64-dc92594748b2","Type":"ContainerDied","Data":"8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35"}
Sep 11 15:25:28.861331 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.861242    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d" event={"ID":"f5094e1f-ea63-4233-bc64-dc92594748b2","Type":"ContainerDied","Data":"d19dd516f15ffa717a23d432933571fb71250dcd0501491f0172b0e4196b76e3"}
Sep 11 15:25:28.861331 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.861270    2574 scope.go:117] "RemoveContainer" containerID="8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35"
Sep 11 15:25:28.866883 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.866854    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5094e1f-ea63-4233-bc64-dc92594748b2-plugins-config-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:25:28.867022 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.866885    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwbsl\" (UniqueName: \"kubernetes.io/projected/f5094e1f-ea63-4233-bc64-dc92594748b2-kube-api-access-bwbsl\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:25:28.874865 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.874719    2574 scope.go:117] "RemoveContainer" containerID="8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35"
Sep 11 15:25:28.875102 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:25:28.875084    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35\": container with ID starting with 8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35 not found: ID does not exist" containerID="8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35"
Sep 11 15:25:28.875152 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.875112    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35"} err="failed to get container status \"8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35\": rpc error: code = NotFound desc = could not find container \"8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35\": container with ID starting with 8c9bea6aee4649b1a636c59d58518521cac951d8ae6f547d734054ca7c01be35 not found: ID does not exist"
Sep 11 15:25:28.886145 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.886121    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"]
Sep 11 15:25:28.889569 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:28.889537    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ca78ef-75674ffdb-55k6d"]
Sep 11 15:25:29.995032 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:29.994986    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5094e1f-ea63-4233-bc64-dc92594748b2" path="/var/lib/kubelet/pods/f5094e1f-ea63-4233-bc64-dc92594748b2/volumes"
Sep 11 15:25:54.398422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.398392    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"]
Sep 11 15:25:54.398925 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.398855    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5094e1f-ea63-4233-bc64-dc92594748b2" containerName="payload-pre-processing"
Sep 11 15:25:54.398925 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.398868    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5094e1f-ea63-4233-bc64-dc92594748b2" containerName="payload-pre-processing"
Sep 11 15:25:54.399001 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.398945    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5094e1f-ea63-4233-bc64-dc92594748b2" containerName="payload-pre-processing"
Sep 11 15:25:54.403190 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.403161    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.405873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.405853    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0dd91403-serving-cert\""
Sep 11 15:25:54.408735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.408547    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"]
Sep 11 15:25:54.518816 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.518780    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-maas-api-tls\") pod \"maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.519000 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.518877    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdvqg\" (UniqueName: \"kubernetes.io/projected/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-kube-api-access-xdvqg\") pod \"maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.519000 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.518904    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-metrics-certs\") pod \"maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.519000 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.518946    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-openshift-service-ca\") pod \"maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.619829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.619794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-maas-api-tls\") pod \"maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.619989 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.619897    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdvqg\" (UniqueName: \"kubernetes.io/projected/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-kube-api-access-xdvqg\") pod \"maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.619989 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.619917    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-metrics-certs\") pod \"maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.619989 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.619933    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-openshift-service-ca\") pod \"maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.620525 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.620503    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-openshift-service-ca\") pod \"maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.622468 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.622442    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-metrics-certs\") pod \"maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.622567 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.622449    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-maas-api-tls\") pod \"maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.628141 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.628114    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdvqg\" (UniqueName: \"kubernetes.io/projected/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-kube-api-access-xdvqg\") pod \"maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:54.716813 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:54.716728    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:55.019800 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:55.019776    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"]
Sep 11 15:25:55.021808 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:25:55.021778    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e8274f_1dc8_44f4_8cad_ec0e96c00514.slice/crio-fda2bc02070ba4bd73d433337be0deafe670795bcf51c753f320ad2ef868f986 WatchSource:0}: Error finding container fda2bc02070ba4bd73d433337be0deafe670795bcf51c753f320ad2ef868f986: Status 404 returned error can't find the container with id fda2bc02070ba4bd73d433337be0deafe670795bcf51c753f320ad2ef868f986
Sep 11 15:25:55.023436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:55.023415    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 15:25:56.003944 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:56.003907    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l" event={"ID":"c9e8274f-1dc8-44f4-8cad-ec0e96c00514","Type":"ContainerStarted","Data":"9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337"}
Sep 11 15:25:56.004395 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:56.003956    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l" event={"ID":"c9e8274f-1dc8-44f4-8cad-ec0e96c00514","Type":"ContainerStarted","Data":"fda2bc02070ba4bd73d433337be0deafe670795bcf51c753f320ad2ef868f986"}
Sep 11 15:25:56.004395 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:56.003982    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:25:56.024701 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:25:56.023843    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l" podStartSLOduration=1.624834635 podStartE2EDuration="2.023822975s" totalImagesPullingTime="398.98834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:25:56.021088068 +0000 UTC m=+1030.480805068" watchObservedRunningTime="2026-09-11 15:25:56.023822975 +0000 UTC m=+1030.483539979"
Sep 11 15:26:02.014797 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:02.014766    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:26:14.380381 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:14.380335    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"]
Sep 11 15:26:28.934424 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:28.934378    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"]
Sep 11 15:26:28.935015 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:28.934667    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6" podUID="2128f383-ce3f-4644-92a2-c8aa7bc4ecc0" containerName="maas-api" containerID="cri-o://e45028524168825920a3270925a3437ea1dbe64d0e3f13df14e3322e06f371d6" gracePeriod=30
Sep 11 15:26:29.184037 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.184009    2574 generic.go:356] "Generic (PLEG): container finished" podID="2128f383-ce3f-4644-92a2-c8aa7bc4ecc0" containerID="e45028524168825920a3270925a3437ea1dbe64d0e3f13df14e3322e06f371d6" exitCode=0
Sep 11 15:26:29.184153 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.184059    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6" event={"ID":"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0","Type":"ContainerDied","Data":"e45028524168825920a3270925a3437ea1dbe64d0e3f13df14e3322e06f371d6"}
Sep 11 15:26:29.205072 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.205046    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:26:29.283261 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.283227    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-maas-api-tls\") pod \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") "
Sep 11 15:26:29.283443 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.283340    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-openshift-service-ca\") pod \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") "
Sep 11 15:26:29.283443 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.283388    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-metrics-certs\") pod \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") "
Sep 11 15:26:29.283443 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.283410    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpn4w\" (UniqueName: \"kubernetes.io/projected/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-kube-api-access-tpn4w\") pod \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\" (UID: \"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0\") "
Sep 11 15:26:29.283806 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.283771    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2128f383-ce3f-4644-92a2-c8aa7bc4ecc0" (UID: "2128f383-ce3f-4644-92a2-c8aa7bc4ecc0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:26:29.286279 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.286252    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2128f383-ce3f-4644-92a2-c8aa7bc4ecc0" (UID: "2128f383-ce3f-4644-92a2-c8aa7bc4ecc0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:26:29.286279 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.286268    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-kube-api-access-tpn4w" (OuterVolumeSpecName: "kube-api-access-tpn4w") pod "2128f383-ce3f-4644-92a2-c8aa7bc4ecc0" (UID: "2128f383-ce3f-4644-92a2-c8aa7bc4ecc0"). InnerVolumeSpecName "kube-api-access-tpn4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:26:29.286420 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.286280    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2128f383-ce3f-4644-92a2-c8aa7bc4ecc0" (UID: "2128f383-ce3f-4644-92a2-c8aa7bc4ecc0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:26:29.384760 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.384712    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-openshift-service-ca\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:29.384760 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.384760    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:29.384966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.384775    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpn4w\" (UniqueName: \"kubernetes.io/projected/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-kube-api-access-tpn4w\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:29.384966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.384788    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0-maas-api-tls\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:29.400753 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.400718    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j" podUID="85645556-34a6-4e92-a724-2a87fe7d0216" containerName="main" containerID="cri-o://942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31" gracePeriod=45
Sep 11 15:26:29.655049 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.655025    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:26:29.688532 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.688501    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-tmp-dir\") pod \"85645556-34a6-4e92-a724-2a87fe7d0216\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") "
Sep 11 15:26:29.688714 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.688540    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-model-cache\") pod \"85645556-34a6-4e92-a724-2a87fe7d0216\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") "
Sep 11 15:26:29.688714 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.688654    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-dshm\") pod \"85645556-34a6-4e92-a724-2a87fe7d0216\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") "
Sep 11 15:26:29.688714 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.688695    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlttv\" (UniqueName: \"kubernetes.io/projected/85645556-34a6-4e92-a724-2a87fe7d0216-kube-api-access-rlttv\") pod \"85645556-34a6-4e92-a724-2a87fe7d0216\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") "
Sep 11 15:26:29.688888 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.688738    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-home\") pod \"85645556-34a6-4e92-a724-2a87fe7d0216\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") "
Sep 11 15:26:29.688888 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.688777    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85645556-34a6-4e92-a724-2a87fe7d0216-tls-certs\") pod \"85645556-34a6-4e92-a724-2a87fe7d0216\" (UID: \"85645556-34a6-4e92-a724-2a87fe7d0216\") "
Sep 11 15:26:29.688888 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.688868    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "85645556-34a6-4e92-a724-2a87fe7d0216" (UID: "85645556-34a6-4e92-a724-2a87fe7d0216"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:29.689034 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.688884    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-model-cache" (OuterVolumeSpecName: "model-cache") pod "85645556-34a6-4e92-a724-2a87fe7d0216" (UID: "85645556-34a6-4e92-a724-2a87fe7d0216"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:29.689094 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.689071    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-home" (OuterVolumeSpecName: "home") pod "85645556-34a6-4e92-a724-2a87fe7d0216" (UID: "85645556-34a6-4e92-a724-2a87fe7d0216"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:29.689238 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.689217    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-model-cache\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:29.689238 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.689241    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-home\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:29.689451 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.689254    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-tmp-dir\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:29.691123 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.691089    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85645556-34a6-4e92-a724-2a87fe7d0216-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "85645556-34a6-4e92-a724-2a87fe7d0216" (UID: "85645556-34a6-4e92-a724-2a87fe7d0216"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:26:29.691217 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.691152    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85645556-34a6-4e92-a724-2a87fe7d0216-kube-api-access-rlttv" (OuterVolumeSpecName: "kube-api-access-rlttv") pod "85645556-34a6-4e92-a724-2a87fe7d0216" (UID: "85645556-34a6-4e92-a724-2a87fe7d0216"). InnerVolumeSpecName "kube-api-access-rlttv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:26:29.691261 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.691226    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-dshm" (OuterVolumeSpecName: "dshm") pod "85645556-34a6-4e92-a724-2a87fe7d0216" (UID: "85645556-34a6-4e92-a724-2a87fe7d0216"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:29.789837 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.789743    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85645556-34a6-4e92-a724-2a87fe7d0216-tls-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:29.789837 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.789775    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85645556-34a6-4e92-a724-2a87fe7d0216-dshm\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:29.789837 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:29.789789    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlttv\" (UniqueName: \"kubernetes.io/projected/85645556-34a6-4e92-a724-2a87fe7d0216-kube-api-access-rlttv\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:30.191078 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.191044    2574 generic.go:356] "Generic (PLEG): container finished" podID="85645556-34a6-4e92-a724-2a87fe7d0216" containerID="942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31" exitCode=0
Sep 11 15:26:30.191078 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.191084    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"
Sep 11 15:26:30.191656 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.191137    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j" event={"ID":"85645556-34a6-4e92-a724-2a87fe7d0216","Type":"ContainerDied","Data":"942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31"}
Sep 11 15:26:30.191656 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.191185    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j" event={"ID":"85645556-34a6-4e92-a724-2a87fe7d0216","Type":"ContainerDied","Data":"485df445d81d57102e16f7f8b604d779ab907780919781e07edb68ff1ef1bebe"}
Sep 11 15:26:30.191656 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.191206    2574 scope.go:117] "RemoveContainer" containerID="942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31"
Sep 11 15:26:30.192822 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.192801    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"
Sep 11 15:26:30.192930 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.192804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6" event={"ID":"2128f383-ce3f-4644-92a2-c8aa7bc4ecc0","Type":"ContainerDied","Data":"e11292b079b9276304953a932adf8ff3587ccf503950bd315f78e0312dc834b0"}
Sep 11 15:26:30.201753 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.201737    2574 scope.go:117] "RemoveContainer" containerID="942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31"
Sep 11 15:26:30.202060 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:26:30.202032    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31\": container with ID starting with 942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31 not found: ID does not exist" containerID="942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31"
Sep 11 15:26:30.202175 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.202070    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31"} err="failed to get container status \"942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31\": rpc error: code = NotFound desc = could not find container \"942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31\": container with ID starting with 942c027fdb4f86ad6e9dc41c87001cdd5cc2d3b76925025d890036abaabb4d31 not found: ID does not exist"
Sep 11 15:26:30.202175 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.202096    2574 scope.go:117] "RemoveContainer" containerID="e45028524168825920a3270925a3437ea1dbe64d0e3f13df14e3322e06f371d6"
Sep 11 15:26:30.210170 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.210147    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"]
Sep 11 15:26:30.216687 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.216665    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-778341-58976b547d-j28z6"]
Sep 11 15:26:30.227663 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.227641    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"]
Sep 11 15:26:30.231017 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:30.230996    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-778341/test-model-778341-kserve-7cf7649cc-bkf5j"]
Sep 11 15:26:31.995299 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:31.995264    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2128f383-ce3f-4644-92a2-c8aa7bc4ecc0" path="/var/lib/kubelet/pods/2128f383-ce3f-4644-92a2-c8aa7bc4ecc0/volumes"
Sep 11 15:26:31.995795 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:31.995677    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85645556-34a6-4e92-a724-2a87fe7d0216" path="/var/lib/kubelet/pods/85645556-34a6-4e92-a724-2a87fe7d0216/volumes"
Sep 11 15:26:35.694230 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:35.694176    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"]
Sep 11 15:26:35.694757 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:35.694455    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l" podUID="c9e8274f-1dc8-44f4-8cad-ec0e96c00514" containerName="maas-api" containerID="cri-o://9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337" gracePeriod=30
Sep 11 15:26:35.962564 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:35.962532    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:26:36.053722 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.053687    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-metrics-certs\") pod \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") "
Sep 11 15:26:36.053722 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.053733    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-maas-api-tls\") pod \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") "
Sep 11 15:26:36.053979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.053768    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdvqg\" (UniqueName: \"kubernetes.io/projected/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-kube-api-access-xdvqg\") pod \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") "
Sep 11 15:26:36.053979 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.053814    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-openshift-service-ca\") pod \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\" (UID: \"c9e8274f-1dc8-44f4-8cad-ec0e96c00514\") "
Sep 11 15:26:36.054188 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.054159    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9e8274f-1dc8-44f4-8cad-ec0e96c00514" (UID: "c9e8274f-1dc8-44f4-8cad-ec0e96c00514"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:26:36.056406 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.056384    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9e8274f-1dc8-44f4-8cad-ec0e96c00514" (UID: "c9e8274f-1dc8-44f4-8cad-ec0e96c00514"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:26:36.056601 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.056579    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c9e8274f-1dc8-44f4-8cad-ec0e96c00514" (UID: "c9e8274f-1dc8-44f4-8cad-ec0e96c00514"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:26:36.056601 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.056586    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-kube-api-access-xdvqg" (OuterVolumeSpecName: "kube-api-access-xdvqg") pod "c9e8274f-1dc8-44f4-8cad-ec0e96c00514" (UID: "c9e8274f-1dc8-44f4-8cad-ec0e96c00514"). InnerVolumeSpecName "kube-api-access-xdvqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:26:36.155037 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.155000    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:36.155037 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.155030    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-maas-api-tls\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:36.155037 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.155039    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdvqg\" (UniqueName: \"kubernetes.io/projected/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-kube-api-access-xdvqg\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:36.155037 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.155048    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9e8274f-1dc8-44f4-8cad-ec0e96c00514-openshift-service-ca\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:36.228568 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.228463    2574 generic.go:356] "Generic (PLEG): container finished" podID="c9e8274f-1dc8-44f4-8cad-ec0e96c00514" containerID="9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337" exitCode=0
Sep 11 15:26:36.228568 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.228515    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"
Sep 11 15:26:36.228817 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.228520    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l" event={"ID":"c9e8274f-1dc8-44f4-8cad-ec0e96c00514","Type":"ContainerDied","Data":"9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337"}
Sep 11 15:26:36.228817 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.228682    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l" event={"ID":"c9e8274f-1dc8-44f4-8cad-ec0e96c00514","Type":"ContainerDied","Data":"fda2bc02070ba4bd73d433337be0deafe670795bcf51c753f320ad2ef868f986"}
Sep 11 15:26:36.228817 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.228713    2574 scope.go:117] "RemoveContainer" containerID="9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337"
Sep 11 15:26:36.245307 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.245269    2574 scope.go:117] "RemoveContainer" containerID="9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337"
Sep 11 15:26:36.246987 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:26:36.245738    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337\": container with ID starting with 9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337 not found: ID does not exist" containerID="9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337"
Sep 11 15:26:36.246987 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.245808    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337"} err="failed to get container status \"9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337\": rpc error: code = NotFound desc = could not find container \"9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337\": container with ID starting with 9f859c1d786214c0ce49cf5e57f32418293cd1787140351eb22ba43d03dc1337 not found: ID does not exist"
Sep 11 15:26:36.261533 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.261502    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"]
Sep 11 15:26:36.264673 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.264647    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0dd91403-5d6ddfb667-sph8l"]
Sep 11 15:26:36.430103 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.430063    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"]
Sep 11 15:26:36.430359 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:36.430330    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy" containerID="cri-o://01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed" gracePeriod=30
Sep 11 15:26:37.994765 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:37.994690    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9e8274f-1dc8-44f4-8cad-ec0e96c00514" path="/var/lib/kubelet/pods/c9e8274f-1dc8-44f4-8cad-ec0e96c00514/volumes"
Sep 11 15:26:41.688852 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.688828    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:26:41.807733 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.807602    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-envoy\") pod \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") "
Sep 11 15:26:41.807733 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.807697    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-podinfo\") pod \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") "
Sep 11 15:26:41.807966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.807738    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6b28\" (UniqueName: \"kubernetes.io/projected/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-kube-api-access-f6b28\") pod \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") "
Sep 11 15:26:41.807966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.807791    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-token\") pod \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") "
Sep 11 15:26:41.807966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.807811    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-credential-socket\") pod \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") "
Sep 11 15:26:41.807966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.807831    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-data\") pod \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") "
Sep 11 15:26:41.807966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.807868    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-workload-certs\") pod \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") "
Sep 11 15:26:41.807966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.807920    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-workload-socket\") pod \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") "
Sep 11 15:26:41.807966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.807960    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istiod-ca-cert\") pod \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\" (UID: \"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96\") "
Sep 11 15:26:41.808325 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.808216    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" (UID: "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:41.808325 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.808224    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-data" (OuterVolumeSpecName: "istio-data") pod "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" (UID: "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:41.808325 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.808244    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" (UID: "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:41.808678 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.808435    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" (UID: "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:41.808678 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.808500    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" (UID: "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:26:41.810085 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.810061    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" (UID: "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 15:26:41.810327 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.810301    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-token" (OuterVolumeSpecName: "istio-token") pod "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" (UID: "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:26:41.810514 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.810499    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" (UID: "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:41.810595 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.810574    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-kube-api-access-f6b28" (OuterVolumeSpecName: "kube-api-access-f6b28") pod "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" (UID: "249f71f1-dc73-45e7-ac3f-3e65fdcd1c96"). InnerVolumeSpecName "kube-api-access-f6b28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:26:41.908768 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.908729    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-token\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:41.908768 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.908761    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-credential-socket\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:41.908768 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.908771    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-data\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:41.908768 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.908779    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-workload-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:41.909048 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.908787    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-workload-socket\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:41.909048 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.908795    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istiod-ca-cert\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:41.909048 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.908803    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-envoy\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:41.909048 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.908810    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-istio-podinfo\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:41.909048 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:41.908818    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6b28\" (UniqueName: \"kubernetes.io/projected/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96-kube-api-access-f6b28\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:42.262569 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:42.262536    2574 generic.go:356] "Generic (PLEG): container finished" podID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerID="01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed" exitCode=0
Sep 11 15:26:42.262569 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:42.262574    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" event={"ID":"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96","Type":"ContainerDied","Data":"01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed"}
Sep 11 15:26:42.262850 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:42.262634    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"
Sep 11 15:26:42.262850 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:42.262644    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r" event={"ID":"249f71f1-dc73-45e7-ac3f-3e65fdcd1c96","Type":"ContainerDied","Data":"99f908450ecf469310ef3794e928fdb6284ddaee4093d14f4a735db2279a67b4"}
Sep 11 15:26:42.262850 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:42.262666    2574 scope.go:117] "RemoveContainer" containerID="01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed"
Sep 11 15:26:42.271598 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:42.271577    2574 scope.go:117] "RemoveContainer" containerID="ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e"
Sep 11 15:26:42.280219 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:42.280110    2574 scope.go:117] "RemoveContainer" containerID="01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed"
Sep 11 15:26:42.280298 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:42.280276    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"]
Sep 11 15:26:42.280444 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:26:42.280422    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed\": container with ID starting with 01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed not found: ID does not exist" containerID="01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed"
Sep 11 15:26:42.280484 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:42.280452    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed"} err="failed to get container status \"01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed\": rpc error: code = NotFound desc = could not find container \"01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed\": container with ID starting with 01362ba64755878b70c9fd70293e3211476c6cf1d67ee8ef7fa868705f9167ed not found: ID does not exist"
Sep 11 15:26:42.280484 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:42.280469    2574 scope.go:117] "RemoveContainer" containerID="ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e"
Sep 11 15:26:42.280717 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:26:42.280702    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e\": container with ID starting with ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e not found: ID does not exist" containerID="ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e"
Sep 11 15:26:42.280761 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:42.280719    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e"} err="failed to get container status \"ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e\": rpc error: code = NotFound desc = could not find container \"ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e\": container with ID starting with ac0a7f1e72c194ef45a08bf1987da3e14e0da558f237ff9050727063f083b88e not found: ID does not exist"
Sep 11 15:26:42.284039 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:42.284017    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-778341-openshift-default-5c87cb9bbb-rpp4r"]
Sep 11 15:26:43.994497 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:43.994435    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" path="/var/lib/kubelet/pods/249f71f1-dc73-45e7-ac3f-3e65fdcd1c96/volumes"
Sep 11 15:26:54.226099 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:54.226050    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"]
Sep 11 15:26:54.227765 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:54.227509    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" podUID="f16852ae-5793-486f-9f29-915f964b146c" containerName="istio-proxy" containerID="cri-o://35bf9e9a1f6c01ae1f69815cb687f1aa1e2f15a6416db83008b01c902bd9693f" gracePeriod=30
Sep 11 15:26:59.203128 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.203095    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"]
Sep 11 15:26:59.204236 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204206    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy"
Sep 11 15:26:59.204236 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204236    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy"
Sep 11 15:26:59.204436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204256    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9e8274f-1dc8-44f4-8cad-ec0e96c00514" containerName="maas-api"
Sep 11 15:26:59.204436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204261    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9e8274f-1dc8-44f4-8cad-ec0e96c00514" containerName="maas-api"
Sep 11 15:26:59.204436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204274    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85645556-34a6-4e92-a724-2a87fe7d0216" containerName="main"
Sep 11 15:26:59.204436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204281    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="85645556-34a6-4e92-a724-2a87fe7d0216" containerName="main"
Sep 11 15:26:59.204436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204300    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2128f383-ce3f-4644-92a2-c8aa7bc4ecc0" containerName="maas-api"
Sep 11 15:26:59.204436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204308    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2128f383-ce3f-4644-92a2-c8aa7bc4ecc0" containerName="maas-api"
Sep 11 15:26:59.204436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204381    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="85645556-34a6-4e92-a724-2a87fe7d0216" containerName="main"
Sep 11 15:26:59.204436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204389    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy"
Sep 11 15:26:59.204436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204395    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9e8274f-1dc8-44f4-8cad-ec0e96c00514" containerName="maas-api"
Sep 11 15:26:59.204436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204402    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy"
Sep 11 15:26:59.204436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.204407    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2128f383-ce3f-4644-92a2-c8aa7bc4ecc0" containerName="maas-api"
Sep 11 15:26:59.207537 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.207519    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.209959 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.209932    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-397e40-serving-cert\""
Sep 11 15:26:59.216575 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.216501    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"]
Sep 11 15:26:59.268333 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.268303    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b14245b6-9e5d-489f-8a0f-0bcf5224523f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.268489 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.268398    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.268489 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.268437    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2fwf\" (UniqueName: \"kubernetes.io/projected/b14245b6-9e5d-489f-8a0f-0bcf5224523f-kube-api-access-j2fwf\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.268594 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.268525    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.347532 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.347503    2574 generic.go:356] "Generic (PLEG): container finished" podID="f16852ae-5793-486f-9f29-915f964b146c" containerID="35bf9e9a1f6c01ae1f69815cb687f1aa1e2f15a6416db83008b01c902bd9693f" exitCode=0
Sep 11 15:26:59.347684 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.347570    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" event={"ID":"f16852ae-5793-486f-9f29-915f964b146c","Type":"ContainerDied","Data":"35bf9e9a1f6c01ae1f69815cb687f1aa1e2f15a6416db83008b01c902bd9693f"}
Sep 11 15:26:59.347684 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.347660    2574 scope.go:117] "RemoveContainer" containerID="fbaa68f26a433642c169679167db64222f6ec04314c195c7fb95ff546a3ba3c5"
Sep 11 15:26:59.369608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.369567    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2fwf\" (UniqueName: \"kubernetes.io/projected/b14245b6-9e5d-489f-8a0f-0bcf5224523f-kube-api-access-j2fwf\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.369783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.369676    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.369783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.369707    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b14245b6-9e5d-489f-8a0f-0bcf5224523f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.369783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.369760    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.369925 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:26:59.369817    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-serving-cert: secret "maas-api-e2e-shared-a-w3-397e40-serving-cert" not found
Sep 11 15:26:59.369925 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:26:59.369893    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-maas-api-tls podName:b14245b6-9e5d-489f-8a0f-0bcf5224523f nodeName:}" failed. No retries permitted until 2026-09-11 15:26:59.869873232 +0000 UTC m=+1094.329590209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-maas-api-tls") pod "maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft" (UID: "b14245b6-9e5d-489f-8a0f-0bcf5224523f") : secret "maas-api-e2e-shared-a-w3-397e40-serving-cert" not found
Sep 11 15:26:59.370433 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.370413    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b14245b6-9e5d-489f-8a0f-0bcf5224523f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.372755 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.372733    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.380676 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.380655    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2fwf\" (UniqueName: \"kubernetes.io/projected/b14245b6-9e5d-489f-8a0f-0bcf5224523f-kube-api-access-j2fwf\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.479442 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.479417    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:26:59.571639 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.571579    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-workload-certs\") pod \"f16852ae-5793-486f-9f29-915f964b146c\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") "
Sep 11 15:26:59.571819 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.571650    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wj6s\" (UniqueName: \"kubernetes.io/projected/f16852ae-5793-486f-9f29-915f964b146c-kube-api-access-4wj6s\") pod \"f16852ae-5793-486f-9f29-915f964b146c\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") "
Sep 11 15:26:59.571819 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.571678    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f16852ae-5793-486f-9f29-915f964b146c-istiod-ca-cert\") pod \"f16852ae-5793-486f-9f29-915f964b146c\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") "
Sep 11 15:26:59.571819 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.571705    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-istio-envoy\") pod \"f16852ae-5793-486f-9f29-915f964b146c\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") "
Sep 11 15:26:59.571819 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.571726    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f16852ae-5793-486f-9f29-915f964b146c-istio-podinfo\") pod \"f16852ae-5793-486f-9f29-915f964b146c\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") "
Sep 11 15:26:59.571819 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.571743    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f16852ae-5793-486f-9f29-915f964b146c-istio-token\") pod \"f16852ae-5793-486f-9f29-915f964b146c\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") "
Sep 11 15:26:59.571819 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.571768    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-workload-socket\") pod \"f16852ae-5793-486f-9f29-915f964b146c\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") "
Sep 11 15:26:59.571819 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.571802    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-istio-data\") pod \"f16852ae-5793-486f-9f29-915f964b146c\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") "
Sep 11 15:26:59.572314 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.571849    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-credential-socket\") pod \"f16852ae-5793-486f-9f29-915f964b146c\" (UID: \"f16852ae-5793-486f-9f29-915f964b146c\") "
Sep 11 15:26:59.572314 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.571948    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f16852ae-5793-486f-9f29-915f964b146c" (UID: "f16852ae-5793-486f-9f29-915f964b146c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:59.572314 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.572133    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f16852ae-5793-486f-9f29-915f964b146c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f16852ae-5793-486f-9f29-915f964b146c" (UID: "f16852ae-5793-486f-9f29-915f964b146c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:26:59.572314 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.572140    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f16852ae-5793-486f-9f29-915f964b146c" (UID: "f16852ae-5793-486f-9f29-915f964b146c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:59.573017 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.572255    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f16852ae-5793-486f-9f29-915f964b146c-istiod-ca-cert\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:59.573017 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.572337    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-credential-socket\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:59.573017 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.572351    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-workload-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:59.573017 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.572372    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-istio-data" (OuterVolumeSpecName: "istio-data") pod "f16852ae-5793-486f-9f29-915f964b146c" (UID: "f16852ae-5793-486f-9f29-915f964b146c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:59.573017 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.572438    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f16852ae-5793-486f-9f29-915f964b146c" (UID: "f16852ae-5793-486f-9f29-915f964b146c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:59.574153 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.574131    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f16852ae-5793-486f-9f29-915f964b146c" (UID: "f16852ae-5793-486f-9f29-915f964b146c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:26:59.574259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.574246    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f16852ae-5793-486f-9f29-915f964b146c-istio-token" (OuterVolumeSpecName: "istio-token") pod "f16852ae-5793-486f-9f29-915f964b146c" (UID: "f16852ae-5793-486f-9f29-915f964b146c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:26:59.574562 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.574536    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f16852ae-5793-486f-9f29-915f964b146c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f16852ae-5793-486f-9f29-915f964b146c" (UID: "f16852ae-5793-486f-9f29-915f964b146c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 15:26:59.574562 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.574546    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f16852ae-5793-486f-9f29-915f964b146c-kube-api-access-4wj6s" (OuterVolumeSpecName: "kube-api-access-4wj6s") pod "f16852ae-5793-486f-9f29-915f964b146c" (UID: "f16852ae-5793-486f-9f29-915f964b146c"). InnerVolumeSpecName "kube-api-access-4wj6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:26:59.673344 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.673306    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-istio-data\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:59.673344 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.673335    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wj6s\" (UniqueName: \"kubernetes.io/projected/f16852ae-5793-486f-9f29-915f964b146c-kube-api-access-4wj6s\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:59.673344 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.673347    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-istio-envoy\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:59.673344 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.673355    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f16852ae-5793-486f-9f29-915f964b146c-istio-podinfo\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:59.673604 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.673362    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f16852ae-5793-486f-9f29-915f964b146c-istio-token\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:59.673604 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.673370    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16852ae-5793-486f-9f29-915f964b146c-workload-socket\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:26:59.875301 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:26:59.875266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:26:59.875476 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:26:59.875429    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-serving-cert: secret "maas-api-e2e-shared-a-w3-397e40-serving-cert" not found
Sep 11 15:26:59.875518 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:26:59.875510    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-maas-api-tls podName:b14245b6-9e5d-489f-8a0f-0bcf5224523f nodeName:}" failed. No retries permitted until 2026-09-11 15:27:00.875494329 +0000 UTC m=+1095.335211310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-maas-api-tls") pod "maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft" (UID: "b14245b6-9e5d-489f-8a0f-0bcf5224523f") : secret "maas-api-e2e-shared-a-w3-397e40-serving-cert" not found
Sep 11 15:27:00.353900 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:00.353866    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"
Sep 11 15:27:00.353900 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:00.353882    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg" event={"ID":"f16852ae-5793-486f-9f29-915f964b146c","Type":"ContainerDied","Data":"1a3701d894bc0f2ae9e71eb706eb7a7310168f405124c7f135e0dc9fa809a50c"}
Sep 11 15:27:00.354333 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:00.353941    2574 scope.go:117] "RemoveContainer" containerID="35bf9e9a1f6c01ae1f69815cb687f1aa1e2f15a6416db83008b01c902bd9693f"
Sep 11 15:27:00.371517 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:00.371494    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"]
Sep 11 15:27:00.375071 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:00.375047    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-9f08bd-openshift-default-6c797789b6-k4mkg"]
Sep 11 15:27:00.884867 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:00.884833    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:27:00.887349 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:00.887328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:27:01.021130 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.021089    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:27:01.295966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.295939    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"]
Sep 11 15:27:01.298092 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:27:01.298066    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14245b6_9e5d_489f_8a0f_0bcf5224523f.slice/crio-1b408f354e2a6f5d2920e1c4a3ef1de52dd7053754fd0968706612414f806b7a WatchSource:0}: Error finding container 1b408f354e2a6f5d2920e1c4a3ef1de52dd7053754fd0968706612414f806b7a: Status 404 returned error can't find the container with id 1b408f354e2a6f5d2920e1c4a3ef1de52dd7053754fd0968706612414f806b7a
Sep 11 15:27:01.361203 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.361167    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft" event={"ID":"b14245b6-9e5d-489f-8a0f-0bcf5224523f","Type":"ContainerStarted","Data":"1b408f354e2a6f5d2920e1c4a3ef1de52dd7053754fd0968706612414f806b7a"}
Sep 11 15:27:01.792529 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.792494    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"]
Sep 11 15:27:01.793123 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.793098    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy"
Sep 11 15:27:01.793123 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.793122    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="249f71f1-dc73-45e7-ac3f-3e65fdcd1c96" containerName="istio-proxy"
Sep 11 15:27:01.793266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.793137    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16852ae-5793-486f-9f29-915f964b146c" containerName="istio-proxy"
Sep 11 15:27:01.793266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.793145    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16852ae-5793-486f-9f29-915f964b146c" containerName="istio-proxy"
Sep 11 15:27:01.793266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.793154    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16852ae-5793-486f-9f29-915f964b146c" containerName="istio-proxy"
Sep 11 15:27:01.793266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.793161    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16852ae-5793-486f-9f29-915f964b146c" containerName="istio-proxy"
Sep 11 15:27:01.793266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.793243    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16852ae-5793-486f-9f29-915f964b146c" containerName="istio-proxy"
Sep 11 15:27:01.793266 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.793254    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16852ae-5793-486f-9f29-915f964b146c" containerName="istio-proxy"
Sep 11 15:27:01.796484 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.796464    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:01.799523 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.799309    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-4a348b-serving-cert\""
Sep 11 15:27:01.808289 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.807543    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"]
Sep 11 15:27:01.894909 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.894867    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:01.894909 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.894910    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n2hr\" (UniqueName: \"kubernetes.io/projected/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-kube-api-access-6n2hr\") pod \"maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:01.895140 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.894984    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:01.895140 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.895004    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:01.995548 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.995461    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n2hr\" (UniqueName: \"kubernetes.io/projected/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-kube-api-access-6n2hr\") pod \"maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:01.995783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.995548    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:01.995783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.995582    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:01.995783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.995690    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:01.996318 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.996288    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:01.996967 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.996939    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f16852ae-5793-486f-9f29-915f964b146c" path="/var/lib/kubelet/pods/f16852ae-5793-486f-9f29-915f964b146c/volumes"
Sep 11 15:27:01.998270 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.998240    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:01.998457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:01.998436    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:02.004327 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:02.004301    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n2hr\" (UniqueName: \"kubernetes.io/projected/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-kube-api-access-6n2hr\") pod \"maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:02.109991 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:02.109950    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:02.368304 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:02.368269    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft" event={"ID":"b14245b6-9e5d-489f-8a0f-0bcf5224523f","Type":"ContainerStarted","Data":"7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30"}
Sep 11 15:27:02.368715 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:02.368339    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:27:02.387590 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:02.387561    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"]
Sep 11 15:27:02.390157 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:02.390107    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft" podStartSLOduration=2.994363064 podStartE2EDuration="3.390088909s" totalImagesPullingTime="395.725845ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:27:02.388171707 +0000 UTC m=+1096.847888731" watchObservedRunningTime="2026-09-11 15:27:02.390088909 +0000 UTC m=+1096.849805953"
Sep 11 15:27:02.390953 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:27:02.390916    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad406b9c_ec5d_4bd5_8b68_76f75f42fe76.slice/crio-ef1d3d4c0e27180cef9b814dcec403fc2f949c24041776840bc2cd003a1d65a1 WatchSource:0}: Error finding container ef1d3d4c0e27180cef9b814dcec403fc2f949c24041776840bc2cd003a1d65a1: Status 404 returned error can't find the container with id ef1d3d4c0e27180cef9b814dcec403fc2f949c24041776840bc2cd003a1d65a1
Sep 11 15:27:03.375189 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:03.375150    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr" event={"ID":"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76","Type":"ContainerStarted","Data":"8298ea37dfbd2b38c8922d3f8510f4dffb47c72ee767f52549570e15774f9c31"}
Sep 11 15:27:03.375680 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:03.375209    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr" event={"ID":"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76","Type":"ContainerStarted","Data":"ef1d3d4c0e27180cef9b814dcec403fc2f949c24041776840bc2cd003a1d65a1"}
Sep 11 15:27:03.375680 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:03.375346    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:03.393664 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:03.393589    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr" podStartSLOduration=2.08153813 podStartE2EDuration="2.393571726s" totalImagesPullingTime="312.033596ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:27:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:27:03.392268062 +0000 UTC m=+1097.851985060" watchObservedRunningTime="2026-09-11 15:27:03.393571726 +0000 UTC m=+1097.853288725"
Sep 11 15:27:08.380908 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:08.380880    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:27:09.386019 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:09.385988    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:27:25.534863 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.534827    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"]
Sep 11 15:27:25.539038 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.539017    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.541459 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.541439    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-7ee57f-openshift-default-dockercfg-7vr45\""
Sep 11 15:27:25.548771 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.548748    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"]
Sep 11 15:27:25.614282 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.614248    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-workload-certs\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.614282 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.614286    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-podinfo\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.614461 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.614332    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5jdj\" (UniqueName: \"kubernetes.io/projected/37306187-64bb-4c18-b2d4-d48e0526bec8-kube-api-access-n5jdj\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.614461 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.614380    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-workload-socket\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.614461 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.614412    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-credential-socket\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.614461 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.614446    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-envoy\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.614588 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.614501    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-token\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.614588 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.614520    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37306187-64bb-4c18-b2d4-d48e0526bec8-istiod-ca-cert\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.614588 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.614571    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-data\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.715497 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.715465    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-data\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.715709 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.715506    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-workload-certs\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.715709 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.715525    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-podinfo\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.715709 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.715546    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5jdj\" (UniqueName: \"kubernetes.io/projected/37306187-64bb-4c18-b2d4-d48e0526bec8-kube-api-access-n5jdj\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.715709 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.715574    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-workload-socket\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.715709 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.715603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-credential-socket\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.715709 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.715672    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-envoy\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.716104 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.715732    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-token\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.716104 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.715760    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37306187-64bb-4c18-b2d4-d48e0526bec8-istiod-ca-cert\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.716104 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.715961    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-workload-certs\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.716104 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.715990    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-data\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.716104 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.716039    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-workload-socket\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.716104 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.716101    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-credential-socket\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.716557 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.716356    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37306187-64bb-4c18-b2d4-d48e0526bec8-istiod-ca-cert\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.718105 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.718087    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-podinfo\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.718105 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.718098    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-envoy\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.724721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.724701    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-token\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.724813 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.724795    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5jdj\" (UniqueName: \"kubernetes.io/projected/37306187-64bb-4c18-b2d4-d48e0526bec8-kube-api-access-n5jdj\") pod \"e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") " pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:25.849939 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:25.849866    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:26.125710 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:26.125678    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"]
Sep 11 15:27:26.127795 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:27:26.127762    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37306187_64bb_4c18_b2d4_d48e0526bec8.slice/crio-76d6322f199c33192492d1fb7f1c7a85f4879ecf6945bad12af740ff654bad42 WatchSource:0}: Error finding container 76d6322f199c33192492d1fb7f1c7a85f4879ecf6945bad12af740ff654bad42: Status 404 returned error can't find the container with id 76d6322f199c33192492d1fb7f1c7a85f4879ecf6945bad12af740ff654bad42
Sep 11 15:27:26.130516 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:26.130487    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:27:26.130634 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:26.130564    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:27:26.130704 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:26.130644    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:27:26.495813 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:26.495713    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" event={"ID":"37306187-64bb-4c18-b2d4-d48e0526bec8","Type":"ContainerStarted","Data":"0969af36247d8957d901be955529c5e00faf711610e741f5b9f9a82fd453bfef"}
Sep 11 15:27:26.495813 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:26.495780    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" event={"ID":"37306187-64bb-4c18-b2d4-d48e0526bec8","Type":"ContainerStarted","Data":"76d6322f199c33192492d1fb7f1c7a85f4879ecf6945bad12af740ff654bad42"}
Sep 11 15:27:26.517440 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:26.517388    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" podStartSLOduration=1.517371172 podStartE2EDuration="1.517371172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:27:26.514924703 +0000 UTC m=+1120.974641705" watchObservedRunningTime="2026-09-11 15:27:26.517371172 +0000 UTC m=+1120.977088171"
Sep 11 15:27:26.850133 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:26.850056    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:27.856645 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:27.856578    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:28.506229 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.506197    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:28.507544 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.507517    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:28.637545 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.637505    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"]
Sep 11 15:27:28.641344 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.641322    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:28.644720 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.644700    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-abba31-serving-cert\""
Sep 11 15:27:28.651720 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.651697    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"]
Sep 11 15:27:28.747263 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.747230    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:28.747436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.747271    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkkqc\" (UniqueName: \"kubernetes.io/projected/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-kube-api-access-nkkqc\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:28.747436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.747324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:28.747436 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.747389    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:28.848608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.848528    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:28.848608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.848570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkkqc\" (UniqueName: \"kubernetes.io/projected/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-kube-api-access-nkkqc\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:28.848817 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.848667    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:28.848817 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.848795    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:28.848931 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:27:28.848915    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-serving-cert: secret "maas-api-e2e-shared-b-w3-abba31-serving-cert" not found
Sep 11 15:27:28.849009 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:27:28.848997    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-maas-api-tls podName:dfe4b6af-1ccb-49d9-bf2d-d375cce26a51 nodeName:}" failed. No retries permitted until 2026-09-11 15:27:29.348976112 +0000 UTC m=+1123.808693106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-maas-api-tls") pod "maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc" (UID: "dfe4b6af-1ccb-49d9-bf2d-d375cce26a51") : secret "maas-api-e2e-shared-b-w3-abba31-serving-cert" not found
Sep 11 15:27:28.849327 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.849311    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:28.851243 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.851220    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:28.859805 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:28.859783    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkkqc\" (UniqueName: \"kubernetes.io/projected/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-kube-api-access-nkkqc\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:29.353432 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:29.353393    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:29.356011 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:29.355985    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:29.553708 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:29.553677    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:29.832065 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:29.832027    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"]
Sep 11 15:27:29.837366 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:27:29.837337    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe4b6af_1ccb_49d9_bf2d_d375cce26a51.slice/crio-33e4579f8c9b66a10142be9e6fb3f1beafd09d31f3f57a5649c5ef9cd3800632 WatchSource:0}: Error finding container 33e4579f8c9b66a10142be9e6fb3f1beafd09d31f3f57a5649c5ef9cd3800632: Status 404 returned error can't find the container with id 33e4579f8c9b66a10142be9e6fb3f1beafd09d31f3f57a5649c5ef9cd3800632
Sep 11 15:27:30.518237 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.518131    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc" event={"ID":"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51","Type":"ContainerStarted","Data":"b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0"}
Sep 11 15:27:30.518690 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.518340    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:30.518690 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.518385    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc" event={"ID":"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51","Type":"ContainerStarted","Data":"33e4579f8c9b66a10142be9e6fb3f1beafd09d31f3f57a5649c5ef9cd3800632"}
Sep 11 15:27:30.537097 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.537043    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc" podStartSLOduration=2.164948248 podStartE2EDuration="2.537023622s" totalImagesPullingTime="372.075374ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:27:30.536021164 +0000 UTC m=+1124.995738165" watchObservedRunningTime="2026-09-11 15:27:30.537023622 +0000 UTC m=+1124.996740620"
Sep 11 15:27:30.787256 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.787168    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"]
Sep 11 15:27:30.790822 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.790805    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"
Sep 11 15:27:30.793367 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.793347    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-7ee57f\""
Sep 11 15:27:30.793479 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.793411    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-7ee57f-dockercfg-9r4r5\""
Sep 11 15:27:30.800463 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.800440    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"]
Sep 11 15:27:30.869825 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.869791    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99549aef-174e-490d-9643-d36371cbcc95-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p\" (UID: \"99549aef-174e-490d-9643-d36371cbcc95\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"
Sep 11 15:27:30.870025 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.869954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc9kt\" (UniqueName: \"kubernetes.io/projected/99549aef-174e-490d-9643-d36371cbcc95-kube-api-access-sc9kt\") pod \"payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p\" (UID: \"99549aef-174e-490d-9643-d36371cbcc95\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"
Sep 11 15:27:30.971115 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.971076    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc9kt\" (UniqueName: \"kubernetes.io/projected/99549aef-174e-490d-9643-d36371cbcc95-kube-api-access-sc9kt\") pod \"payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p\" (UID: \"99549aef-174e-490d-9643-d36371cbcc95\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"
Sep 11 15:27:30.971334 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.971163    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99549aef-174e-490d-9643-d36371cbcc95-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p\" (UID: \"99549aef-174e-490d-9643-d36371cbcc95\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"
Sep 11 15:27:30.971927 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.971908    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99549aef-174e-490d-9643-d36371cbcc95-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p\" (UID: \"99549aef-174e-490d-9643-d36371cbcc95\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"
Sep 11 15:27:30.982662 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:30.982640    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc9kt\" (UniqueName: \"kubernetes.io/projected/99549aef-174e-490d-9643-d36371cbcc95-kube-api-access-sc9kt\") pod \"payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p\" (UID: \"99549aef-174e-490d-9643-d36371cbcc95\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"
Sep 11 15:27:31.101647 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:31.101513    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"
Sep 11 15:27:31.375348 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:31.375320    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"]
Sep 11 15:27:31.376840 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:27:31.376812    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99549aef_174e_490d_9643_d36371cbcc95.slice/crio-0f02d91d28771e8087e21a06159966092acb5f79cdf84881cdfbd3aee97f0af3 WatchSource:0}: Error finding container 0f02d91d28771e8087e21a06159966092acb5f79cdf84881cdfbd3aee97f0af3: Status 404 returned error can't find the container with id 0f02d91d28771e8087e21a06159966092acb5f79cdf84881cdfbd3aee97f0af3
Sep 11 15:27:31.525383 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:31.525343    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p" event={"ID":"99549aef-174e-490d-9643-d36371cbcc95","Type":"ContainerStarted","Data":"8d890b2dff1aeb47e553e75307cd2627ec2263a2c3c3bf76c33a9321b05208ef"}
Sep 11 15:27:31.525850 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:31.525670    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"
Sep 11 15:27:31.525850 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:31.525726    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p" event={"ID":"99549aef-174e-490d-9643-d36371cbcc95","Type":"ContainerStarted","Data":"0f02d91d28771e8087e21a06159966092acb5f79cdf84881cdfbd3aee97f0af3"}
Sep 11 15:27:31.541168 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:31.541118    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p" podStartSLOduration=1.541100352 podStartE2EDuration="1.541100352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:27:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:27:31.540414727 +0000 UTC m=+1126.000131732" watchObservedRunningTime="2026-09-11 15:27:31.541100352 +0000 UTC m=+1126.000817355"
Sep 11 15:27:36.531390 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:36.531362    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:27:42.536580 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:42.535768    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"
Sep 11 15:27:44.547847 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:44.547799    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 15:27:44.548259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:44.547897    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 15:27:46.607107 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:46.607070    2574 generic.go:356] "Generic (PLEG): container finished" podID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerID="0969af36247d8957d901be955529c5e00faf711610e741f5b9f9a82fd453bfef" exitCode=0
Sep 11 15:27:46.607518 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:46.607149    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" event={"ID":"37306187-64bb-4c18-b2d4-d48e0526bec8","Type":"ContainerDied","Data":"0969af36247d8957d901be955529c5e00faf711610e741f5b9f9a82fd453bfef"}
Sep 11 15:27:46.607561 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:46.607529    2574 scope.go:117] "RemoveContainer" containerID="0969af36247d8957d901be955529c5e00faf711610e741f5b9f9a82fd453bfef"
Sep 11 15:27:46.608606 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:46.608581    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:27:46.608708 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:46.608663    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:27:46.608708 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:46.608697    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:27:47.614493 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:47.614464    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" event={"ID":"37306187-64bb-4c18-b2d4-d48e0526bec8","Type":"ContainerStarted","Data":"16c17f4a6590d1c8d4486eb53e42de4382006fd737b08bd3c767f55371eff4ba"}
Sep 11 15:27:47.850883 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:47.850848    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:47.851180 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:47.851151    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 15:27:47.851299 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:47.851221    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 15:27:48.851201 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:48.851156    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 15:27:48.851744 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:48.851224    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 15:27:49.851083 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:49.851047    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 15:27:49.851415 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:49.851369    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 15:27:50.850152 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:50.850118    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 15:27:50.850422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:50.850393    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 15:27:51.851325 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:51.851276    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 15:27:51.851847 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:51.851392    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 15:27:52.854084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:52.854052    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:52.854454 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:52.854317    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:27:52.855093 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:27:52.855073    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:28:14.198947 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.198870    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"]
Sep 11 15:28:14.201423 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.201406    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"
Sep 11 15:28:14.209583 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.209561    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-dcdcc9ba-dockercfg-d4t9t\""
Sep 11 15:28:14.210490 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.210471    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-dcdcc9ba\""
Sep 11 15:28:14.227138 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.227112    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"]
Sep 11 15:28:14.245532 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.245508    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"]
Sep 11 15:28:14.248051 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.248036    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"
Sep 11 15:28:14.270552 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.270529    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"]
Sep 11 15:28:14.293206 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.293153    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4wzt\" (UniqueName: \"kubernetes.io/projected/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac-kube-api-access-x4wzt\") pod \"payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8\" (UID: \"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"
Sep 11 15:28:14.293558 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.293534    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8\" (UID: \"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"
Sep 11 15:28:14.394855 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.394820    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mpkg\" (UniqueName: \"kubernetes.io/projected/b40675e1-fa5d-4c23-9434-a51c35cddadd-kube-api-access-9mpkg\") pod \"payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr\" (UID: \"b40675e1-fa5d-4c23-9434-a51c35cddadd\") " pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"
Sep 11 15:28:14.394855 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.394858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b40675e1-fa5d-4c23-9434-a51c35cddadd-plugins-config-volume\") pod \"payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr\" (UID: \"b40675e1-fa5d-4c23-9434-a51c35cddadd\") " pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"
Sep 11 15:28:14.395060 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.394953    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8\" (UID: \"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"
Sep 11 15:28:14.395060 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.394983    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4wzt\" (UniqueName: \"kubernetes.io/projected/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac-kube-api-access-x4wzt\") pod \"payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8\" (UID: \"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"
Sep 11 15:28:14.395716 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.395692    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8\" (UID: \"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"
Sep 11 15:28:14.405202 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.405180    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4wzt\" (UniqueName: \"kubernetes.io/projected/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac-kube-api-access-x4wzt\") pod \"payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8\" (UID: \"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"
Sep 11 15:28:14.495950 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.495860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mpkg\" (UniqueName: \"kubernetes.io/projected/b40675e1-fa5d-4c23-9434-a51c35cddadd-kube-api-access-9mpkg\") pod \"payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr\" (UID: \"b40675e1-fa5d-4c23-9434-a51c35cddadd\") " pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"
Sep 11 15:28:14.495950 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.495901    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b40675e1-fa5d-4c23-9434-a51c35cddadd-plugins-config-volume\") pod \"payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr\" (UID: \"b40675e1-fa5d-4c23-9434-a51c35cddadd\") " pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"
Sep 11 15:28:14.496565 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.496547    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b40675e1-fa5d-4c23-9434-a51c35cddadd-plugins-config-volume\") pod \"payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr\" (UID: \"b40675e1-fa5d-4c23-9434-a51c35cddadd\") " pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"
Sep 11 15:28:14.503466 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.503444    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mpkg\" (UniqueName: \"kubernetes.io/projected/b40675e1-fa5d-4c23-9434-a51c35cddadd-kube-api-access-9mpkg\") pod \"payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr\" (UID: \"b40675e1-fa5d-4c23-9434-a51c35cddadd\") " pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"
Sep 11 15:28:14.511326 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.511302    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"
Sep 11 15:28:14.558697 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.558401    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"
Sep 11 15:28:14.783152 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.783126    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"]
Sep 11 15:28:14.784768 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:28:14.784739    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c83f11b_eea3_4bc1_9b15_faa9fdbca5ac.slice/crio-0910be8c2ac169178846632aaa91b29a22cb94039d1fc32ed9d8e87a906cbff1 WatchSource:0}: Error finding container 0910be8c2ac169178846632aaa91b29a22cb94039d1fc32ed9d8e87a906cbff1: Status 404 returned error can't find the container with id 0910be8c2ac169178846632aaa91b29a22cb94039d1fc32ed9d8e87a906cbff1
Sep 11 15:28:14.840948 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:14.840924    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"]
Sep 11 15:28:14.843296 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:28:14.843272    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb40675e1_fa5d_4c23_9434_a51c35cddadd.slice/crio-0330654ad8ae164f5ac925bcbe99789f53d552701f2516677ecfad6541b6e247 WatchSource:0}: Error finding container 0330654ad8ae164f5ac925bcbe99789f53d552701f2516677ecfad6541b6e247: Status 404 returned error can't find the container with id 0330654ad8ae164f5ac925bcbe99789f53d552701f2516677ecfad6541b6e247
Sep 11 15:28:15.770969 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:15.770931    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8" event={"ID":"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac","Type":"ContainerStarted","Data":"1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9"}
Sep 11 15:28:15.771441 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:15.771003    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"
Sep 11 15:28:15.771441 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:15.771026    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8" event={"ID":"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac","Type":"ContainerStarted","Data":"0910be8c2ac169178846632aaa91b29a22cb94039d1fc32ed9d8e87a906cbff1"}
Sep 11 15:28:15.772525 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:15.772500    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr" event={"ID":"b40675e1-fa5d-4c23-9434-a51c35cddadd","Type":"ContainerStarted","Data":"716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de"}
Sep 11 15:28:15.772664 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:15.772543    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr" event={"ID":"b40675e1-fa5d-4c23-9434-a51c35cddadd","Type":"ContainerStarted","Data":"0330654ad8ae164f5ac925bcbe99789f53d552701f2516677ecfad6541b6e247"}
Sep 11 15:28:15.772664 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:15.772570    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"
Sep 11 15:28:15.787282 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:15.787242    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8" podStartSLOduration=1.787230379 podStartE2EDuration="1.787230379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:28:15.785672971 +0000 UTC m=+1170.245389969" watchObservedRunningTime="2026-09-11 15:28:15.787230379 +0000 UTC m=+1170.246947377"
Sep 11 15:28:15.802623 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:15.802575    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr" podStartSLOduration=1.8025601230000001 podStartE2EDuration="1.802560123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:28:15.802270291 +0000 UTC m=+1170.261987292" watchObservedRunningTime="2026-09-11 15:28:15.802560123 +0000 UTC m=+1170.262277126"
Sep 11 15:28:26.779070 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:26.779035    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"
Sep 11 15:28:26.779470 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:28:26.779198    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"
Sep 11 15:29:35.774824 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:35.774791    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"]
Sep 11 15:29:35.775345 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:35.775021    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr" podUID="b40675e1-fa5d-4c23-9434-a51c35cddadd" containerName="payload-processing" containerID="cri-o://716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de" gracePeriod=30
Sep 11 15:29:35.784210 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:35.784181    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"]
Sep 11 15:29:35.784442 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:35.784405    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8" podUID="3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac" containerName="payload-pre-processing" containerID="cri-o://1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9" gracePeriod=30
Sep 11 15:29:36.054256 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.054233    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"
Sep 11 15:29:36.071431 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.071408    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"
Sep 11 15:29:36.150124 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.150084    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4wzt\" (UniqueName: \"kubernetes.io/projected/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac-kube-api-access-x4wzt\") pod \"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac\" (UID: \"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac\") "
Sep 11 15:29:36.150307 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.150162    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b40675e1-fa5d-4c23-9434-a51c35cddadd-plugins-config-volume\") pod \"b40675e1-fa5d-4c23-9434-a51c35cddadd\" (UID: \"b40675e1-fa5d-4c23-9434-a51c35cddadd\") "
Sep 11 15:29:36.150307 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.150199    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mpkg\" (UniqueName: \"kubernetes.io/projected/b40675e1-fa5d-4c23-9434-a51c35cddadd-kube-api-access-9mpkg\") pod \"b40675e1-fa5d-4c23-9434-a51c35cddadd\" (UID: \"b40675e1-fa5d-4c23-9434-a51c35cddadd\") "
Sep 11 15:29:36.150307 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.150273    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac-plugins-config-volume\") pod \"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac\" (UID: \"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac\") "
Sep 11 15:29:36.150962 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.150935    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b40675e1-fa5d-4c23-9434-a51c35cddadd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b40675e1-fa5d-4c23-9434-a51c35cddadd" (UID: "b40675e1-fa5d-4c23-9434-a51c35cddadd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:29:36.151952 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.151929    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac" (UID: "3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:29:36.154020 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.153989    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac-kube-api-access-x4wzt" (OuterVolumeSpecName: "kube-api-access-x4wzt") pod "3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac" (UID: "3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac"). InnerVolumeSpecName "kube-api-access-x4wzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:29:36.155010 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.154983    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b40675e1-fa5d-4c23-9434-a51c35cddadd-kube-api-access-9mpkg" (OuterVolumeSpecName: "kube-api-access-9mpkg") pod "b40675e1-fa5d-4c23-9434-a51c35cddadd" (UID: "b40675e1-fa5d-4c23-9434-a51c35cddadd"). InnerVolumeSpecName "kube-api-access-9mpkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:29:36.185047 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.185022    2574 generic.go:356] "Generic (PLEG): container finished" podID="3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac" containerID="1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9" exitCode=0
Sep 11 15:29:36.185177 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.185077    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"
Sep 11 15:29:36.185177 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.185116    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8" event={"ID":"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac","Type":"ContainerDied","Data":"1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9"}
Sep 11 15:29:36.185295 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.185190    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8" event={"ID":"3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac","Type":"ContainerDied","Data":"0910be8c2ac169178846632aaa91b29a22cb94039d1fc32ed9d8e87a906cbff1"}
Sep 11 15:29:36.185295 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.185220    2574 scope.go:117] "RemoveContainer" containerID="1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9"
Sep 11 15:29:36.186521 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.186500    2574 generic.go:356] "Generic (PLEG): container finished" podID="b40675e1-fa5d-4c23-9434-a51c35cddadd" containerID="716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de" exitCode=0
Sep 11 15:29:36.186646 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.186527    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr" event={"ID":"b40675e1-fa5d-4c23-9434-a51c35cddadd","Type":"ContainerDied","Data":"716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de"}
Sep 11 15:29:36.186646 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.186571    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"
Sep 11 15:29:36.186741 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.186577    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr" event={"ID":"b40675e1-fa5d-4c23-9434-a51c35cddadd","Type":"ContainerDied","Data":"0330654ad8ae164f5ac925bcbe99789f53d552701f2516677ecfad6541b6e247"}
Sep 11 15:29:36.195430 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.195412    2574 scope.go:117] "RemoveContainer" containerID="1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9"
Sep 11 15:29:36.195720 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:29:36.195695    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9\": container with ID starting with 1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9 not found: ID does not exist" containerID="1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9"
Sep 11 15:29:36.195803 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.195731    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9"} err="failed to get container status \"1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9\": rpc error: code = NotFound desc = could not find container \"1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9\": container with ID starting with 1bf7e3023cbd13e063dccba4f46cdd880ed45619b5876f35a22e02a722a2a4f9 not found: ID does not exist"
Sep 11 15:29:36.195803 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.195755    2574 scope.go:117] "RemoveContainer" containerID="716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de"
Sep 11 15:29:36.203750 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.203733    2574 scope.go:117] "RemoveContainer" containerID="716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de"
Sep 11 15:29:36.203974 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:29:36.203958    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de\": container with ID starting with 716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de not found: ID does not exist" containerID="716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de"
Sep 11 15:29:36.204025 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.203978    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de"} err="failed to get container status \"716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de\": rpc error: code = NotFound desc = could not find container \"716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de\": container with ID starting with 716d913a30bc169f309785c76c3057fbecb84488a940f16e39ad91bd102e46de not found: ID does not exist"
Sep 11 15:29:36.229695 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.229672    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"]
Sep 11 15:29:36.234717 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.234683    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcdcc9ba-5c5b8796b9-mx2rr"]
Sep 11 15:29:36.247640 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.247597    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"]
Sep 11 15:29:36.249518 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.249496    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcdcc9ba-67475fb56b-hm2p8"]
Sep 11 15:29:36.251555 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.251532    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4wzt\" (UniqueName: \"kubernetes.io/projected/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac-kube-api-access-x4wzt\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:29:36.251555 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.251556    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b40675e1-fa5d-4c23-9434-a51c35cddadd-plugins-config-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:29:36.251724 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.251566    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mpkg\" (UniqueName: \"kubernetes.io/projected/b40675e1-fa5d-4c23-9434-a51c35cddadd-kube-api-access-9mpkg\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:29:36.251724 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:36.251576    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac-plugins-config-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:29:37.995263 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:37.995185    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac" path="/var/lib/kubelet/pods/3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac/volumes"
Sep 11 15:29:37.995643 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:29:37.995549    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b40675e1-fa5d-4c23-9434-a51c35cddadd" path="/var/lib/kubelet/pods/b40675e1-fa5d-4c23-9434-a51c35cddadd/volumes"
Sep 11 15:31:15.188358 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.188260    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"]
Sep 11 15:31:15.188932 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.188912    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac" containerName="payload-pre-processing"
Sep 11 15:31:15.189003 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.188934    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac" containerName="payload-pre-processing"
Sep 11 15:31:15.189003 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.188944    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b40675e1-fa5d-4c23-9434-a51c35cddadd" containerName="payload-processing"
Sep 11 15:31:15.189003 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.188953    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b40675e1-fa5d-4c23-9434-a51c35cddadd" containerName="payload-processing"
Sep 11 15:31:15.189149 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.189054    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b40675e1-fa5d-4c23-9434-a51c35cddadd" containerName="payload-processing"
Sep 11 15:31:15.189149 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.189067    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c83f11b-eea3-4bc1-9b15-faa9fdbca5ac" containerName="payload-pre-processing"
Sep 11 15:31:15.191680 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.191662    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.194250 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.194229    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-abba31\"/\"kube-root-ca.crt\""
Sep 11 15:31:15.195376 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.195360    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-abba31\"/\"default-dockercfg-qdbqn\""
Sep 11 15:31:15.195376 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.195367    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-abba31\"/\"sub-test-model-abba31-kserve-self-signed-certs\""
Sep 11 15:31:15.195529 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.195365    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-abba31\"/\"openshift-service-ca.crt\""
Sep 11 15:31:15.203497 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.203474    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"]
Sep 11 15:31:15.327536 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.327499    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cw7v\" (UniqueName: \"kubernetes.io/projected/ea852122-8d2f-4959-9adb-3798b9d5004c-kube-api-access-6cw7v\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.327741 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.327586    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-tmp-dir\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.327741 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.327606    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea852122-8d2f-4959-9adb-3798b9d5004c-tls-certs\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.327862 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.327736    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-model-cache\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.327862 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.327770    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-home\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.327862 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.327801    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-dshm\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.429281 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.429244    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-home\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.429281 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.429284    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-dshm\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.429543 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.429320    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cw7v\" (UniqueName: \"kubernetes.io/projected/ea852122-8d2f-4959-9adb-3798b9d5004c-kube-api-access-6cw7v\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.429543 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.429370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-tmp-dir\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.429543 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.429395    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea852122-8d2f-4959-9adb-3798b9d5004c-tls-certs\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.429543 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.429442    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-model-cache\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.429791 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.429765    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-home\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.429873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.429849    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-tmp-dir\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.429873 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.429861    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-model-cache\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.431863 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.431839    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-dshm\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.432351 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.432329    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea852122-8d2f-4959-9adb-3798b9d5004c-tls-certs\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.437502 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.437480    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cw7v\" (UniqueName: \"kubernetes.io/projected/ea852122-8d2f-4959-9adb-3798b9d5004c-kube-api-access-6cw7v\") pod \"sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") " pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.503792 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.503697    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:15.778838 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:15.778813    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"]
Sep 11 15:31:15.781629 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:31:15.781588    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea852122_8d2f_4959_9adb_3798b9d5004c.slice/crio-3b19e73ffb96f7f3ec681550ccae5b214f0ad183905e9ecb5bbacf2f12227d4b WatchSource:0}: Error finding container 3b19e73ffb96f7f3ec681550ccae5b214f0ad183905e9ecb5bbacf2f12227d4b: Status 404 returned error can't find the container with id 3b19e73ffb96f7f3ec681550ccae5b214f0ad183905e9ecb5bbacf2f12227d4b
Sep 11 15:31:16.681623 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:16.681587    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8" event={"ID":"ea852122-8d2f-4959-9adb-3798b9d5004c","Type":"ContainerStarted","Data":"10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4"}
Sep 11 15:31:16.682036 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:16.681647    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8" event={"ID":"ea852122-8d2f-4959-9adb-3798b9d5004c","Type":"ContainerStarted","Data":"3b19e73ffb96f7f3ec681550ccae5b214f0ad183905e9ecb5bbacf2f12227d4b"}
Sep 11 15:31:16.700406 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:16.700358    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8" podStartSLOduration=1.700342444 podStartE2EDuration="1.700342444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:31:16.698856425 +0000 UTC m=+1351.158573437" watchObservedRunningTime="2026-09-11 15:31:16.700342444 +0000 UTC m=+1351.160059488"
Sep 11 15:31:25.504098 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:25.504060    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:25.504491 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:25.504112    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:25.516853 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:25.516832    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:25.739598 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:25.739566    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:31:28.718277 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:28.718240    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"]
Sep 11 15:31:28.720801 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:28.720785    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"
Sep 11 15:31:28.724683 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:28.724661    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-808212\""
Sep 11 15:31:28.724813 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:28.724669    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-808212-dockercfg-k8q2r\""
Sep 11 15:31:28.741360 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:28.741324    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"]
Sep 11 15:31:28.861883 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:28.861846    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhzpq\" (UniqueName: \"kubernetes.io/projected/c037ac35-b123-458a-b268-df49d9e17728-kube-api-access-vhzpq\") pod \"payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q\" (UID: \"c037ac35-b123-458a-b268-df49d9e17728\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"
Sep 11 15:31:28.862036 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:28.861892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c037ac35-b123-458a-b268-df49d9e17728-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q\" (UID: \"c037ac35-b123-458a-b268-df49d9e17728\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"
Sep 11 15:31:28.963275 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:28.963241    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhzpq\" (UniqueName: \"kubernetes.io/projected/c037ac35-b123-458a-b268-df49d9e17728-kube-api-access-vhzpq\") pod \"payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q\" (UID: \"c037ac35-b123-458a-b268-df49d9e17728\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"
Sep 11 15:31:28.963428 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:28.963281    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c037ac35-b123-458a-b268-df49d9e17728-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q\" (UID: \"c037ac35-b123-458a-b268-df49d9e17728\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"
Sep 11 15:31:28.963958 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:28.963939    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c037ac35-b123-458a-b268-df49d9e17728-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q\" (UID: \"c037ac35-b123-458a-b268-df49d9e17728\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"
Sep 11 15:31:28.972196 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:28.972141    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhzpq\" (UniqueName: \"kubernetes.io/projected/c037ac35-b123-458a-b268-df49d9e17728-kube-api-access-vhzpq\") pod \"payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q\" (UID: \"c037ac35-b123-458a-b268-df49d9e17728\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"
Sep 11 15:31:29.031986 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:29.031956    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"
Sep 11 15:31:29.302882 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:29.302861    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"]
Sep 11 15:31:29.305128 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:31:29.305091    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc037ac35_b123_458a_b268_df49d9e17728.slice/crio-28615d2e0feeffed715e311cee5051d1af5acd041c869d80bf621b34c984bf29 WatchSource:0}: Error finding container 28615d2e0feeffed715e311cee5051d1af5acd041c869d80bf621b34c984bf29: Status 404 returned error can't find the container with id 28615d2e0feeffed715e311cee5051d1af5acd041c869d80bf621b34c984bf29
Sep 11 15:31:29.752254 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:29.752220    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q" event={"ID":"c037ac35-b123-458a-b268-df49d9e17728","Type":"ContainerStarted","Data":"6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6"}
Sep 11 15:31:29.752764 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:29.752277    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q" event={"ID":"c037ac35-b123-458a-b268-df49d9e17728","Type":"ContainerStarted","Data":"28615d2e0feeffed715e311cee5051d1af5acd041c869d80bf621b34c984bf29"}
Sep 11 15:31:29.752764 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:29.752336    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"
Sep 11 15:31:29.768267 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:29.768219    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q" podStartSLOduration=1.7682067479999999 podStartE2EDuration="1.768206748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:31:29.767215235 +0000 UTC m=+1364.226932235" watchObservedRunningTime="2026-09-11 15:31:29.768206748 +0000 UTC m=+1364.227923747"
Sep 11 15:31:40.760039 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:31:40.760002    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"
Sep 11 15:32:02.594328 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.594289    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"]
Sep 11 15:32:02.599286 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.599266    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:02.601824 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.601802    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-63c85a-serving-cert\""
Sep 11 15:32:02.607735 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.607706    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"]
Sep 11 15:32:02.701029 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.700997    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-metrics-certs\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:02.701029 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.701035    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rthq8\" (UniqueName: \"kubernetes.io/projected/4613dfe4-4462-4e82-939c-e0dc833198bb-kube-api-access-rthq8\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:02.701265 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.701234    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-maas-api-tls\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:02.701313 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.701268    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4613dfe4-4462-4e82-939c-e0dc833198bb-openshift-service-ca\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:02.801886 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.801846    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-maas-api-tls\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:02.801886 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.801892    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4613dfe4-4462-4e82-939c-e0dc833198bb-openshift-service-ca\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:02.802133 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.801914    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-metrics-certs\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:02.802133 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.801931    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rthq8\" (UniqueName: \"kubernetes.io/projected/4613dfe4-4462-4e82-939c-e0dc833198bb-kube-api-access-rthq8\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:02.802133 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:32:02.802024    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-serving-cert: secret "maas-api-e2e-api-b-63c85a-serving-cert" not found
Sep 11 15:32:02.802133 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:32:02.802106    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-maas-api-tls podName:4613dfe4-4462-4e82-939c-e0dc833198bb nodeName:}" failed. No retries permitted until 2026-09-11 15:32:03.302085422 +0000 UTC m=+1397.761802399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-maas-api-tls") pod "maas-api-e2e-api-b-63c85a-86d846cb78-82lx7" (UID: "4613dfe4-4462-4e82-939c-e0dc833198bb") : secret "maas-api-e2e-api-b-63c85a-serving-cert" not found
Sep 11 15:32:02.802511 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.802490    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4613dfe4-4462-4e82-939c-e0dc833198bb-openshift-service-ca\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:02.804567 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.804547    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-metrics-certs\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:02.811340 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:02.811309    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rthq8\" (UniqueName: \"kubernetes.io/projected/4613dfe4-4462-4e82-939c-e0dc833198bb-kube-api-access-rthq8\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:03.308134 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:03.308092    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-maas-api-tls\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:03.310809 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:03.310787    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-maas-api-tls\") pod \"maas-api-e2e-api-b-63c85a-86d846cb78-82lx7\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:03.510688 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:03.510648    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:03.788865 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:03.788838    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"]
Sep 11 15:32:03.790479 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:32:03.790454    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4613dfe4_4462_4e82_939c_e0dc833198bb.slice/crio-eced51e8d1c6c4ce37923fb2d6d5995454c3af8f2ce296abf11ef917ae4851ca WatchSource:0}: Error finding container eced51e8d1c6c4ce37923fb2d6d5995454c3af8f2ce296abf11ef917ae4851ca: Status 404 returned error can't find the container with id eced51e8d1c6c4ce37923fb2d6d5995454c3af8f2ce296abf11ef917ae4851ca
Sep 11 15:32:03.791928 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:03.791912    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 15:32:03.935018 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:03.934984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7" event={"ID":"4613dfe4-4462-4e82-939c-e0dc833198bb","Type":"ContainerStarted","Data":"eced51e8d1c6c4ce37923fb2d6d5995454c3af8f2ce296abf11ef917ae4851ca"}
Sep 11 15:32:04.949631 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:04.949566    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7" event={"ID":"4613dfe4-4462-4e82-939c-e0dc833198bb","Type":"ContainerStarted","Data":"a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa"}
Sep 11 15:32:04.950047 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:04.949697    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:04.965198 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:04.965137    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7" podStartSLOduration=2.4927980180000002 podStartE2EDuration="2.965115655s" totalImagesPullingTime="472.317637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:32:04.965034996 +0000 UTC m=+1399.424751996" watchObservedRunningTime="2026-09-11 15:32:04.965115655 +0000 UTC m=+1399.424832655"
Sep 11 15:32:10.185508 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:10.185459    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"]
Sep 11 15:32:10.960409 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:10.960376    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:32:25.206510 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.206446    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8" podUID="ea852122-8d2f-4959-9adb-3798b9d5004c" containerName="main" containerID="cri-o://10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4" gracePeriod=45
Sep 11 15:32:25.463519 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.463448    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:32:25.538148 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.538111    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea852122-8d2f-4959-9adb-3798b9d5004c-tls-certs\") pod \"ea852122-8d2f-4959-9adb-3798b9d5004c\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") "
Sep 11 15:32:25.538364 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.538179    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-home\") pod \"ea852122-8d2f-4959-9adb-3798b9d5004c\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") "
Sep 11 15:32:25.538364 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.538232    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-tmp-dir\") pod \"ea852122-8d2f-4959-9adb-3798b9d5004c\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") "
Sep 11 15:32:25.538364 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.538296    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-model-cache\") pod \"ea852122-8d2f-4959-9adb-3798b9d5004c\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") "
Sep 11 15:32:25.538535 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.538379    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-dshm\") pod \"ea852122-8d2f-4959-9adb-3798b9d5004c\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") "
Sep 11 15:32:25.538535 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.538411    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cw7v\" (UniqueName: \"kubernetes.io/projected/ea852122-8d2f-4959-9adb-3798b9d5004c-kube-api-access-6cw7v\") pod \"ea852122-8d2f-4959-9adb-3798b9d5004c\" (UID: \"ea852122-8d2f-4959-9adb-3798b9d5004c\") "
Sep 11 15:32:25.538535 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.538514    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-home" (OuterVolumeSpecName: "home") pod "ea852122-8d2f-4959-9adb-3798b9d5004c" (UID: "ea852122-8d2f-4959-9adb-3798b9d5004c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:32:25.538715 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.538578    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-model-cache" (OuterVolumeSpecName: "model-cache") pod "ea852122-8d2f-4959-9adb-3798b9d5004c" (UID: "ea852122-8d2f-4959-9adb-3798b9d5004c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:32:25.538715 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.538691    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ea852122-8d2f-4959-9adb-3798b9d5004c" (UID: "ea852122-8d2f-4959-9adb-3798b9d5004c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:32:25.538833 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.538800    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-tmp-dir\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:32:25.538833 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.538820    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-model-cache\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:32:25.538934 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.538833    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-home\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:32:25.540932 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.540893    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-dshm" (OuterVolumeSpecName: "dshm") pod "ea852122-8d2f-4959-9adb-3798b9d5004c" (UID: "ea852122-8d2f-4959-9adb-3798b9d5004c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:32:25.541037 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.540931    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea852122-8d2f-4959-9adb-3798b9d5004c-kube-api-access-6cw7v" (OuterVolumeSpecName: "kube-api-access-6cw7v") pod "ea852122-8d2f-4959-9adb-3798b9d5004c" (UID: "ea852122-8d2f-4959-9adb-3798b9d5004c"). InnerVolumeSpecName "kube-api-access-6cw7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:32:25.541037 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.541021    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea852122-8d2f-4959-9adb-3798b9d5004c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ea852122-8d2f-4959-9adb-3798b9d5004c" (UID: "ea852122-8d2f-4959-9adb-3798b9d5004c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:32:25.640148 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.640110    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea852122-8d2f-4959-9adb-3798b9d5004c-dshm\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:32:25.640148 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.640151    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cw7v\" (UniqueName: \"kubernetes.io/projected/ea852122-8d2f-4959-9adb-3798b9d5004c-kube-api-access-6cw7v\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:32:25.640357 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:25.640166    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea852122-8d2f-4959-9adb-3798b9d5004c-tls-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:32:26.063915 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:26.063872    2574 generic.go:356] "Generic (PLEG): container finished" podID="ea852122-8d2f-4959-9adb-3798b9d5004c" containerID="10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4" exitCode=0
Sep 11 15:32:26.064120 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:26.063915    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8" event={"ID":"ea852122-8d2f-4959-9adb-3798b9d5004c","Type":"ContainerDied","Data":"10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4"}
Sep 11 15:32:26.064120 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:26.063949    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"
Sep 11 15:32:26.064120 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:26.063973    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8" event={"ID":"ea852122-8d2f-4959-9adb-3798b9d5004c","Type":"ContainerDied","Data":"3b19e73ffb96f7f3ec681550ccae5b214f0ad183905e9ecb5bbacf2f12227d4b"}
Sep 11 15:32:26.064120 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:26.063996    2574 scope.go:117] "RemoveContainer" containerID="10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4"
Sep 11 15:32:26.073293 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:26.073265    2574 scope.go:117] "RemoveContainer" containerID="10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4"
Sep 11 15:32:26.073666 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:32:26.073643    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4\": container with ID starting with 10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4 not found: ID does not exist" containerID="10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4"
Sep 11 15:32:26.073742 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:26.073675    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4"} err="failed to get container status \"10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4\": rpc error: code = NotFound desc = could not find container \"10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4\": container with ID starting with 10ff686d242e8330f6fc63f6c99479897dd2e8ba6e50bf9bfe0a299881cd84f4 not found: ID does not exist"
Sep 11 15:32:26.080004 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:26.079975    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"]
Sep 11 15:32:26.086080 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:26.086050    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abba31/sub-test-model-abba31-kserve-6cf9c9c96c-4jxc8"]
Sep 11 15:32:27.995293 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:27.995262    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea852122-8d2f-4959-9adb-3798b9d5004c" path="/var/lib/kubelet/pods/ea852122-8d2f-4959-9adb-3798b9d5004c/volumes"
Sep 11 15:32:41.485199 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.485108    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"]
Sep 11 15:32:41.485836 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.485816    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea852122-8d2f-4959-9adb-3798b9d5004c" containerName="main"
Sep 11 15:32:41.485920 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.485838    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea852122-8d2f-4959-9adb-3798b9d5004c" containerName="main"
Sep 11 15:32:41.485976 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.485956    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea852122-8d2f-4959-9adb-3798b9d5004c" containerName="main"
Sep 11 15:32:41.490345 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.490321    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.493795 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.493765    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-abba31\"/\"default-dockercfg-qdbqn\""
Sep 11 15:32:41.493795 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.493766    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-abba31\"/\"kube-root-ca.crt\""
Sep 11 15:32:41.494013 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.493835    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-abba31\"/\"openshift-service-ca.crt\""
Sep 11 15:32:41.494013 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.493795    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-abba31\"/\"rate-test-model-abba31-kserve-self-signed-certs\""
Sep 11 15:32:41.500002 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.499970    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"]
Sep 11 15:32:41.598724 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.598683    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkshc\" (UniqueName: \"kubernetes.io/projected/4bb29288-4613-44a6-9fb3-2caebd63197f-kube-api-access-lkshc\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.598939 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.598736    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-model-cache\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.598939 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.598753    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-home\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.598939 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.598893    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bb29288-4613-44a6-9fb3-2caebd63197f-tls-certs\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.599120 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.598941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-tmp-dir\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.599120 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.598982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-dshm\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.700009 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.699968    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkshc\" (UniqueName: \"kubernetes.io/projected/4bb29288-4613-44a6-9fb3-2caebd63197f-kube-api-access-lkshc\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.700214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.700028    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-model-cache\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.700214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.700048    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-home\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.700214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.700099    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bb29288-4613-44a6-9fb3-2caebd63197f-tls-certs\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.700214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.700125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-tmp-dir\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.700214 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.700154    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-dshm\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.700474 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.700456    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-home\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.700538 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.700470    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-model-cache\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.700664 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.700605    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-tmp-dir\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.702731 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.702711    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-dshm\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.702994 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.702974    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bb29288-4613-44a6-9fb3-2caebd63197f-tls-certs\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.708601 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.708568    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkshc\" (UniqueName: \"kubernetes.io/projected/4bb29288-4613-44a6-9fb3-2caebd63197f-kube-api-access-lkshc\") pod \"rate-test-model-abba31-kserve-6d84c56d99-tsrfw\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") " pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:41.801903 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:41.801798    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:42.080580 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:42.080553    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"]
Sep 11 15:32:42.083113 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:32:42.083075    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bb29288_4613_44a6_9fb3_2caebd63197f.slice/crio-7d4721149c2f901eabbde3d0726e83511bca8e9ed9314428c09e1d3f03e6531d WatchSource:0}: Error finding container 7d4721149c2f901eabbde3d0726e83511bca8e9ed9314428c09e1d3f03e6531d: Status 404 returned error can't find the container with id 7d4721149c2f901eabbde3d0726e83511bca8e9ed9314428c09e1d3f03e6531d
Sep 11 15:32:42.159474 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:42.159441    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw" event={"ID":"4bb29288-4613-44a6-9fb3-2caebd63197f","Type":"ContainerStarted","Data":"7d4721149c2f901eabbde3d0726e83511bca8e9ed9314428c09e1d3f03e6531d"}
Sep 11 15:32:43.166681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:43.166640    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw" event={"ID":"4bb29288-4613-44a6-9fb3-2caebd63197f","Type":"ContainerStarted","Data":"14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193"}
Sep 11 15:32:43.184682 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:43.184598    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw" podStartSLOduration=2.184556435 podStartE2EDuration="2.184556435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:32:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:32:43.1833731 +0000 UTC m=+1437.643090104" watchObservedRunningTime="2026-09-11 15:32:43.184556435 +0000 UTC m=+1437.644273435"
Sep 11 15:32:47.317448 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:47.317409    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"]
Sep 11 15:32:47.319884 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:47.318834    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q" podUID="c037ac35-b123-458a-b268-df49d9e17728" containerName="payload-pre-processing" containerID="cri-o://6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6" gracePeriod=30
Sep 11 15:32:47.568428 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:47.568350    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"
Sep 11 15:32:47.654392 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:47.654359    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhzpq\" (UniqueName: \"kubernetes.io/projected/c037ac35-b123-458a-b268-df49d9e17728-kube-api-access-vhzpq\") pod \"c037ac35-b123-458a-b268-df49d9e17728\" (UID: \"c037ac35-b123-458a-b268-df49d9e17728\") "
Sep 11 15:32:47.654392 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:47.654396    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c037ac35-b123-458a-b268-df49d9e17728-plugins-config-volume\") pod \"c037ac35-b123-458a-b268-df49d9e17728\" (UID: \"c037ac35-b123-458a-b268-df49d9e17728\") "
Sep 11 15:32:47.654944 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:47.654919    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c037ac35-b123-458a-b268-df49d9e17728-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c037ac35-b123-458a-b268-df49d9e17728" (UID: "c037ac35-b123-458a-b268-df49d9e17728"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:32:47.656946 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:47.656919    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c037ac35-b123-458a-b268-df49d9e17728-kube-api-access-vhzpq" (OuterVolumeSpecName: "kube-api-access-vhzpq") pod "c037ac35-b123-458a-b268-df49d9e17728" (UID: "c037ac35-b123-458a-b268-df49d9e17728"). InnerVolumeSpecName "kube-api-access-vhzpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:32:47.755405 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:47.755368    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhzpq\" (UniqueName: \"kubernetes.io/projected/c037ac35-b123-458a-b268-df49d9e17728-kube-api-access-vhzpq\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:32:47.755405 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:47.755399    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c037ac35-b123-458a-b268-df49d9e17728-plugins-config-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:32:48.194769 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:48.194729    2574 generic.go:356] "Generic (PLEG): container finished" podID="c037ac35-b123-458a-b268-df49d9e17728" containerID="6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6" exitCode=0
Sep 11 15:32:48.194989 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:48.194782    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"
Sep 11 15:32:48.194989 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:48.194828    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q" event={"ID":"c037ac35-b123-458a-b268-df49d9e17728","Type":"ContainerDied","Data":"6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6"}
Sep 11 15:32:48.194989 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:48.194887    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q" event={"ID":"c037ac35-b123-458a-b268-df49d9e17728","Type":"ContainerDied","Data":"28615d2e0feeffed715e311cee5051d1af5acd041c869d80bf621b34c984bf29"}
Sep 11 15:32:48.194989 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:48.194910    2574 scope.go:117] "RemoveContainer" containerID="6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6"
Sep 11 15:32:48.204408 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:48.204387    2574 scope.go:117] "RemoveContainer" containerID="6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6"
Sep 11 15:32:48.204716 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:32:48.204692    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6\": container with ID starting with 6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6 not found: ID does not exist" containerID="6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6"
Sep 11 15:32:48.204779 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:48.204730    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6"} err="failed to get container status \"6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6\": rpc error: code = NotFound desc = could not find container \"6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6\": container with ID starting with 6afdb19aaa30e4e1a1460169dd76b91ab34889c7d584c9dd9088b5b9751fbcd6 not found: ID does not exist"
Sep 11 15:32:48.212662 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:48.212636    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"]
Sep 11 15:32:48.216258 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:48.216235    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-808212-69d68df5fd-92g7q"]
Sep 11 15:32:49.995379 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:49.995348    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c037ac35-b123-458a-b268-df49d9e17728" path="/var/lib/kubelet/pods/c037ac35-b123-458a-b268-df49d9e17728/volumes"
Sep 11 15:32:51.802958 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:51.802912    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:51.802958 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:51.802963    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:51.815872 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:51.815845    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:32:52.242226 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:32:52.242178    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:33:09.703549 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:09.703514    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"]
Sep 11 15:33:09.704054 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:09.703799    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7" podUID="4613dfe4-4462-4e82-939c-e0dc833198bb" containerName="maas-api" containerID="cri-o://a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa" gracePeriod=30
Sep 11 15:33:09.968009 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:09.967948    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:33:10.073880 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.073846    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-maas-api-tls\") pod \"4613dfe4-4462-4e82-939c-e0dc833198bb\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") "
Sep 11 15:33:10.074069 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.073968    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-metrics-certs\") pod \"4613dfe4-4462-4e82-939c-e0dc833198bb\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") "
Sep 11 15:33:10.074069 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.074029    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4613dfe4-4462-4e82-939c-e0dc833198bb-openshift-service-ca\") pod \"4613dfe4-4462-4e82-939c-e0dc833198bb\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") "
Sep 11 15:33:10.074178 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.074076    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rthq8\" (UniqueName: \"kubernetes.io/projected/4613dfe4-4462-4e82-939c-e0dc833198bb-kube-api-access-rthq8\") pod \"4613dfe4-4462-4e82-939c-e0dc833198bb\" (UID: \"4613dfe4-4462-4e82-939c-e0dc833198bb\") "
Sep 11 15:33:10.074481 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.074438    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4613dfe4-4462-4e82-939c-e0dc833198bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4613dfe4-4462-4e82-939c-e0dc833198bb" (UID: "4613dfe4-4462-4e82-939c-e0dc833198bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:33:10.076510 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.076477    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4613dfe4-4462-4e82-939c-e0dc833198bb" (UID: "4613dfe4-4462-4e82-939c-e0dc833198bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:33:10.076510 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.076490    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4613dfe4-4462-4e82-939c-e0dc833198bb" (UID: "4613dfe4-4462-4e82-939c-e0dc833198bb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:33:10.076787 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.076765    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4613dfe4-4462-4e82-939c-e0dc833198bb-kube-api-access-rthq8" (OuterVolumeSpecName: "kube-api-access-rthq8") pod "4613dfe4-4462-4e82-939c-e0dc833198bb" (UID: "4613dfe4-4462-4e82-939c-e0dc833198bb"). InnerVolumeSpecName "kube-api-access-rthq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:33:10.175972 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.175935    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rthq8\" (UniqueName: \"kubernetes.io/projected/4613dfe4-4462-4e82-939c-e0dc833198bb-kube-api-access-rthq8\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:10.175972 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.175965    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-maas-api-tls\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:10.175972 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.175975    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4613dfe4-4462-4e82-939c-e0dc833198bb-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:10.176202 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.175985    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4613dfe4-4462-4e82-939c-e0dc833198bb-openshift-service-ca\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:10.326234 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.326122    2574 generic.go:356] "Generic (PLEG): container finished" podID="4613dfe4-4462-4e82-939c-e0dc833198bb" containerID="a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa" exitCode=0
Sep 11 15:33:10.326234 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.326182    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7" event={"ID":"4613dfe4-4462-4e82-939c-e0dc833198bb","Type":"ContainerDied","Data":"a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa"}
Sep 11 15:33:10.326234 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.326193    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"
Sep 11 15:33:10.326234 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.326231    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7" event={"ID":"4613dfe4-4462-4e82-939c-e0dc833198bb","Type":"ContainerDied","Data":"eced51e8d1c6c4ce37923fb2d6d5995454c3af8f2ce296abf11ef917ae4851ca"}
Sep 11 15:33:10.326575 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.326260    2574 scope.go:117] "RemoveContainer" containerID="a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa"
Sep 11 15:33:10.338053 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.338031    2574 scope.go:117] "RemoveContainer" containerID="a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa"
Sep 11 15:33:10.338353 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:33:10.338330    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa\": container with ID starting with a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa not found: ID does not exist" containerID="a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa"
Sep 11 15:33:10.338428 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.338360    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa"} err="failed to get container status \"a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa\": rpc error: code = NotFound desc = could not find container \"a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa\": container with ID starting with a1a697823c44a7b45432687152f6e4849ac8b43a8887631f65f5a438d9ad46fa not found: ID does not exist"
Sep 11 15:33:10.349907 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.349884    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"]
Sep 11 15:33:10.356013 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:10.355993    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-63c85a-86d846cb78-82lx7"]
Sep 11 15:33:11.995050 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:11.995014    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4613dfe4-4462-4e82-939c-e0dc833198bb" path="/var/lib/kubelet/pods/4613dfe4-4462-4e82-939c-e0dc833198bb/volumes"
Sep 11 15:33:27.217475 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.217440    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"]
Sep 11 15:33:27.218013 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.217747    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr" podUID="ad406b9c-ec5d-4bd5-8b68-76f75f42fe76" containerName="maas-api" containerID="cri-o://8298ea37dfbd2b38c8922d3f8510f4dffb47c72ee767f52549570e15774f9c31" gracePeriod=30
Sep 11 15:33:27.424716 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.424685    2574 generic.go:356] "Generic (PLEG): container finished" podID="ad406b9c-ec5d-4bd5-8b68-76f75f42fe76" containerID="8298ea37dfbd2b38c8922d3f8510f4dffb47c72ee767f52549570e15774f9c31" exitCode=0
Sep 11 15:33:27.424875 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.424764    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr" event={"ID":"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76","Type":"ContainerDied","Data":"8298ea37dfbd2b38c8922d3f8510f4dffb47c72ee767f52549570e15774f9c31"}
Sep 11 15:33:27.481761 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.481707    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:33:27.545467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.545429    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-maas-api-tls\") pod \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") "
Sep 11 15:33:27.545701 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.545510    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n2hr\" (UniqueName: \"kubernetes.io/projected/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-kube-api-access-6n2hr\") pod \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") "
Sep 11 15:33:27.545701 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.545566    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-metrics-certs\") pod \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") "
Sep 11 15:33:27.545701 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.545661    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-openshift-service-ca\") pod \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\" (UID: \"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76\") "
Sep 11 15:33:27.546230 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.546196    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad406b9c-ec5d-4bd5-8b68-76f75f42fe76" (UID: "ad406b9c-ec5d-4bd5-8b68-76f75f42fe76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:33:27.548239 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.548205    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-kube-api-access-6n2hr" (OuterVolumeSpecName: "kube-api-access-6n2hr") pod "ad406b9c-ec5d-4bd5-8b68-76f75f42fe76" (UID: "ad406b9c-ec5d-4bd5-8b68-76f75f42fe76"). InnerVolumeSpecName "kube-api-access-6n2hr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:33:27.548355 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.548297    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ad406b9c-ec5d-4bd5-8b68-76f75f42fe76" (UID: "ad406b9c-ec5d-4bd5-8b68-76f75f42fe76"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:33:27.548425 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.548394    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad406b9c-ec5d-4bd5-8b68-76f75f42fe76" (UID: "ad406b9c-ec5d-4bd5-8b68-76f75f42fe76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:33:27.647139 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.647095    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n2hr\" (UniqueName: \"kubernetes.io/projected/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-kube-api-access-6n2hr\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:27.647139 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.647132    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:27.647139 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.647142    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-openshift-service-ca\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:27.647415 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:27.647151    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76-maas-api-tls\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:28.432084 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:28.432038    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr" event={"ID":"ad406b9c-ec5d-4bd5-8b68-76f75f42fe76","Type":"ContainerDied","Data":"ef1d3d4c0e27180cef9b814dcec403fc2f949c24041776840bc2cd003a1d65a1"}
Sep 11 15:33:28.432572 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:28.432123    2574 scope.go:117] "RemoveContainer" containerID="8298ea37dfbd2b38c8922d3f8510f4dffb47c72ee767f52549570e15774f9c31"
Sep 11 15:33:28.432572 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:28.432056    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"
Sep 11 15:33:28.453597 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:28.453573    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"]
Sep 11 15:33:28.455581 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:28.455560    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4a348b-5b58c68f4-9j2sr"]
Sep 11 15:33:28.667019 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:28.666978    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"]
Sep 11 15:33:29.994690 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:29.994656    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad406b9c-ec5d-4bd5-8b68-76f75f42fe76" path="/var/lib/kubelet/pods/ad406b9c-ec5d-4bd5-8b68-76f75f42fe76/volumes"
Sep 11 15:33:35.375801 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.375765    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"]
Sep 11 15:33:35.376571 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.376460    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad406b9c-ec5d-4bd5-8b68-76f75f42fe76" containerName="maas-api"
Sep 11 15:33:35.376571 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.376479    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad406b9c-ec5d-4bd5-8b68-76f75f42fe76" containerName="maas-api"
Sep 11 15:33:35.376571 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.376522    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c037ac35-b123-458a-b268-df49d9e17728" containerName="payload-pre-processing"
Sep 11 15:33:35.376571 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.376532    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c037ac35-b123-458a-b268-df49d9e17728" containerName="payload-pre-processing"
Sep 11 15:33:35.376571 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.376542    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4613dfe4-4462-4e82-939c-e0dc833198bb" containerName="maas-api"
Sep 11 15:33:35.376571 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.376551    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4613dfe4-4462-4e82-939c-e0dc833198bb" containerName="maas-api"
Sep 11 15:33:35.376831 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.376670    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad406b9c-ec5d-4bd5-8b68-76f75f42fe76" containerName="maas-api"
Sep 11 15:33:35.376831 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.376683    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c037ac35-b123-458a-b268-df49d9e17728" containerName="payload-pre-processing"
Sep 11 15:33:35.376831 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.376695    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4613dfe4-4462-4e82-939c-e0dc833198bb" containerName="maas-api"
Sep 11 15:33:35.381177 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.381156    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:35.383942 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.383916    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-8559ee-serving-cert\""
Sep 11 15:33:35.390758 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.390272    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"]
Sep 11 15:33:35.424906 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.424881    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:35.424906 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.424910    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p65fj\" (UniqueName: \"kubernetes.io/projected/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-kube-api-access-p65fj\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:35.425144 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.425012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-metrics-certs\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:35.425144 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.425058    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:35.526586 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.526542    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:35.526586 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.526581    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p65fj\" (UniqueName: \"kubernetes.io/projected/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-kube-api-access-p65fj\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:35.526881 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.526693    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-metrics-certs\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:35.526881 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:33:35.526731    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-serving-cert: secret "maas-api-e2e-ipp-a-8559ee-serving-cert" not found
Sep 11 15:33:35.526881 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.526744    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:35.526881 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:33:35.526799    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-maas-api-tls podName:28fa12aa-6054-4ef0-abeb-f2b452ffcc29 nodeName:}" failed. No retries permitted until 2026-09-11 15:33:36.026777598 +0000 UTC m=+1490.486494580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-maas-api-tls") pod "maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns" (UID: "28fa12aa-6054-4ef0-abeb-f2b452ffcc29") : secret "maas-api-e2e-ipp-a-8559ee-serving-cert" not found
Sep 11 15:33:35.527444 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.527420    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:35.529419 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.529393    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-metrics-certs\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:35.538462 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:35.538435    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p65fj\" (UniqueName: \"kubernetes.io/projected/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-kube-api-access-p65fj\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:36.032483 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:36.032449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:36.035077 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:36.035055    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:36.295942 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:36.295849    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:36.574292 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:36.574253    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"]
Sep 11 15:33:36.575938 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:33:36.575911    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28fa12aa_6054_4ef0_abeb_f2b452ffcc29.slice/crio-8cc8e9eeaee46b5de924e901416d78791957c4008d55641b1a173104cd04c265 WatchSource:0}: Error finding container 8cc8e9eeaee46b5de924e901416d78791957c4008d55641b1a173104cd04c265: Status 404 returned error can't find the container with id 8cc8e9eeaee46b5de924e901416d78791957c4008d55641b1a173104cd04c265
Sep 11 15:33:37.483824 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:37.483793    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns" event={"ID":"28fa12aa-6054-4ef0-abeb-f2b452ffcc29","Type":"ContainerStarted","Data":"509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b"}
Sep 11 15:33:37.484000 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:37.483853    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns" event={"ID":"28fa12aa-6054-4ef0-abeb-f2b452ffcc29","Type":"ContainerStarted","Data":"8cc8e9eeaee46b5de924e901416d78791957c4008d55641b1a173104cd04c265"}
Sep 11 15:33:37.484000 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:37.483967    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:37.500064 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:37.500012    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns" podStartSLOduration=2.075982035 podStartE2EDuration="2.499994219s" totalImagesPullingTime="424.012184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:33:37.498858555 +0000 UTC m=+1491.958575555" watchObservedRunningTime="2026-09-11 15:33:37.499994219 +0000 UTC m=+1491.959711260"
Sep 11 15:33:43.495371 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:43.495338    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:33:43.687776 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:43.687708    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw" podUID="4bb29288-4613-44a6-9fb3-2caebd63197f" containerName="main" containerID="cri-o://14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193" gracePeriod=45
Sep 11 15:33:43.941350 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:43.941325    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:33:44.012292 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.012261    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-model-cache\") pod \"4bb29288-4613-44a6-9fb3-2caebd63197f\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") "
Sep 11 15:33:44.012472 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.012342    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bb29288-4613-44a6-9fb3-2caebd63197f-tls-certs\") pod \"4bb29288-4613-44a6-9fb3-2caebd63197f\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") "
Sep 11 15:33:44.012472 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.012404    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-home\") pod \"4bb29288-4613-44a6-9fb3-2caebd63197f\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") "
Sep 11 15:33:44.012472 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.012423    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkshc\" (UniqueName: \"kubernetes.io/projected/4bb29288-4613-44a6-9fb3-2caebd63197f-kube-api-access-lkshc\") pod \"4bb29288-4613-44a6-9fb3-2caebd63197f\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") "
Sep 11 15:33:44.012472 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.012458    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-tmp-dir\") pod \"4bb29288-4613-44a6-9fb3-2caebd63197f\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") "
Sep 11 15:33:44.012472 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.012473    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-dshm\") pod \"4bb29288-4613-44a6-9fb3-2caebd63197f\" (UID: \"4bb29288-4613-44a6-9fb3-2caebd63197f\") "
Sep 11 15:33:44.012778 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.012559    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-model-cache" (OuterVolumeSpecName: "model-cache") pod "4bb29288-4613-44a6-9fb3-2caebd63197f" (UID: "4bb29288-4613-44a6-9fb3-2caebd63197f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:33:44.012778 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.012763    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-home" (OuterVolumeSpecName: "home") pod "4bb29288-4613-44a6-9fb3-2caebd63197f" (UID: "4bb29288-4613-44a6-9fb3-2caebd63197f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:33:44.012876 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.012777    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4bb29288-4613-44a6-9fb3-2caebd63197f" (UID: "4bb29288-4613-44a6-9fb3-2caebd63197f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:33:44.012876 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.012831    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-model-cache\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:44.014668 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.014648    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bb29288-4613-44a6-9fb3-2caebd63197f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4bb29288-4613-44a6-9fb3-2caebd63197f" (UID: "4bb29288-4613-44a6-9fb3-2caebd63197f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:33:44.014750 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.014674    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-dshm" (OuterVolumeSpecName: "dshm") pod "4bb29288-4613-44a6-9fb3-2caebd63197f" (UID: "4bb29288-4613-44a6-9fb3-2caebd63197f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:33:44.014805 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.014769    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bb29288-4613-44a6-9fb3-2caebd63197f-kube-api-access-lkshc" (OuterVolumeSpecName: "kube-api-access-lkshc") pod "4bb29288-4613-44a6-9fb3-2caebd63197f" (UID: "4bb29288-4613-44a6-9fb3-2caebd63197f"). InnerVolumeSpecName "kube-api-access-lkshc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:33:44.114132 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.114100    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-home\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:44.114132 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.114131    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkshc\" (UniqueName: \"kubernetes.io/projected/4bb29288-4613-44a6-9fb3-2caebd63197f-kube-api-access-lkshc\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:44.114334 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.114145    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-tmp-dir\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:44.114334 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.114157    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bb29288-4613-44a6-9fb3-2caebd63197f-dshm\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:44.114334 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.114167    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bb29288-4613-44a6-9fb3-2caebd63197f-tls-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:44.523401 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.523308    2574 generic.go:356] "Generic (PLEG): container finished" podID="4bb29288-4613-44a6-9fb3-2caebd63197f" containerID="14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193" exitCode=0
Sep 11 15:33:44.523401 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.523359    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"
Sep 11 15:33:44.523875 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.523394    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw" event={"ID":"4bb29288-4613-44a6-9fb3-2caebd63197f","Type":"ContainerDied","Data":"14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193"}
Sep 11 15:33:44.523875 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.523441    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw" event={"ID":"4bb29288-4613-44a6-9fb3-2caebd63197f","Type":"ContainerDied","Data":"7d4721149c2f901eabbde3d0726e83511bca8e9ed9314428c09e1d3f03e6531d"}
Sep 11 15:33:44.523875 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.523459    2574 scope.go:117] "RemoveContainer" containerID="14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193"
Sep 11 15:33:44.534185 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.534165    2574 scope.go:117] "RemoveContainer" containerID="14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193"
Sep 11 15:33:44.534528 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:33:44.534503    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193\": container with ID starting with 14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193 not found: ID does not exist" containerID="14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193"
Sep 11 15:33:44.534579 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.534542    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193"} err="failed to get container status \"14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193\": rpc error: code = NotFound desc = could not find container \"14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193\": container with ID starting with 14a3ba5d552d1a0e399f2aac5e7f5d45e7debedb7679c10ffae5d1a47ae67193 not found: ID does not exist"
Sep 11 15:33:44.545751 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.545719    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"]
Sep 11 15:33:44.549317 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:44.549292    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abba31/rate-test-model-abba31-kserve-6d84c56d99-tsrfw"]
Sep 11 15:33:45.352501 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:45.352469    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"]
Sep 11 15:33:45.352743 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:45.352715    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p" podUID="99549aef-174e-490d-9643-d36371cbcc95" containerName="payload-processing" containerID="cri-o://8d890b2dff1aeb47e553e75307cd2627ec2263a2c3c3bf76c33a9321b05208ef" gracePeriod=30
Sep 11 15:33:45.538471 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:45.538443    2574 generic.go:356] "Generic (PLEG): container finished" podID="99549aef-174e-490d-9643-d36371cbcc95" containerID="8d890b2dff1aeb47e553e75307cd2627ec2263a2c3c3bf76c33a9321b05208ef" exitCode=0
Sep 11 15:33:45.538893 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:45.538516    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p" event={"ID":"99549aef-174e-490d-9643-d36371cbcc95","Type":"ContainerDied","Data":"8d890b2dff1aeb47e553e75307cd2627ec2263a2c3c3bf76c33a9321b05208ef"}
Sep 11 15:33:45.617184 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:45.617162    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"
Sep 11 15:33:45.732881 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:45.732845    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99549aef-174e-490d-9643-d36371cbcc95-plugins-config-volume\") pod \"99549aef-174e-490d-9643-d36371cbcc95\" (UID: \"99549aef-174e-490d-9643-d36371cbcc95\") "
Sep 11 15:33:45.733069 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:45.732888    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc9kt\" (UniqueName: \"kubernetes.io/projected/99549aef-174e-490d-9643-d36371cbcc95-kube-api-access-sc9kt\") pod \"99549aef-174e-490d-9643-d36371cbcc95\" (UID: \"99549aef-174e-490d-9643-d36371cbcc95\") "
Sep 11 15:33:45.733236 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:45.733213    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99549aef-174e-490d-9643-d36371cbcc95-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "99549aef-174e-490d-9643-d36371cbcc95" (UID: "99549aef-174e-490d-9643-d36371cbcc95"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:33:45.735360 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:45.735325    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99549aef-174e-490d-9643-d36371cbcc95-kube-api-access-sc9kt" (OuterVolumeSpecName: "kube-api-access-sc9kt") pod "99549aef-174e-490d-9643-d36371cbcc95" (UID: "99549aef-174e-490d-9643-d36371cbcc95"). InnerVolumeSpecName "kube-api-access-sc9kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:33:45.834595 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:45.834562    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99549aef-174e-490d-9643-d36371cbcc95-plugins-config-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:45.834595 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:45.834592    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc9kt\" (UniqueName: \"kubernetes.io/projected/99549aef-174e-490d-9643-d36371cbcc95-kube-api-access-sc9kt\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:45.996025 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:45.995948    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bb29288-4613-44a6-9fb3-2caebd63197f" path="/var/lib/kubelet/pods/4bb29288-4613-44a6-9fb3-2caebd63197f/volumes"
Sep 11 15:33:46.148465 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:46.148427    2574 scope.go:117] "RemoveContainer" containerID="8d890b2dff1aeb47e553e75307cd2627ec2263a2c3c3bf76c33a9321b05208ef"
Sep 11 15:33:46.549291 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:46.549250    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p" event={"ID":"99549aef-174e-490d-9643-d36371cbcc95","Type":"ContainerDied","Data":"0f02d91d28771e8087e21a06159966092acb5f79cdf84881cdfbd3aee97f0af3"}
Sep 11 15:33:46.549791 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:46.549265    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"
Sep 11 15:33:46.582628 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:46.582569    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"]
Sep 11 15:33:46.587553 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:46.587515    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7ee57f-89fbbbc7-wvg2p"]
Sep 11 15:33:47.995325 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:47.995294    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99549aef-174e-490d-9643-d36371cbcc95" path="/var/lib/kubelet/pods/99549aef-174e-490d-9643-d36371cbcc95/volumes"
Sep 11 15:33:52.413350 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:52.413315    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"]
Sep 11 15:33:52.413810 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:52.413580    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy" containerID="cri-o://16c17f4a6590d1c8d4486eb53e42de4382006fd737b08bd3c767f55371eff4ba" gracePeriod=30
Sep 11 15:33:52.857350 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:52.857267    2574 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 15:33:52.857500 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:52.857349    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 15:33:57.610985 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.610955    2574 generic.go:356] "Generic (PLEG): container finished" podID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerID="16c17f4a6590d1c8d4486eb53e42de4382006fd737b08bd3c767f55371eff4ba" exitCode=0
Sep 11 15:33:57.611451 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.611032    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" event={"ID":"37306187-64bb-4c18-b2d4-d48e0526bec8","Type":"ContainerDied","Data":"16c17f4a6590d1c8d4486eb53e42de4382006fd737b08bd3c767f55371eff4ba"}
Sep 11 15:33:57.611451 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.611103    2574 scope.go:117] "RemoveContainer" containerID="0969af36247d8957d901be955529c5e00faf711610e741f5b9f9a82fd453bfef"
Sep 11 15:33:57.676137 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.676076    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:33:57.755402 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.755369    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-envoy\") pod \"37306187-64bb-4c18-b2d4-d48e0526bec8\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") "
Sep 11 15:33:57.755402 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.755406    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-podinfo\") pod \"37306187-64bb-4c18-b2d4-d48e0526bec8\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") "
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.755424    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-token\") pod \"37306187-64bb-4c18-b2d4-d48e0526bec8\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") "
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.755451    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37306187-64bb-4c18-b2d4-d48e0526bec8-istiod-ca-cert\") pod \"37306187-64bb-4c18-b2d4-d48e0526bec8\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") "
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.755509    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-data\") pod \"37306187-64bb-4c18-b2d4-d48e0526bec8\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") "
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.755542    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-workload-certs\") pod \"37306187-64bb-4c18-b2d4-d48e0526bec8\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") "
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.755674    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-workload-socket\") pod \"37306187-64bb-4c18-b2d4-d48e0526bec8\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") "
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.755720    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5jdj\" (UniqueName: \"kubernetes.io/projected/37306187-64bb-4c18-b2d4-d48e0526bec8-kube-api-access-n5jdj\") pod \"37306187-64bb-4c18-b2d4-d48e0526bec8\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") "
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.755747    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-credential-socket\") pod \"37306187-64bb-4c18-b2d4-d48e0526bec8\" (UID: \"37306187-64bb-4c18-b2d4-d48e0526bec8\") "
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.756051    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37306187-64bb-4c18-b2d4-d48e0526bec8" (UID: "37306187-64bb-4c18-b2d4-d48e0526bec8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.756081    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37306187-64bb-4c18-b2d4-d48e0526bec8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37306187-64bb-4c18-b2d4-d48e0526bec8" (UID: "37306187-64bb-4c18-b2d4-d48e0526bec8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.756250    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37306187-64bb-4c18-b2d4-d48e0526bec8-istiod-ca-cert\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.756268    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-workload-socket\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.756274    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37306187-64bb-4c18-b2d4-d48e0526bec8" (UID: "37306187-64bb-4c18-b2d4-d48e0526bec8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:33:57.756457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.756423    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-data" (OuterVolumeSpecName: "istio-data") pod "37306187-64bb-4c18-b2d4-d48e0526bec8" (UID: "37306187-64bb-4c18-b2d4-d48e0526bec8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:33:57.757393 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.756545    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37306187-64bb-4c18-b2d4-d48e0526bec8" (UID: "37306187-64bb-4c18-b2d4-d48e0526bec8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:33:57.758047 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.758008    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37306187-64bb-4c18-b2d4-d48e0526bec8" (UID: "37306187-64bb-4c18-b2d4-d48e0526bec8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 15:33:57.758416 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.758391    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37306187-64bb-4c18-b2d4-d48e0526bec8" (UID: "37306187-64bb-4c18-b2d4-d48e0526bec8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:33:57.758527 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.758485    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-token" (OuterVolumeSpecName: "istio-token") pod "37306187-64bb-4c18-b2d4-d48e0526bec8" (UID: "37306187-64bb-4c18-b2d4-d48e0526bec8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:33:57.758607 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.758589    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37306187-64bb-4c18-b2d4-d48e0526bec8-kube-api-access-n5jdj" (OuterVolumeSpecName: "kube-api-access-n5jdj") pod "37306187-64bb-4c18-b2d4-d48e0526bec8" (UID: "37306187-64bb-4c18-b2d4-d48e0526bec8"). InnerVolumeSpecName "kube-api-access-n5jdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:33:57.856945 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.856907    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5jdj\" (UniqueName: \"kubernetes.io/projected/37306187-64bb-4c18-b2d4-d48e0526bec8-kube-api-access-n5jdj\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:57.856945 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.856938    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-credential-socket\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:57.856945 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.856947    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-envoy\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:57.857176 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.856957    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-podinfo\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:57.857176 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.856964    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-token\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:57.857176 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.856973    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-istio-data\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:57.857176 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:57.856980    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37306187-64bb-4c18-b2d4-d48e0526bec8-workload-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:33:58.617817 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:58.617790    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"
Sep 11 15:33:58.618229 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:58.617820    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh" event={"ID":"37306187-64bb-4c18-b2d4-d48e0526bec8","Type":"ContainerDied","Data":"76d6322f199c33192492d1fb7f1c7a85f4879ecf6945bad12af740ff654bad42"}
Sep 11 15:33:58.618229 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:58.617880    2574 scope.go:117] "RemoveContainer" containerID="16c17f4a6590d1c8d4486eb53e42de4382006fd737b08bd3c767f55371eff4ba"
Sep 11 15:33:58.635034 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:58.635005    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"]
Sep 11 15:33:58.641664 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:58.641606    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7ee57f-openshift-default-659494d7db-qftkh"]
Sep 11 15:33:59.284981 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.284948    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"]
Sep 11 15:33:59.285591 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.285570    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy"
Sep 11 15:33:59.285659 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.285596    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy"
Sep 11 15:33:59.285659 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.285627    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99549aef-174e-490d-9643-d36371cbcc95" containerName="payload-processing"
Sep 11 15:33:59.285659 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.285637    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="99549aef-174e-490d-9643-d36371cbcc95" containerName="payload-processing"
Sep 11 15:33:59.285770 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.285677    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy"
Sep 11 15:33:59.285770 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.285686    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy"
Sep 11 15:33:59.285770 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.285701    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bb29288-4613-44a6-9fb3-2caebd63197f" containerName="main"
Sep 11 15:33:59.285770 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.285708    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bb29288-4613-44a6-9fb3-2caebd63197f" containerName="main"
Sep 11 15:33:59.285889 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.285824    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bb29288-4613-44a6-9fb3-2caebd63197f" containerName="main"
Sep 11 15:33:59.285889 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.285837    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="99549aef-174e-490d-9643-d36371cbcc95" containerName="payload-processing"
Sep 11 15:33:59.285889 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.285848    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy"
Sep 11 15:33:59.285889 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.285858    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" containerName="istio-proxy"
Sep 11 15:33:59.290826 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.290802    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.293206 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.293177    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-0ce6e9-serving-cert\""
Sep 11 15:33:59.298132 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.298110    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"]
Sep 11 15:33:59.370467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.370439    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37fa928-a0e0-4a46-ab0c-707750e81c98-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.370677 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.370512    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.370677 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.370582    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9dmf\" (UniqueName: \"kubernetes.io/projected/b37fa928-a0e0-4a46-ab0c-707750e81c98-kube-api-access-t9dmf\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.370677 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.370662    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-metrics-certs\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.471417 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.471375    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9dmf\" (UniqueName: \"kubernetes.io/projected/b37fa928-a0e0-4a46-ab0c-707750e81c98-kube-api-access-t9dmf\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.471665 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.471428    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-metrics-certs\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.471665 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.471475    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37fa928-a0e0-4a46-ab0c-707750e81c98-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.471665 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.471535    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.471855 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:33:59.471722    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-serving-cert: secret "maas-api-e2e-ipp-b-0ce6e9-serving-cert" not found
Sep 11 15:33:59.471855 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:33:59.471800    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-maas-api-tls podName:b37fa928-a0e0-4a46-ab0c-707750e81c98 nodeName:}" failed. No retries permitted until 2026-09-11 15:33:59.971777549 +0000 UTC m=+1514.431494548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-maas-api-tls") pod "maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr" (UID: "b37fa928-a0e0-4a46-ab0c-707750e81c98") : secret "maas-api-e2e-ipp-b-0ce6e9-serving-cert" not found
Sep 11 15:33:59.472186 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.472164    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37fa928-a0e0-4a46-ab0c-707750e81c98-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.474200 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.474182    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-metrics-certs\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.481894 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.481869    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9dmf\" (UniqueName: \"kubernetes.io/projected/b37fa928-a0e0-4a46-ab0c-707750e81c98-kube-api-access-t9dmf\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.884250 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.884209    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"]
Sep 11 15:33:59.887802 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.887783    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"
Sep 11 15:33:59.890015 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.889992    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-0ce6e9\""
Sep 11 15:33:59.890167 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.890150    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-0ce6e9-dockercfg-dx766\""
Sep 11 15:33:59.897880 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.897853    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"]
Sep 11 15:33:59.976920 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.976879    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26\" (UID: \"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"
Sep 11 15:33:59.977099 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.976945    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.977099 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.977056    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pbks\" (UniqueName: \"kubernetes.io/projected/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4-kube-api-access-5pbks\") pod \"payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26\" (UID: \"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"
Sep 11 15:33:59.980234 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.980204    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:33:59.997330 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:33:59.997293    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37306187-64bb-4c18-b2d4-d48e0526bec8" path="/var/lib/kubelet/pods/37306187-64bb-4c18-b2d4-d48e0526bec8/volumes"
Sep 11 15:34:00.078199 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.078164    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pbks\" (UniqueName: \"kubernetes.io/projected/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4-kube-api-access-5pbks\") pod \"payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26\" (UID: \"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"
Sep 11 15:34:00.078388 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.078221    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26\" (UID: \"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"
Sep 11 15:34:00.078934 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.078910    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26\" (UID: \"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"
Sep 11 15:34:00.086260 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.086238    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pbks\" (UniqueName: \"kubernetes.io/projected/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4-kube-api-access-5pbks\") pod \"payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26\" (UID: \"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"
Sep 11 15:34:00.199991 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.199895    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"
Sep 11 15:34:00.205265 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.205242    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:34:00.481407 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.481269    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"]
Sep 11 15:34:00.485374 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.484717    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"]
Sep 11 15:34:00.485374 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:34:00.485308    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad05d733_c8b0_4eac_8735_ab3f7c4f02f4.slice/crio-af4b1ab17784eff36b8e737b1eea9c097b1cfda63fbfdc8f9138d5709fd51850 WatchSource:0}: Error finding container af4b1ab17784eff36b8e737b1eea9c097b1cfda63fbfdc8f9138d5709fd51850: Status 404 returned error can't find the container with id af4b1ab17784eff36b8e737b1eea9c097b1cfda63fbfdc8f9138d5709fd51850
Sep 11 15:34:00.632074 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.631984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr" event={"ID":"b37fa928-a0e0-4a46-ab0c-707750e81c98","Type":"ContainerStarted","Data":"ed3aa06cad1522d4ecf7e76025e4101cc64c01692dececef0e36c5994a2275e9"}
Sep 11 15:34:00.633847 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.633815    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26" event={"ID":"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4","Type":"ContainerStarted","Data":"9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008"}
Sep 11 15:34:00.634008 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.633873    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26" event={"ID":"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4","Type":"ContainerStarted","Data":"af4b1ab17784eff36b8e737b1eea9c097b1cfda63fbfdc8f9138d5709fd51850"}
Sep 11 15:34:00.634008 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.633919    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"
Sep 11 15:34:00.651019 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:00.650969    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26" podStartSLOduration=1.6509555 podStartE2EDuration="1.6509555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:33:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:34:00.649128224 +0000 UTC m=+1515.108845224" watchObservedRunningTime="2026-09-11 15:34:00.6509555 +0000 UTC m=+1515.110672500"
Sep 11 15:34:01.641079 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:01.641032    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr" event={"ID":"b37fa928-a0e0-4a46-ab0c-707750e81c98","Type":"ContainerStarted","Data":"1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61"}
Sep 11 15:34:01.641659 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:01.641319    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:34:01.657999 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:01.657948    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr" podStartSLOduration=2.314201631 podStartE2EDuration="2.65793175s" totalImagesPullingTime="343.730119ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:34:01.657140942 +0000 UTC m=+1516.116857968" watchObservedRunningTime="2026-09-11 15:34:01.65793175 +0000 UTC m=+1516.117648749"
Sep 11 15:34:07.651736 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:07.651660    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:34:11.643181 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:11.643145    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"
Sep 11 15:34:26.668641 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:26.668590    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jdnwd_1efdddb6-ee3c-4f1a-8474-2dc38031e665/payload-processing/0.log"
Sep 11 15:34:59.404843 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:34:59.404809    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jdnwd_1efdddb6-ee3c-4f1a-8474-2dc38031e665/payload-processing/0.log"
Sep 11 15:35:00.054303 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.054268    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"]
Sep 11 15:35:00.059100 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.059070    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.061554 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.061530    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-f58c81-openshift-default-dockercfg-crmsl\""
Sep 11 15:35:00.069706 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.069594    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"]
Sep 11 15:35:00.139839 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.139799    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-token\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.140038 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.139855    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/130be396-7b4c-4af4-8ccb-cec9aae83568-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.140038 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.139974    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8t8l\" (UniqueName: \"kubernetes.io/projected/130be396-7b4c-4af4-8ccb-cec9aae83568-kube-api-access-s8t8l\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.140140 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.140111    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-envoy\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.140192 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.140178    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-credential-socket\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.140262 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.140212    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-podinfo\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.140355 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.140338    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-workload-certs\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.140760 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.140739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-data\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.140889 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.140783    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-workload-socket\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242012 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.241976    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-workload-certs\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242035    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-data\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-workload-socket\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242091    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-token\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242123    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/130be396-7b4c-4af4-8ccb-cec9aae83568-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242182 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242163    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8t8l\" (UniqueName: \"kubernetes.io/projected/130be396-7b4c-4af4-8ccb-cec9aae83568-kube-api-access-s8t8l\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242660 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242190    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-envoy\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242660 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242218    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-credential-socket\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242660 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242383    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-podinfo\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242660 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242448    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-workload-certs\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242660 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242484    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-workload-socket\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242660 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242572    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-credential-socket\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242982 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242704    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-data\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.242982 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.242883    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/130be396-7b4c-4af4-8ccb-cec9aae83568-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.244653 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.244633    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-envoy\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.244925 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.244909    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-podinfo\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.250163 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.250138    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8t8l\" (UniqueName: \"kubernetes.io/projected/130be396-7b4c-4af4-8ccb-cec9aae83568-kube-api-access-s8t8l\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.250336 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.250318    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-token\") pod \"e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") " pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.371147 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.371086    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:00.643905 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.643823    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"]
Sep 11 15:35:00.654780 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.654744    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:35:00.654901 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.654821    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:35:00.654901 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.654862    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:35:00.948676 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.948569    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" event={"ID":"130be396-7b4c-4af4-8ccb-cec9aae83568","Type":"ContainerStarted","Data":"d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318"}
Sep 11 15:35:00.948845 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.948692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" event={"ID":"130be396-7b4c-4af4-8ccb-cec9aae83568","Type":"ContainerStarted","Data":"8d1007a8a7fe7e0b1614a8c268a57c7c10e68a1cfda432c42e39ee5022b2f159"}
Sep 11 15:35:00.967921 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:00.967868    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" podStartSLOduration=0.967854212 podStartE2EDuration="967.854212ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:35:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:35:00.966512996 +0000 UTC m=+1575.426229995" watchObservedRunningTime="2026-09-11 15:35:00.967854212 +0000 UTC m=+1575.427571212"
Sep 11 15:35:01.372145 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:01.372109    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:01.377945 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:01.377918    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:01.954102 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:01.954073    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:01.955647 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:01.955621    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:06.536006 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:06.535973    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"]
Sep 11 15:35:06.539947 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:06.539922    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"
Sep 11 15:35:06.542373 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:06.542350    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-f58c81-dockercfg-f4jnv\""
Sep 11 15:35:06.542502 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:06.542456    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-f58c81\""
Sep 11 15:35:06.550779 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:06.550753    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"]
Sep 11 15:35:06.705663 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:06.705594    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ef6fc24-4703-4508-9e5a-70c526fb7d16-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f\" (UID: \"9ef6fc24-4703-4508-9e5a-70c526fb7d16\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"
Sep 11 15:35:06.705837 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:06.705689    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn9vj\" (UniqueName: \"kubernetes.io/projected/9ef6fc24-4703-4508-9e5a-70c526fb7d16-kube-api-access-dn9vj\") pod \"payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f\" (UID: \"9ef6fc24-4703-4508-9e5a-70c526fb7d16\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"
Sep 11 15:35:06.806478 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:06.806378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn9vj\" (UniqueName: \"kubernetes.io/projected/9ef6fc24-4703-4508-9e5a-70c526fb7d16-kube-api-access-dn9vj\") pod \"payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f\" (UID: \"9ef6fc24-4703-4508-9e5a-70c526fb7d16\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"
Sep 11 15:35:06.806685 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:06.806533    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ef6fc24-4703-4508-9e5a-70c526fb7d16-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f\" (UID: \"9ef6fc24-4703-4508-9e5a-70c526fb7d16\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"
Sep 11 15:35:06.807248 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:06.807228    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ef6fc24-4703-4508-9e5a-70c526fb7d16-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f\" (UID: \"9ef6fc24-4703-4508-9e5a-70c526fb7d16\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"
Sep 11 15:35:06.814309 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:06.814283    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn9vj\" (UniqueName: \"kubernetes.io/projected/9ef6fc24-4703-4508-9e5a-70c526fb7d16-kube-api-access-dn9vj\") pod \"payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f\" (UID: \"9ef6fc24-4703-4508-9e5a-70c526fb7d16\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"
Sep 11 15:35:06.854398 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:06.854371    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"
Sep 11 15:35:07.128249 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:07.128132    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"]
Sep 11 15:35:07.130136 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:35:07.130091    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef6fc24_4703_4508_9e5a_70c526fb7d16.slice/crio-26be3ceb8cedf2b21f0885e36925baf5a420e397d168856ca0d67be51a427e48 WatchSource:0}: Error finding container 26be3ceb8cedf2b21f0885e36925baf5a420e397d168856ca0d67be51a427e48: Status 404 returned error can't find the container with id 26be3ceb8cedf2b21f0885e36925baf5a420e397d168856ca0d67be51a427e48
Sep 11 15:35:07.994752 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:07.994721    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"
Sep 11 15:35:07.995152 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:07.994766    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f" event={"ID":"9ef6fc24-4703-4508-9e5a-70c526fb7d16","Type":"ContainerStarted","Data":"bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412"}
Sep 11 15:35:07.995152 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:07.994785    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f" event={"ID":"9ef6fc24-4703-4508-9e5a-70c526fb7d16","Type":"ContainerStarted","Data":"26be3ceb8cedf2b21f0885e36925baf5a420e397d168856ca0d67be51a427e48"}
Sep 11 15:35:08.005304 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:08.005252    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f" podStartSLOduration=2.005234479 podStartE2EDuration="2.005234479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:35:08.004759437 +0000 UTC m=+1582.464476435" watchObservedRunningTime="2026-09-11 15:35:08.005234479 +0000 UTC m=+1582.464951479"
Sep 11 15:35:18.996807 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:18.996775    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"
Sep 11 15:35:21.071371 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:21.071286    2574 generic.go:356] "Generic (PLEG): container finished" podID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerID="d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318" exitCode=0
Sep 11 15:35:21.071371 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:21.071360    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" event={"ID":"130be396-7b4c-4af4-8ccb-cec9aae83568","Type":"ContainerDied","Data":"d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318"}
Sep 11 15:35:21.071900 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:21.071772    2574 scope.go:117] "RemoveContainer" containerID="d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318"
Sep 11 15:35:21.072902 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:21.072876    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:35:21.072980 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:21.072942    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:35:21.072980 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:21.072975    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 15:35:22.079453 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:22.079414    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" event={"ID":"130be396-7b4c-4af4-8ccb-cec9aae83568","Type":"ContainerStarted","Data":"18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9"}
Sep 11 15:35:22.371925 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:22.371892    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:22.372145 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:22.372122    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 15:35:22.372252 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:22.372179    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 15:35:23.372371 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:23.372332    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 15:35:23.372814 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:23.372394    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 15:35:24.371681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:24.371645    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 15:35:24.371864 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:24.371700    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 15:35:25.372007 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:25.371966    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 15:35:25.372407 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:25.372023    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 15:35:26.372323 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:26.372287    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 15:35:26.372711 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:26.372342    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 15:35:27.375321 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:27.375290    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:27.375795 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:27.375674    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:27.376353 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:27.376333    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:44.733045 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:44.732970    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"]
Sep 11 15:35:44.733511 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:44.733178    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f" podUID="9ef6fc24-4703-4508-9e5a-70c526fb7d16" containerName="payload-processing" containerID="cri-o://bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412" gracePeriod=30
Sep 11 15:35:44.993151 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:44.993083    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"
Sep 11 15:35:45.078919 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.078888    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ef6fc24-4703-4508-9e5a-70c526fb7d16-plugins-config-volume\") pod \"9ef6fc24-4703-4508-9e5a-70c526fb7d16\" (UID: \"9ef6fc24-4703-4508-9e5a-70c526fb7d16\") "
Sep 11 15:35:45.079081 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.078987    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn9vj\" (UniqueName: \"kubernetes.io/projected/9ef6fc24-4703-4508-9e5a-70c526fb7d16-kube-api-access-dn9vj\") pod \"9ef6fc24-4703-4508-9e5a-70c526fb7d16\" (UID: \"9ef6fc24-4703-4508-9e5a-70c526fb7d16\") "
Sep 11 15:35:45.079322 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.079302    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ef6fc24-4703-4508-9e5a-70c526fb7d16-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ef6fc24-4703-4508-9e5a-70c526fb7d16" (UID: "9ef6fc24-4703-4508-9e5a-70c526fb7d16"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:35:45.081239 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.081219    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ef6fc24-4703-4508-9e5a-70c526fb7d16-kube-api-access-dn9vj" (OuterVolumeSpecName: "kube-api-access-dn9vj") pod "9ef6fc24-4703-4508-9e5a-70c526fb7d16" (UID: "9ef6fc24-4703-4508-9e5a-70c526fb7d16"). InnerVolumeSpecName "kube-api-access-dn9vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:35:45.180764 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.180736    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ef6fc24-4703-4508-9e5a-70c526fb7d16-plugins-config-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:35:45.180764 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.180763    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn9vj\" (UniqueName: \"kubernetes.io/projected/9ef6fc24-4703-4508-9e5a-70c526fb7d16-kube-api-access-dn9vj\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:35:45.203267 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.203230    2574 generic.go:356] "Generic (PLEG): container finished" podID="9ef6fc24-4703-4508-9e5a-70c526fb7d16" containerID="bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412" exitCode=0
Sep 11 15:35:45.203419 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.203278    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"
Sep 11 15:35:45.203419 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.203327    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f" event={"ID":"9ef6fc24-4703-4508-9e5a-70c526fb7d16","Type":"ContainerDied","Data":"bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412"}
Sep 11 15:35:45.203419 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.203381    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f" event={"ID":"9ef6fc24-4703-4508-9e5a-70c526fb7d16","Type":"ContainerDied","Data":"26be3ceb8cedf2b21f0885e36925baf5a420e397d168856ca0d67be51a427e48"}
Sep 11 15:35:45.203419 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.203404    2574 scope.go:117] "RemoveContainer" containerID="bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412"
Sep 11 15:35:45.214458 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.214436    2574 scope.go:117] "RemoveContainer" containerID="bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412"
Sep 11 15:35:45.214920 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:35:45.214895    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412\": container with ID starting with bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412 not found: ID does not exist" containerID="bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412"
Sep 11 15:35:45.214998 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.214930    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412"} err="failed to get container status \"bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412\": rpc error: code = NotFound desc = could not find container \"bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412\": container with ID starting with bf860f78e0a15b18133a013dee04560e3f9df0a46918d41940711733ce848412 not found: ID does not exist"
Sep 11 15:35:45.229208 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.229161    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"]
Sep 11 15:35:45.237108 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.237079    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f58c81-6b45895489-h7m4f"]
Sep 11 15:35:45.994312 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:45.994278    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ef6fc24-4703-4508-9e5a-70c526fb7d16" path="/var/lib/kubelet/pods/9ef6fc24-4703-4508-9e5a-70c526fb7d16/volumes"
Sep 11 15:35:51.268334 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:51.268302    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"]
Sep 11 15:35:51.268760 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:51.268572    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerName="istio-proxy" containerID="cri-o://18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9" gracePeriod=30
Sep 11 15:35:56.536294 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.536219    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:56.689954 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.689924    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8t8l\" (UniqueName: \"kubernetes.io/projected/130be396-7b4c-4af4-8ccb-cec9aae83568-kube-api-access-s8t8l\") pod \"130be396-7b4c-4af4-8ccb-cec9aae83568\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") "
Sep 11 15:35:56.690110 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.689969    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-token\") pod \"130be396-7b4c-4af4-8ccb-cec9aae83568\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") "
Sep 11 15:35:56.690110 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.689992    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-podinfo\") pod \"130be396-7b4c-4af4-8ccb-cec9aae83568\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") "
Sep 11 15:35:56.690110 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.690033    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-workload-certs\") pod \"130be396-7b4c-4af4-8ccb-cec9aae83568\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") "
Sep 11 15:35:56.690210 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.690175    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-data\") pod \"130be396-7b4c-4af4-8ccb-cec9aae83568\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") "
Sep 11 15:35:56.690277 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.690254    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/130be396-7b4c-4af4-8ccb-cec9aae83568-istiod-ca-cert\") pod \"130be396-7b4c-4af4-8ccb-cec9aae83568\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") "
Sep 11 15:35:56.690334 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.690296    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "130be396-7b4c-4af4-8ccb-cec9aae83568" (UID: "130be396-7b4c-4af4-8ccb-cec9aae83568"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:35:56.690334 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.690311    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-envoy\") pod \"130be396-7b4c-4af4-8ccb-cec9aae83568\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") "
Sep 11 15:35:56.690431 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.690359    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-credential-socket\") pod \"130be396-7b4c-4af4-8ccb-cec9aae83568\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") "
Sep 11 15:35:56.690431 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.690404    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-workload-socket\") pod \"130be396-7b4c-4af4-8ccb-cec9aae83568\" (UID: \"130be396-7b4c-4af4-8ccb-cec9aae83568\") "
Sep 11 15:35:56.690685 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.690560    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/130be396-7b4c-4af4-8ccb-cec9aae83568-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "130be396-7b4c-4af4-8ccb-cec9aae83568" (UID: "130be396-7b4c-4af4-8ccb-cec9aae83568"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:35:56.690902 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.690608    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "130be396-7b4c-4af4-8ccb-cec9aae83568" (UID: "130be396-7b4c-4af4-8ccb-cec9aae83568"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:35:56.690902 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.690748    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-data" (OuterVolumeSpecName: "istio-data") pod "130be396-7b4c-4af4-8ccb-cec9aae83568" (UID: "130be396-7b4c-4af4-8ccb-cec9aae83568"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:35:56.690902 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.690766    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-workload-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:35:56.691091 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.690812    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "130be396-7b4c-4af4-8ccb-cec9aae83568" (UID: "130be396-7b4c-4af4-8ccb-cec9aae83568"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:35:56.692481 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.692459    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "130be396-7b4c-4af4-8ccb-cec9aae83568" (UID: "130be396-7b4c-4af4-8ccb-cec9aae83568"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 15:35:56.692673 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.692651    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "130be396-7b4c-4af4-8ccb-cec9aae83568" (UID: "130be396-7b4c-4af4-8ccb-cec9aae83568"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:35:56.692939 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.692916    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/130be396-7b4c-4af4-8ccb-cec9aae83568-kube-api-access-s8t8l" (OuterVolumeSpecName: "kube-api-access-s8t8l") pod "130be396-7b4c-4af4-8ccb-cec9aae83568" (UID: "130be396-7b4c-4af4-8ccb-cec9aae83568"). InnerVolumeSpecName "kube-api-access-s8t8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:35:56.693045 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.693026    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-token" (OuterVolumeSpecName: "istio-token") pod "130be396-7b4c-4af4-8ccb-cec9aae83568" (UID: "130be396-7b4c-4af4-8ccb-cec9aae83568"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:35:56.791688 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.791585    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/130be396-7b4c-4af4-8ccb-cec9aae83568-istiod-ca-cert\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:35:56.791688 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.791635    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-envoy\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:35:56.791688 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.791645    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-credential-socket\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:35:56.791688 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.791654    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-workload-socket\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:35:56.791688 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.791663    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8t8l\" (UniqueName: \"kubernetes.io/projected/130be396-7b4c-4af4-8ccb-cec9aae83568-kube-api-access-s8t8l\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:35:56.791688 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.791673    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-token\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:35:56.791688 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.791681    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-podinfo\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:35:56.791688 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:56.791689    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/130be396-7b4c-4af4-8ccb-cec9aae83568-istio-data\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:35:57.268406 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.268370    2574 generic.go:356] "Generic (PLEG): container finished" podID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerID="18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9" exitCode=0
Sep 11 15:35:57.268574 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.268480    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"
Sep 11 15:35:57.268574 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.268480    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" event={"ID":"130be396-7b4c-4af4-8ccb-cec9aae83568","Type":"ContainerDied","Data":"18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9"}
Sep 11 15:35:57.268574 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.268539    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm" event={"ID":"130be396-7b4c-4af4-8ccb-cec9aae83568","Type":"ContainerDied","Data":"8d1007a8a7fe7e0b1614a8c268a57c7c10e68a1cfda432c42e39ee5022b2f159"}
Sep 11 15:35:57.268574 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.268560    2574 scope.go:117] "RemoveContainer" containerID="18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9"
Sep 11 15:35:57.278791 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.278774    2574 scope.go:117] "RemoveContainer" containerID="d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318"
Sep 11 15:35:57.288228 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.288211    2574 scope.go:117] "RemoveContainer" containerID="18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9"
Sep 11 15:35:57.288509 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:35:57.288487    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9\": container with ID starting with 18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9 not found: ID does not exist" containerID="18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9"
Sep 11 15:35:57.288608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.288515    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9"} err="failed to get container status \"18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9\": rpc error: code = NotFound desc = could not find container \"18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9\": container with ID starting with 18403b3608d23086edeb7a03a844abfb654246228b0e202c1382631bdf0931b9 not found: ID does not exist"
Sep 11 15:35:57.288608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.288532    2574 scope.go:117] "RemoveContainer" containerID="d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318"
Sep 11 15:35:57.288870 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:35:57.288848    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318\": container with ID starting with d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318 not found: ID does not exist" containerID="d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318"
Sep 11 15:35:57.288929 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.288877    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318"} err="failed to get container status \"d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318\": rpc error: code = NotFound desc = could not find container \"d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318\": container with ID starting with d8181c8e5678bb2dd451e172f6ee3aaaa4b31606bae6efa1ee09dd355b4f8318 not found: ID does not exist"
Sep 11 15:35:57.292387 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.292366    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"]
Sep 11 15:35:57.296597 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.296574    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f58c81-openshift-default-6b49cfcfd-vvwfm"]
Sep 11 15:35:57.996124 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:35:57.996090    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" path="/var/lib/kubelet/pods/130be396-7b4c-4af4-8ccb-cec9aae83568/volumes"
Sep 11 15:36:10.584055 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:10.584021    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"]
Sep 11 15:36:10.584630 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:10.584289    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns" podUID="28fa12aa-6054-4ef0-abeb-f2b452ffcc29" containerName="maas-api" containerID="cri-o://509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b" gracePeriod=30
Sep 11 15:36:10.867889 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:10.867855    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:36:10.920953 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:10.920916    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-metrics-certs\") pod \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") "
Sep 11 15:36:10.921144 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:10.920982    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p65fj\" (UniqueName: \"kubernetes.io/projected/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-kube-api-access-p65fj\") pod \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") "
Sep 11 15:36:10.921144 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:10.921028    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-maas-api-tls\") pod \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") "
Sep 11 15:36:10.921144 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:10.921058    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-openshift-service-ca\") pod \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\" (UID: \"28fa12aa-6054-4ef0-abeb-f2b452ffcc29\") "
Sep 11 15:36:10.921567 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:10.921527    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28fa12aa-6054-4ef0-abeb-f2b452ffcc29" (UID: "28fa12aa-6054-4ef0-abeb-f2b452ffcc29"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:36:10.922043 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:10.922017    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-openshift-service-ca\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:36:10.923875 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:10.923812    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "28fa12aa-6054-4ef0-abeb-f2b452ffcc29" (UID: "28fa12aa-6054-4ef0-abeb-f2b452ffcc29"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:36:10.923875 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:10.923823    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-kube-api-access-p65fj" (OuterVolumeSpecName: "kube-api-access-p65fj") pod "28fa12aa-6054-4ef0-abeb-f2b452ffcc29" (UID: "28fa12aa-6054-4ef0-abeb-f2b452ffcc29"). InnerVolumeSpecName "kube-api-access-p65fj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:36:10.924069 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:10.923997    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28fa12aa-6054-4ef0-abeb-f2b452ffcc29" (UID: "28fa12aa-6054-4ef0-abeb-f2b452ffcc29"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:36:11.022572 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.022536    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:36:11.022572 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.022571    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p65fj\" (UniqueName: \"kubernetes.io/projected/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-kube-api-access-p65fj\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:36:11.022821 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.022585    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28fa12aa-6054-4ef0-abeb-f2b452ffcc29-maas-api-tls\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:36:11.343593 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.343558    2574 generic.go:356] "Generic (PLEG): container finished" podID="28fa12aa-6054-4ef0-abeb-f2b452ffcc29" containerID="509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b" exitCode=0
Sep 11 15:36:11.343783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.343635    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"
Sep 11 15:36:11.343783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.343644    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns" event={"ID":"28fa12aa-6054-4ef0-abeb-f2b452ffcc29","Type":"ContainerDied","Data":"509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b"}
Sep 11 15:36:11.343783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.343698    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns" event={"ID":"28fa12aa-6054-4ef0-abeb-f2b452ffcc29","Type":"ContainerDied","Data":"8cc8e9eeaee46b5de924e901416d78791957c4008d55641b1a173104cd04c265"}
Sep 11 15:36:11.343783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.343721    2574 scope.go:117] "RemoveContainer" containerID="509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b"
Sep 11 15:36:11.353105 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.353088    2574 scope.go:117] "RemoveContainer" containerID="509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b"
Sep 11 15:36:11.353385 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:36:11.353367    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b\": container with ID starting with 509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b not found: ID does not exist" containerID="509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b"
Sep 11 15:36:11.353433 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.353392    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b"} err="failed to get container status \"509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b\": rpc error: code = NotFound desc = could not find container \"509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b\": container with ID starting with 509378f36fe10d699e4fc1c4f81d636f202dfb4009c8e8d8ec2a52f24255d08b not found: ID does not exist"
Sep 11 15:36:11.364919 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.364894    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"]
Sep 11 15:36:11.368574 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.368552    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8559ee-fb76955c9-gvqns"]
Sep 11 15:36:11.995135 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:36:11.995094    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28fa12aa-6054-4ef0-abeb-f2b452ffcc29" path="/var/lib/kubelet/pods/28fa12aa-6054-4ef0-abeb-f2b452ffcc29/volumes"
Sep 11 15:37:09.934926 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:09.934822    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"]
Sep 11 15:37:09.935528 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:09.935117    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr" podUID="b37fa928-a0e0-4a46-ab0c-707750e81c98" containerName="maas-api" containerID="cri-o://1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61" gracePeriod=30
Sep 11 15:37:10.000361 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.000329    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"]
Sep 11 15:37:10.000642 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.000583    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26" podUID="ad05d733-c8b0-4eac-8735-ab3f7c4f02f4" containerName="payload-pre-processing" containerID="cri-o://9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008" gracePeriod=30
Sep 11 15:37:10.270785 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.270757    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:37:10.303014 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.302989    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"
Sep 11 15:37:10.399525 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.399493    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9dmf\" (UniqueName: \"kubernetes.io/projected/b37fa928-a0e0-4a46-ab0c-707750e81c98-kube-api-access-t9dmf\") pod \"b37fa928-a0e0-4a46-ab0c-707750e81c98\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") "
Sep 11 15:37:10.399723 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.399568    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37fa928-a0e0-4a46-ab0c-707750e81c98-openshift-service-ca\") pod \"b37fa928-a0e0-4a46-ab0c-707750e81c98\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") "
Sep 11 15:37:10.399723 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.399601    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-metrics-certs\") pod \"b37fa928-a0e0-4a46-ab0c-707750e81c98\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") "
Sep 11 15:37:10.399723 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.399656    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4-plugins-config-volume\") pod \"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4\" (UID: \"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4\") "
Sep 11 15:37:10.399723 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.399678    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pbks\" (UniqueName: \"kubernetes.io/projected/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4-kube-api-access-5pbks\") pod \"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4\" (UID: \"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4\") "
Sep 11 15:37:10.399947 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.399741    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-maas-api-tls\") pod \"b37fa928-a0e0-4a46-ab0c-707750e81c98\" (UID: \"b37fa928-a0e0-4a46-ab0c-707750e81c98\") "
Sep 11 15:37:10.399998 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.399933    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b37fa928-a0e0-4a46-ab0c-707750e81c98-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b37fa928-a0e0-4a46-ab0c-707750e81c98" (UID: "b37fa928-a0e0-4a46-ab0c-707750e81c98"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:37:10.400049 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.400021    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad05d733-c8b0-4eac-8735-ab3f7c4f02f4" (UID: "ad05d733-c8b0-4eac-8735-ab3f7c4f02f4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:37:10.400172 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.400153    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37fa928-a0e0-4a46-ab0c-707750e81c98-openshift-service-ca\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:10.400232 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.400177    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4-plugins-config-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:10.401970 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.401943    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b37fa928-a0e0-4a46-ab0c-707750e81c98-kube-api-access-t9dmf" (OuterVolumeSpecName: "kube-api-access-t9dmf") pod "b37fa928-a0e0-4a46-ab0c-707750e81c98" (UID: "b37fa928-a0e0-4a46-ab0c-707750e81c98"). InnerVolumeSpecName "kube-api-access-t9dmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:37:10.402092 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.401967    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b37fa928-a0e0-4a46-ab0c-707750e81c98" (UID: "b37fa928-a0e0-4a46-ab0c-707750e81c98"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:37:10.402092 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.401987    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4-kube-api-access-5pbks" (OuterVolumeSpecName: "kube-api-access-5pbks") pod "ad05d733-c8b0-4eac-8735-ab3f7c4f02f4" (UID: "ad05d733-c8b0-4eac-8735-ab3f7c4f02f4"). InnerVolumeSpecName "kube-api-access-5pbks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:37:10.402092 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.402044    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b37fa928-a0e0-4a46-ab0c-707750e81c98" (UID: "b37fa928-a0e0-4a46-ab0c-707750e81c98"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:37:10.501595 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.501518    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-maas-api-tls\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:10.501595 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.501547    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9dmf\" (UniqueName: \"kubernetes.io/projected/b37fa928-a0e0-4a46-ab0c-707750e81c98-kube-api-access-t9dmf\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:10.501595 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.501557    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b37fa928-a0e0-4a46-ab0c-707750e81c98-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:10.501595 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.501566    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pbks\" (UniqueName: \"kubernetes.io/projected/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4-kube-api-access-5pbks\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:10.655570 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.655532    2574 generic.go:356] "Generic (PLEG): container finished" podID="b37fa928-a0e0-4a46-ab0c-707750e81c98" containerID="1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61" exitCode=0
Sep 11 15:37:10.655730 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.655580    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"
Sep 11 15:37:10.655730 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.655629    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr" event={"ID":"b37fa928-a0e0-4a46-ab0c-707750e81c98","Type":"ContainerDied","Data":"1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61"}
Sep 11 15:37:10.655730 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.655678    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr" event={"ID":"b37fa928-a0e0-4a46-ab0c-707750e81c98","Type":"ContainerDied","Data":"ed3aa06cad1522d4ecf7e76025e4101cc64c01692dececef0e36c5994a2275e9"}
Sep 11 15:37:10.655730 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.655700    2574 scope.go:117] "RemoveContainer" containerID="1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61"
Sep 11 15:37:10.657091 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.657066    2574 generic.go:356] "Generic (PLEG): container finished" podID="ad05d733-c8b0-4eac-8735-ab3f7c4f02f4" containerID="9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008" exitCode=0
Sep 11 15:37:10.657215 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.657101    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26" event={"ID":"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4","Type":"ContainerDied","Data":"9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008"}
Sep 11 15:37:10.657215 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.657107    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"
Sep 11 15:37:10.657215 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.657136    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26" event={"ID":"ad05d733-c8b0-4eac-8735-ab3f7c4f02f4","Type":"ContainerDied","Data":"af4b1ab17784eff36b8e737b1eea9c097b1cfda63fbfdc8f9138d5709fd51850"}
Sep 11 15:37:10.667973 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.667954    2574 scope.go:117] "RemoveContainer" containerID="1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61"
Sep 11 15:37:10.668258 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:37:10.668237    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61\": container with ID starting with 1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61 not found: ID does not exist" containerID="1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61"
Sep 11 15:37:10.668347 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.668263    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61"} err="failed to get container status \"1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61\": rpc error: code = NotFound desc = could not find container \"1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61\": container with ID starting with 1c1cef785ca1d24fe54f1c3c4c06c44606a1205efe81b9c46e75bf97816b0a61 not found: ID does not exist"
Sep 11 15:37:10.668347 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.668279    2574 scope.go:117] "RemoveContainer" containerID="9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008"
Sep 11 15:37:10.676713 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.676692    2574 scope.go:117] "RemoveContainer" containerID="9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008"
Sep 11 15:37:10.677039 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:37:10.677019    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008\": container with ID starting with 9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008 not found: ID does not exist" containerID="9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008"
Sep 11 15:37:10.677103 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.677047    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008"} err="failed to get container status \"9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008\": rpc error: code = NotFound desc = could not find container \"9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008\": container with ID starting with 9ddfbfe20ec35b229658861426c74041f0fde4f435144f115bb5d99ab1cdb008 not found: ID does not exist"
Sep 11 15:37:10.678355 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.678338    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"]
Sep 11 15:37:10.688568 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.688544    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0ce6e9-7b887c7855-f66mr"]
Sep 11 15:37:10.699034 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.699012    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"]
Sep 11 15:37:10.703477 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:10.703457    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0ce6e9-8486bff6b-h9x26"]
Sep 11 15:37:11.996206 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:11.996173    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad05d733-c8b0-4eac-8735-ab3f7c4f02f4" path="/var/lib/kubelet/pods/ad05d733-c8b0-4eac-8735-ab3f7c4f02f4/volumes"
Sep 11 15:37:11.996607 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:11.996594    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b37fa928-a0e0-4a46-ab0c-707750e81c98" path="/var/lib/kubelet/pods/b37fa928-a0e0-4a46-ab0c-707750e81c98/volumes"
Sep 11 15:37:27.365544 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.365508    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"]
Sep 11 15:37:27.366468 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.366396    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft" podUID="b14245b6-9e5d-489f-8a0f-0bcf5224523f" containerName="maas-api" containerID="cri-o://7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30" gracePeriod=30
Sep 11 15:37:27.622703 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.622641    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:37:27.658724 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.658674    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-metrics-certs\") pod \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") "
Sep 11 15:37:27.658941 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.658767    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-maas-api-tls\") pod \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") "
Sep 11 15:37:27.658941 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.658796    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2fwf\" (UniqueName: \"kubernetes.io/projected/b14245b6-9e5d-489f-8a0f-0bcf5224523f-kube-api-access-j2fwf\") pod \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") "
Sep 11 15:37:27.658941 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.658892    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b14245b6-9e5d-489f-8a0f-0bcf5224523f-openshift-service-ca\") pod \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\" (UID: \"b14245b6-9e5d-489f-8a0f-0bcf5224523f\") "
Sep 11 15:37:27.659406 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.659301    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b14245b6-9e5d-489f-8a0f-0bcf5224523f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b14245b6-9e5d-489f-8a0f-0bcf5224523f" (UID: "b14245b6-9e5d-489f-8a0f-0bcf5224523f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:37:27.661564 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.661532    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14245b6-9e5d-489f-8a0f-0bcf5224523f-kube-api-access-j2fwf" (OuterVolumeSpecName: "kube-api-access-j2fwf") pod "b14245b6-9e5d-489f-8a0f-0bcf5224523f" (UID: "b14245b6-9e5d-489f-8a0f-0bcf5224523f"). InnerVolumeSpecName "kube-api-access-j2fwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:37:27.661701 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.661678    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b14245b6-9e5d-489f-8a0f-0bcf5224523f" (UID: "b14245b6-9e5d-489f-8a0f-0bcf5224523f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:37:27.661701 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.661692    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b14245b6-9e5d-489f-8a0f-0bcf5224523f" (UID: "b14245b6-9e5d-489f-8a0f-0bcf5224523f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:37:27.747494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.747457    2574 generic.go:356] "Generic (PLEG): container finished" podID="b14245b6-9e5d-489f-8a0f-0bcf5224523f" containerID="7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30" exitCode=0
Sep 11 15:37:27.747717 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.747505    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"
Sep 11 15:37:27.747717 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.747531    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft" event={"ID":"b14245b6-9e5d-489f-8a0f-0bcf5224523f","Type":"ContainerDied","Data":"7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30"}
Sep 11 15:37:27.747717 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.747586    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft" event={"ID":"b14245b6-9e5d-489f-8a0f-0bcf5224523f","Type":"ContainerDied","Data":"1b408f354e2a6f5d2920e1c4a3ef1de52dd7053754fd0968706612414f806b7a"}
Sep 11 15:37:27.747717 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.747607    2574 scope.go:117] "RemoveContainer" containerID="7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30"
Sep 11 15:37:27.760829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.760168    2574 scope.go:117] "RemoveContainer" containerID="7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30"
Sep 11 15:37:27.760829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.760432    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:27.760829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.760454    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b14245b6-9e5d-489f-8a0f-0bcf5224523f-maas-api-tls\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:27.760829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.760467    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2fwf\" (UniqueName: \"kubernetes.io/projected/b14245b6-9e5d-489f-8a0f-0bcf5224523f-kube-api-access-j2fwf\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:27.760829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.760481    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b14245b6-9e5d-489f-8a0f-0bcf5224523f-openshift-service-ca\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:27.760829 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:37:27.760516    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30\": container with ID starting with 7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30 not found: ID does not exist" containerID="7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30"
Sep 11 15:37:27.760829 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.760549    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30"} err="failed to get container status \"7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30\": rpc error: code = NotFound desc = could not find container \"7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30\": container with ID starting with 7d12e37b058e9876cfa73dcc2058e4c25eb629bf0a1d2da2103e0bc04b917d30 not found: ID does not exist"
Sep 11 15:37:27.774876 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.774841    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"]
Sep 11 15:37:27.777982 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.777955    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-397e40-55d48d6f8c-6frft"]
Sep 11 15:37:27.995077 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:27.994992    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b14245b6-9e5d-489f-8a0f-0bcf5224523f" path="/var/lib/kubelet/pods/b14245b6-9e5d-489f-8a0f-0bcf5224523f/volumes"
Sep 11 15:37:44.913977 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:44.913364    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"]
Sep 11 15:37:44.913977 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:44.913586    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc" podUID="dfe4b6af-1ccb-49d9-bf2d-d375cce26a51" containerName="maas-api" containerID="cri-o://b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0" gracePeriod=30
Sep 11 15:37:45.176558 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.176490    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:37:45.321545 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.321508    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-maas-api-tls\") pod \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") "
Sep 11 15:37:45.321748 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.321599    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkkqc\" (UniqueName: \"kubernetes.io/projected/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-kube-api-access-nkkqc\") pod \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") "
Sep 11 15:37:45.321748 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.321675    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-metrics-certs\") pod \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") "
Sep 11 15:37:45.321868 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.321752    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-openshift-service-ca\") pod \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\" (UID: \"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51\") "
Sep 11 15:37:45.322320 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.322239    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dfe4b6af-1ccb-49d9-bf2d-d375cce26a51" (UID: "dfe4b6af-1ccb-49d9-bf2d-d375cce26a51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:37:45.325071 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.324424    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-kube-api-access-nkkqc" (OuterVolumeSpecName: "kube-api-access-nkkqc") pod "dfe4b6af-1ccb-49d9-bf2d-d375cce26a51" (UID: "dfe4b6af-1ccb-49d9-bf2d-d375cce26a51"). InnerVolumeSpecName "kube-api-access-nkkqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:37:45.325071 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.324603    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dfe4b6af-1ccb-49d9-bf2d-d375cce26a51" (UID: "dfe4b6af-1ccb-49d9-bf2d-d375cce26a51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:37:45.325071 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.325031    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dfe4b6af-1ccb-49d9-bf2d-d375cce26a51" (UID: "dfe4b6af-1ccb-49d9-bf2d-d375cce26a51"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:37:45.423231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.423186    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkkqc\" (UniqueName: \"kubernetes.io/projected/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-kube-api-access-nkkqc\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:45.423231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.423228    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:45.423231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.423238    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-openshift-service-ca\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:45.423231 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.423247    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51-maas-api-tls\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:45.841586 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.841549    2574 generic.go:356] "Generic (PLEG): container finished" podID="dfe4b6af-1ccb-49d9-bf2d-d375cce26a51" containerID="b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0" exitCode=0
Sep 11 15:37:45.841779 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.841603    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"
Sep 11 15:37:45.841779 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.841642    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc" event={"ID":"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51","Type":"ContainerDied","Data":"b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0"}
Sep 11 15:37:45.841779 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.841724    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc" event={"ID":"dfe4b6af-1ccb-49d9-bf2d-d375cce26a51","Type":"ContainerDied","Data":"33e4579f8c9b66a10142be9e6fb3f1beafd09d31f3f57a5649c5ef9cd3800632"}
Sep 11 15:37:45.841779 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.841747    2574 scope.go:117] "RemoveContainer" containerID="b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0"
Sep 11 15:37:45.851352 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.851334    2574 scope.go:117] "RemoveContainer" containerID="b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0"
Sep 11 15:37:45.851663 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:37:45.851644    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0\": container with ID starting with b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0 not found: ID does not exist" containerID="b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0"
Sep 11 15:37:45.851722 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.851674    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0"} err="failed to get container status \"b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0\": rpc error: code = NotFound desc = could not find container \"b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0\": container with ID starting with b8631e8ac3de058fc5dee2c1dff34fb50b7357db1c4d828b01ae6aace849ebf0 not found: ID does not exist"
Sep 11 15:37:45.862431 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.862405    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"]
Sep 11 15:37:45.866419 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.866396    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-abba31-65464b5ffd-8rcdc"]
Sep 11 15:37:45.996370 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:45.996338    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe4b6af-1ccb-49d9-bf2d-d375cce26a51" path="/var/lib/kubelet/pods/dfe4b6af-1ccb-49d9-bf2d-d375cce26a51/volumes"
Sep 11 15:37:54.099494 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.099448    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-89f8bdf64-p4cpg"]
Sep 11 15:37:54.100049 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.099739    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-89f8bdf64-p4cpg" podUID="3dde0fcb-dbd3-4786-83f4-dafbdf75bea8" containerName="manager" containerID="cri-o://0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30" gracePeriod=30
Sep 11 15:37:54.347563 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.347533    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:37:54.507241 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.507204    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-metrics-certs\") pod \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") "
Sep 11 15:37:54.507241 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.507244    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-webhook-cert\") pod \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") "
Sep 11 15:37:54.507456 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.507270    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24vbl\" (UniqueName: \"kubernetes.io/projected/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-kube-api-access-24vbl\") pod \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\" (UID: \"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8\") "
Sep 11 15:37:54.509521 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.509488    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3dde0fcb-dbd3-4786-83f4-dafbdf75bea8" (UID: "3dde0fcb-dbd3-4786-83f4-dafbdf75bea8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:37:54.509521 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.509506    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3dde0fcb-dbd3-4786-83f4-dafbdf75bea8" (UID: "3dde0fcb-dbd3-4786-83f4-dafbdf75bea8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:37:54.509712 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.509534    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-kube-api-access-24vbl" (OuterVolumeSpecName: "kube-api-access-24vbl") pod "3dde0fcb-dbd3-4786-83f4-dafbdf75bea8" (UID: "3dde0fcb-dbd3-4786-83f4-dafbdf75bea8"). InnerVolumeSpecName "kube-api-access-24vbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:37:54.608921 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.608888    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:54.608921 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.608917    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-webhook-cert\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:54.609131 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.608929    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24vbl\" (UniqueName: \"kubernetes.io/projected/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8-kube-api-access-24vbl\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:37:54.887116 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.887077    2574 generic.go:356] "Generic (PLEG): container finished" podID="3dde0fcb-dbd3-4786-83f4-dafbdf75bea8" containerID="0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30" exitCode=0
Sep 11 15:37:54.887280 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.887124    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89f8bdf64-p4cpg"
Sep 11 15:37:54.887280 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.887138    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89f8bdf64-p4cpg" event={"ID":"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8","Type":"ContainerDied","Data":"0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30"}
Sep 11 15:37:54.887280 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.887179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89f8bdf64-p4cpg" event={"ID":"3dde0fcb-dbd3-4786-83f4-dafbdf75bea8","Type":"ContainerDied","Data":"54d21aca35830a1a6a39f853c3e951ec240b0de5135dede36b6578047496f471"}
Sep 11 15:37:54.887280 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.887199    2574 scope.go:117] "RemoveContainer" containerID="0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30"
Sep 11 15:37:54.896598 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.896584    2574 scope.go:117] "RemoveContainer" containerID="0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30"
Sep 11 15:37:54.896880 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:37:54.896862    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30\": container with ID starting with 0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30 not found: ID does not exist" containerID="0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30"
Sep 11 15:37:54.896950 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.896887    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30"} err="failed to get container status \"0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30\": rpc error: code = NotFound desc = could not find container \"0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30\": container with ID starting with 0f7d0314509bae0b0b5209f3d1c496f0951c4c07ad42280b55d3fe845bd2cf30 not found: ID does not exist"
Sep 11 15:37:54.907448 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.907427    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-89f8bdf64-p4cpg"]
Sep 11 15:37:54.911916 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:54.911896    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-89f8bdf64-p4cpg"]
Sep 11 15:37:55.994432 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:37:55.994399    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dde0fcb-dbd3-4786-83f4-dafbdf75bea8" path="/var/lib/kubelet/pods/3dde0fcb-dbd3-4786-83f4-dafbdf75bea8/volumes"
Sep 11 15:38:55.675693 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.675657    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-89f8bdf64-2jsbg"]
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676023    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe4b6af-1ccb-49d9-bf2d-d375cce26a51" containerName="maas-api"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676034    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe4b6af-1ccb-49d9-bf2d-d375cce26a51" containerName="maas-api"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676042    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad05d733-c8b0-4eac-8735-ab3f7c4f02f4" containerName="payload-pre-processing"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676047    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad05d733-c8b0-4eac-8735-ab3f7c4f02f4" containerName="payload-pre-processing"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676059    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b14245b6-9e5d-489f-8a0f-0bcf5224523f" containerName="maas-api"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676065    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b14245b6-9e5d-489f-8a0f-0bcf5224523f" containerName="maas-api"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676071    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b37fa928-a0e0-4a46-ab0c-707750e81c98" containerName="maas-api"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676076    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37fa928-a0e0-4a46-ab0c-707750e81c98" containerName="maas-api"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676086    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef6fc24-4703-4508-9e5a-70c526fb7d16" containerName="payload-processing"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676091    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef6fc24-4703-4508-9e5a-70c526fb7d16" containerName="payload-processing"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676103    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28fa12aa-6054-4ef0-abeb-f2b452ffcc29" containerName="maas-api"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676108    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="28fa12aa-6054-4ef0-abeb-f2b452ffcc29" containerName="maas-api"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676113    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerName="istio-proxy"
Sep 11 15:38:55.676117 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676117    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerName="istio-proxy"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676153    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dde0fcb-dbd3-4786-83f4-dafbdf75bea8" containerName="manager"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676160    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dde0fcb-dbd3-4786-83f4-dafbdf75bea8" containerName="manager"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676167    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerName="istio-proxy"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676172    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerName="istio-proxy"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676229    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="28fa12aa-6054-4ef0-abeb-f2b452ffcc29" containerName="maas-api"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676236    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad05d733-c8b0-4eac-8735-ab3f7c4f02f4" containerName="payload-pre-processing"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676243    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b37fa928-a0e0-4a46-ab0c-707750e81c98" containerName="maas-api"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676248    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerName="istio-proxy"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676254    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b14245b6-9e5d-489f-8a0f-0bcf5224523f" containerName="maas-api"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676260    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe4b6af-1ccb-49d9-bf2d-d375cce26a51" containerName="maas-api"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676265    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ef6fc24-4703-4508-9e5a-70c526fb7d16" containerName="payload-processing"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676271    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dde0fcb-dbd3-4786-83f4-dafbdf75bea8" containerName="manager"
Sep 11 15:38:55.676721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.676276    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="130be396-7b4c-4af4-8ccb-cec9aae83568" containerName="istio-proxy"
Sep 11 15:38:55.679521 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.679503    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:38:55.683079 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.683058    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w92cs\""
Sep 11 15:38:55.683079 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.683069    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 15:38:55.683259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.683058    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 15:38:55.683259 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.683057    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 15:38:55.692076 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.692046    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-89f8bdf64-2jsbg"]
Sep 11 15:38:55.758247 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.758208    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6lr5\" (UniqueName: \"kubernetes.io/projected/24a4ad62-aabb-4c1f-baad-98a543a52548-kube-api-access-p6lr5\") pod \"maas-controller-89f8bdf64-2jsbg\" (UID: \"24a4ad62-aabb-4c1f-baad-98a543a52548\") " pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:38:55.758247 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.758248    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24a4ad62-aabb-4c1f-baad-98a543a52548-webhook-cert\") pod \"maas-controller-89f8bdf64-2jsbg\" (UID: \"24a4ad62-aabb-4c1f-baad-98a543a52548\") " pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:38:55.758457 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.758273    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24a4ad62-aabb-4c1f-baad-98a543a52548-metrics-certs\") pod \"maas-controller-89f8bdf64-2jsbg\" (UID: \"24a4ad62-aabb-4c1f-baad-98a543a52548\") " pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:38:55.859066 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.859026    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6lr5\" (UniqueName: \"kubernetes.io/projected/24a4ad62-aabb-4c1f-baad-98a543a52548-kube-api-access-p6lr5\") pod \"maas-controller-89f8bdf64-2jsbg\" (UID: \"24a4ad62-aabb-4c1f-baad-98a543a52548\") " pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:38:55.859066 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.859067    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24a4ad62-aabb-4c1f-baad-98a543a52548-webhook-cert\") pod \"maas-controller-89f8bdf64-2jsbg\" (UID: \"24a4ad62-aabb-4c1f-baad-98a543a52548\") " pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:38:55.859281 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.859091    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24a4ad62-aabb-4c1f-baad-98a543a52548-metrics-certs\") pod \"maas-controller-89f8bdf64-2jsbg\" (UID: \"24a4ad62-aabb-4c1f-baad-98a543a52548\") " pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:38:55.861843 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.861813    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24a4ad62-aabb-4c1f-baad-98a543a52548-metrics-certs\") pod \"maas-controller-89f8bdf64-2jsbg\" (UID: \"24a4ad62-aabb-4c1f-baad-98a543a52548\") " pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:38:55.861843 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.861836    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24a4ad62-aabb-4c1f-baad-98a543a52548-webhook-cert\") pod \"maas-controller-89f8bdf64-2jsbg\" (UID: \"24a4ad62-aabb-4c1f-baad-98a543a52548\") " pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:38:55.867395 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.867372    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6lr5\" (UniqueName: \"kubernetes.io/projected/24a4ad62-aabb-4c1f-baad-98a543a52548-kube-api-access-p6lr5\") pod \"maas-controller-89f8bdf64-2jsbg\" (UID: \"24a4ad62-aabb-4c1f-baad-98a543a52548\") " pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:38:55.991023 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:55.990932    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:38:56.263930 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:56.263851    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-89f8bdf64-2jsbg"]
Sep 11 15:38:56.267060 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:38:56.267033    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a4ad62_aabb_4c1f_baad_98a543a52548.slice/crio-5158282a5f97c0d7b8300e05994b12b55dc9ad4352159df04e6b9088e0c6a7d5 WatchSource:0}: Error finding container 5158282a5f97c0d7b8300e05994b12b55dc9ad4352159df04e6b9088e0c6a7d5: Status 404 returned error can't find the container with id 5158282a5f97c0d7b8300e05994b12b55dc9ad4352159df04e6b9088e0c6a7d5
Sep 11 15:38:56.268336 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:56.268318    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 15:38:57.204931 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:57.204896    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89f8bdf64-2jsbg" event={"ID":"24a4ad62-aabb-4c1f-baad-98a543a52548","Type":"ContainerStarted","Data":"0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8"}
Sep 11 15:38:57.205550 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:57.204954    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89f8bdf64-2jsbg" event={"ID":"24a4ad62-aabb-4c1f-baad-98a543a52548","Type":"ContainerStarted","Data":"5158282a5f97c0d7b8300e05994b12b55dc9ad4352159df04e6b9088e0c6a7d5"}
Sep 11 15:38:57.205550 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:57.205052    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:38:57.222940 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:38:57.222895    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-89f8bdf64-2jsbg" podStartSLOduration=1.444030933 podStartE2EDuration="2.222881437s" totalImagesPullingTime="778.850504ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:38:57.221028785 +0000 UTC m=+1811.680745784" watchObservedRunningTime="2026-09-11 15:38:57.222881437 +0000 UTC m=+1811.682598436"
Sep 11 15:39:08.212851 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:08.212815    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:39:15.400159 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:15.400124    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-89f8bdf64-2jsbg"]
Sep 11 15:39:15.400799 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:15.400327    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-89f8bdf64-2jsbg" podUID="24a4ad62-aabb-4c1f-baad-98a543a52548" containerName="manager" containerID="cri-o://0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8" gracePeriod=30
Sep 11 15:39:15.652560 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:15.652507    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:39:15.751730 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:15.751699    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24a4ad62-aabb-4c1f-baad-98a543a52548-metrics-certs\") pod \"24a4ad62-aabb-4c1f-baad-98a543a52548\" (UID: \"24a4ad62-aabb-4c1f-baad-98a543a52548\") "
Sep 11 15:39:15.751913 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:15.751766    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24a4ad62-aabb-4c1f-baad-98a543a52548-webhook-cert\") pod \"24a4ad62-aabb-4c1f-baad-98a543a52548\" (UID: \"24a4ad62-aabb-4c1f-baad-98a543a52548\") "
Sep 11 15:39:15.751913 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:15.751810    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6lr5\" (UniqueName: \"kubernetes.io/projected/24a4ad62-aabb-4c1f-baad-98a543a52548-kube-api-access-p6lr5\") pod \"24a4ad62-aabb-4c1f-baad-98a543a52548\" (UID: \"24a4ad62-aabb-4c1f-baad-98a543a52548\") "
Sep 11 15:39:15.754011 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:15.753975    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24a4ad62-aabb-4c1f-baad-98a543a52548-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "24a4ad62-aabb-4c1f-baad-98a543a52548" (UID: "24a4ad62-aabb-4c1f-baad-98a543a52548"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:39:15.754011 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:15.753990    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a4ad62-aabb-4c1f-baad-98a543a52548-kube-api-access-p6lr5" (OuterVolumeSpecName: "kube-api-access-p6lr5") pod "24a4ad62-aabb-4c1f-baad-98a543a52548" (UID: "24a4ad62-aabb-4c1f-baad-98a543a52548"). InnerVolumeSpecName "kube-api-access-p6lr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:39:15.754168 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:15.754022    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24a4ad62-aabb-4c1f-baad-98a543a52548-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "24a4ad62-aabb-4c1f-baad-98a543a52548" (UID: "24a4ad62-aabb-4c1f-baad-98a543a52548"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:39:15.853037 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:15.853008    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24a4ad62-aabb-4c1f-baad-98a543a52548-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:39:15.853037 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:15.853033    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24a4ad62-aabb-4c1f-baad-98a543a52548-webhook-cert\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:39:15.853037 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:15.853042    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6lr5\" (UniqueName: \"kubernetes.io/projected/24a4ad62-aabb-4c1f-baad-98a543a52548-kube-api-access-p6lr5\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:39:16.301674 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:16.301579    2574 generic.go:356] "Generic (PLEG): container finished" podID="24a4ad62-aabb-4c1f-baad-98a543a52548" containerID="0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8" exitCode=0
Sep 11 15:39:16.301825 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:16.301676    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89f8bdf64-2jsbg"
Sep 11 15:39:16.301825 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:16.301692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89f8bdf64-2jsbg" event={"ID":"24a4ad62-aabb-4c1f-baad-98a543a52548","Type":"ContainerDied","Data":"0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8"}
Sep 11 15:39:16.301825 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:16.301743    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89f8bdf64-2jsbg" event={"ID":"24a4ad62-aabb-4c1f-baad-98a543a52548","Type":"ContainerDied","Data":"5158282a5f97c0d7b8300e05994b12b55dc9ad4352159df04e6b9088e0c6a7d5"}
Sep 11 15:39:16.301825 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:16.301773    2574 scope.go:117] "RemoveContainer" containerID="0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8"
Sep 11 15:39:16.312690 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:16.312669    2574 scope.go:117] "RemoveContainer" containerID="0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8"
Sep 11 15:39:16.313025 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:39:16.313004    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8\": container with ID starting with 0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8 not found: ID does not exist" containerID="0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8"
Sep 11 15:39:16.313086 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:16.313034    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8"} err="failed to get container status \"0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8\": rpc error: code = NotFound desc = could not find container \"0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8\": container with ID starting with 0d2f13e35155d531bd83d3ed9ab5b4798bed21c2122c15a2c179f91882b0f6c8 not found: ID does not exist"
Sep 11 15:39:16.321411 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:16.321385    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-89f8bdf64-2jsbg"]
Sep 11 15:39:16.323899 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:16.323873    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-89f8bdf64-2jsbg"]
Sep 11 15:39:17.135958 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.135922    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-89f8bdf64-5jwgp"]
Sep 11 15:39:17.136334 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.136312    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24a4ad62-aabb-4c1f-baad-98a543a52548" containerName="manager"
Sep 11 15:39:17.136334 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.136324    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a4ad62-aabb-4c1f-baad-98a543a52548" containerName="manager"
Sep 11 15:39:17.136423 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.136388    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="24a4ad62-aabb-4c1f-baad-98a543a52548" containerName="manager"
Sep 11 15:39:17.140935 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.140913    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:39:17.144323 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.144295    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w92cs\""
Sep 11 15:39:17.144323 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.144316    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 15:39:17.144509 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.144295    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 15:39:17.144509 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.144347    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 15:39:17.148495 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.148422    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-89f8bdf64-5jwgp"]
Sep 11 15:39:17.267496 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.267463    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7256fd9-a4ef-4980-acb0-1f493ff313f3-metrics-certs\") pod \"maas-controller-89f8bdf64-5jwgp\" (UID: \"e7256fd9-a4ef-4980-acb0-1f493ff313f3\") " pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:39:17.267712 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.267558    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7256fd9-a4ef-4980-acb0-1f493ff313f3-webhook-cert\") pod \"maas-controller-89f8bdf64-5jwgp\" (UID: \"e7256fd9-a4ef-4980-acb0-1f493ff313f3\") " pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:39:17.267712 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.267600    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxfbk\" (UniqueName: \"kubernetes.io/projected/e7256fd9-a4ef-4980-acb0-1f493ff313f3-kube-api-access-fxfbk\") pod \"maas-controller-89f8bdf64-5jwgp\" (UID: \"e7256fd9-a4ef-4980-acb0-1f493ff313f3\") " pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:39:17.368422 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.368378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7256fd9-a4ef-4980-acb0-1f493ff313f3-webhook-cert\") pod \"maas-controller-89f8bdf64-5jwgp\" (UID: \"e7256fd9-a4ef-4980-acb0-1f493ff313f3\") " pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:39:17.368670 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.368479    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxfbk\" (UniqueName: \"kubernetes.io/projected/e7256fd9-a4ef-4980-acb0-1f493ff313f3-kube-api-access-fxfbk\") pod \"maas-controller-89f8bdf64-5jwgp\" (UID: \"e7256fd9-a4ef-4980-acb0-1f493ff313f3\") " pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:39:17.368670 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.368539    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7256fd9-a4ef-4980-acb0-1f493ff313f3-metrics-certs\") pod \"maas-controller-89f8bdf64-5jwgp\" (UID: \"e7256fd9-a4ef-4980-acb0-1f493ff313f3\") " pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:39:17.371140 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.371107    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7256fd9-a4ef-4980-acb0-1f493ff313f3-metrics-certs\") pod \"maas-controller-89f8bdf64-5jwgp\" (UID: \"e7256fd9-a4ef-4980-acb0-1f493ff313f3\") " pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:39:17.371286 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.371161    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7256fd9-a4ef-4980-acb0-1f493ff313f3-webhook-cert\") pod \"maas-controller-89f8bdf64-5jwgp\" (UID: \"e7256fd9-a4ef-4980-acb0-1f493ff313f3\") " pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:39:17.376284 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.376258    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxfbk\" (UniqueName: \"kubernetes.io/projected/e7256fd9-a4ef-4980-acb0-1f493ff313f3-kube-api-access-fxfbk\") pod \"maas-controller-89f8bdf64-5jwgp\" (UID: \"e7256fd9-a4ef-4980-acb0-1f493ff313f3\") " pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:39:17.453858 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.453767    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:39:17.726636 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.726583    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-89f8bdf64-5jwgp"]
Sep 11 15:39:17.728762 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:39:17.728732    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7256fd9_a4ef_4980_acb0_1f493ff313f3.slice/crio-42b7a58085316c5ad03a5aa83c7bb6dd8a165f9c8e16ee574b38cf89c686c8ee WatchSource:0}: Error finding container 42b7a58085316c5ad03a5aa83c7bb6dd8a165f9c8e16ee574b38cf89c686c8ee: Status 404 returned error can't find the container with id 42b7a58085316c5ad03a5aa83c7bb6dd8a165f9c8e16ee574b38cf89c686c8ee
Sep 11 15:39:17.994749 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:17.994671    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24a4ad62-aabb-4c1f-baad-98a543a52548" path="/var/lib/kubelet/pods/24a4ad62-aabb-4c1f-baad-98a543a52548/volumes"
Sep 11 15:39:18.314183 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:18.314156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89f8bdf64-5jwgp" event={"ID":"e7256fd9-a4ef-4980-acb0-1f493ff313f3","Type":"ContainerStarted","Data":"d3d915c200df3f5536704f70f8c19abc0dded8a7c1d5f5bebfc074fe57706b50"}
Sep 11 15:39:18.314518 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:18.314203    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-89f8bdf64-5jwgp" event={"ID":"e7256fd9-a4ef-4980-acb0-1f493ff313f3","Type":"ContainerStarted","Data":"42b7a58085316c5ad03a5aa83c7bb6dd8a165f9c8e16ee574b38cf89c686c8ee"}
Sep 11 15:39:18.314518 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:18.314291    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:39:18.330450 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:18.330400    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-89f8bdf64-5jwgp" podStartSLOduration=0.814327624 podStartE2EDuration="1.330382031s" totalImagesPullingTime="516.054407ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:39:18.330168283 +0000 UTC m=+1832.789885307" watchObservedRunningTime="2026-09-11 15:39:18.330382031 +0000 UTC m=+1832.790099032"
Sep 11 15:39:29.322118 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:39:29.322078    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-89f8bdf64-5jwgp"
Sep 11 15:40:22.145722 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:22.145681    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"]
Sep 11 15:40:22.148129 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:22.145896    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr" podUID="6a1e8af0-5ec9-440a-b029-1040d301e12b" containerName="manager" containerID="cri-o://bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306" gracePeriod=10
Sep 11 15:40:22.899654 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:22.899632    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"
Sep 11 15:40:22.952496 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:22.952470    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzbt6\" (UniqueName: \"kubernetes.io/projected/6a1e8af0-5ec9-440a-b029-1040d301e12b-kube-api-access-pzbt6\") pod \"6a1e8af0-5ec9-440a-b029-1040d301e12b\" (UID: \"6a1e8af0-5ec9-440a-b029-1040d301e12b\") "
Sep 11 15:40:22.952703 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:22.952551    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a1e8af0-5ec9-440a-b029-1040d301e12b-extensions-socket-volume\") pod \"6a1e8af0-5ec9-440a-b029-1040d301e12b\" (UID: \"6a1e8af0-5ec9-440a-b029-1040d301e12b\") "
Sep 11 15:40:22.953010 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:22.952979    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a1e8af0-5ec9-440a-b029-1040d301e12b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6a1e8af0-5ec9-440a-b029-1040d301e12b" (UID: "6a1e8af0-5ec9-440a-b029-1040d301e12b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:40:22.954630 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:22.954588    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a1e8af0-5ec9-440a-b029-1040d301e12b-kube-api-access-pzbt6" (OuterVolumeSpecName: "kube-api-access-pzbt6") pod "6a1e8af0-5ec9-440a-b029-1040d301e12b" (UID: "6a1e8af0-5ec9-440a-b029-1040d301e12b"). InnerVolumeSpecName "kube-api-access-pzbt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:40:23.053855 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.053779    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzbt6\" (UniqueName: \"kubernetes.io/projected/6a1e8af0-5ec9-440a-b029-1040d301e12b-kube-api-access-pzbt6\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:40:23.053855 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.053804    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a1e8af0-5ec9-440a-b029-1040d301e12b-extensions-socket-volume\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:40:23.627937 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.627903    2574 generic.go:356] "Generic (PLEG): container finished" podID="6a1e8af0-5ec9-440a-b029-1040d301e12b" containerID="bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306" exitCode=0
Sep 11 15:40:23.628404 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.627948    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"
Sep 11 15:40:23.628404 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.627992    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr" event={"ID":"6a1e8af0-5ec9-440a-b029-1040d301e12b","Type":"ContainerDied","Data":"bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306"}
Sep 11 15:40:23.628404 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.628055    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr" event={"ID":"6a1e8af0-5ec9-440a-b029-1040d301e12b","Type":"ContainerDied","Data":"e76de28a88582861a98a3886e326691fdb1dd0534c65bd85f87f1715cdc334f4"}
Sep 11 15:40:23.628404 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.628089    2574 scope.go:117] "RemoveContainer" containerID="bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306"
Sep 11 15:40:23.638057 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.638041    2574 scope.go:117] "RemoveContainer" containerID="bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306"
Sep 11 15:40:23.638326 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:40:23.638305    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306\": container with ID starting with bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306 not found: ID does not exist" containerID="bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306"
Sep 11 15:40:23.638369 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.638337    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306"} err="failed to get container status \"bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306\": rpc error: code = NotFound desc = could not find container \"bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306\": container with ID starting with bf1f55f897dc8f2c5427c5f8eb500a1bda0739028b2db1fd39590a782bfd8306 not found: ID does not exist"
Sep 11 15:40:23.650836 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.650815    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"]
Sep 11 15:40:23.657040 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.657018    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr"]
Sep 11 15:40:23.877591 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.877549    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-svxfr" podUID="6a1e8af0-5ec9-440a-b029-1040d301e12b" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.29:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 15:40:23.995484 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:40:23.995404    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a1e8af0-5ec9-440a-b029-1040d301e12b" path="/var/lib/kubelet/pods/6a1e8af0-5ec9-440a-b029-1040d301e12b/volumes"
Sep 11 15:41:22.823777 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:22.823743    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"]
Sep 11 15:41:22.824241 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:22.824093    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a1e8af0-5ec9-440a-b029-1040d301e12b" containerName="manager"
Sep 11 15:41:22.824241 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:22.824103    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a1e8af0-5ec9-440a-b029-1040d301e12b" containerName="manager"
Sep 11 15:41:22.824241 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:22.824174    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a1e8af0-5ec9-440a-b029-1040d301e12b" containerName="manager"
Sep 11 15:41:22.827067 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:22.827050    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"
Sep 11 15:41:22.829920 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:22.829900    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wrj9z\""
Sep 11 15:41:22.842279 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:22.842254    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"]
Sep 11 15:41:22.996243 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:22.996204    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8cf98c6-4747-49df-834e-8be2d185c95f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xbnjb\" (UID: \"a8cf98c6-4747-49df-834e-8be2d185c95f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"
Sep 11 15:41:22.996428 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:22.996260    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqml8\" (UniqueName: \"kubernetes.io/projected/a8cf98c6-4747-49df-834e-8be2d185c95f-kube-api-access-zqml8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xbnjb\" (UID: \"a8cf98c6-4747-49df-834e-8be2d185c95f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"
Sep 11 15:41:23.097434 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:23.097346    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8cf98c6-4747-49df-834e-8be2d185c95f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xbnjb\" (UID: \"a8cf98c6-4747-49df-834e-8be2d185c95f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"
Sep 11 15:41:23.097434 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:23.097417    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqml8\" (UniqueName: \"kubernetes.io/projected/a8cf98c6-4747-49df-834e-8be2d185c95f-kube-api-access-zqml8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xbnjb\" (UID: \"a8cf98c6-4747-49df-834e-8be2d185c95f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"
Sep 11 15:41:23.097772 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:23.097752    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8cf98c6-4747-49df-834e-8be2d185c95f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xbnjb\" (UID: \"a8cf98c6-4747-49df-834e-8be2d185c95f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"
Sep 11 15:41:23.106332 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:23.106307    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqml8\" (UniqueName: \"kubernetes.io/projected/a8cf98c6-4747-49df-834e-8be2d185c95f-kube-api-access-zqml8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xbnjb\" (UID: \"a8cf98c6-4747-49df-834e-8be2d185c95f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"
Sep 11 15:41:23.137091 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:23.137064    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"
Sep 11 15:41:23.419459 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:23.419419    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"]
Sep 11 15:41:23.421044 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:41:23.421020    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8cf98c6_4747_49df_834e_8be2d185c95f.slice/crio-9257595d24b3a64fffd533d3d8ed70ea08882beaaa973b5360a470e9952c169c WatchSource:0}: Error finding container 9257595d24b3a64fffd533d3d8ed70ea08882beaaa973b5360a470e9952c169c: Status 404 returned error can't find the container with id 9257595d24b3a64fffd533d3d8ed70ea08882beaaa973b5360a470e9952c169c
Sep 11 15:41:23.906344 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:23.906313    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb" event={"ID":"a8cf98c6-4747-49df-834e-8be2d185c95f","Type":"ContainerStarted","Data":"4042bb2617ab47783fe1f996bb51916cbbe273f6f17e120eca5b3dcd5aac9c5e"}
Sep 11 15:41:23.906761 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:23.906369    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb" event={"ID":"a8cf98c6-4747-49df-834e-8be2d185c95f","Type":"ContainerStarted","Data":"9257595d24b3a64fffd533d3d8ed70ea08882beaaa973b5360a470e9952c169c"}
Sep 11 15:41:23.906761 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:23.906397    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"
Sep 11 15:41:23.933864 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:23.933809    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb" podStartSLOduration=1.933792558 podStartE2EDuration="1.933792558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:41:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:41:23.930873619 +0000 UTC m=+1958.390590630" watchObservedRunningTime="2026-09-11 15:41:23.933792558 +0000 UTC m=+1958.393509556"
Sep 11 15:41:34.913608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:41:34.913576    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xbnjb"
Sep 11 15:42:11.282892 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.282803    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"]
Sep 11 15:42:11.286877 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.286852    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.289515 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.289491    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-0cbe456e-kserve-self-signed-certs\""
Sep 11 15:42:11.295187 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.295164    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"]
Sep 11 15:42:11.436691 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.436657    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-dshm\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.436691 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.436690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-tmp-dir\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.436896 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.436728    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqjhw\" (UniqueName: \"kubernetes.io/projected/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-kube-api-access-fqjhw\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.436896 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.436772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-tls-certs\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.436896 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.436799    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-home\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.436896 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.436848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-model-cache\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.538250 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.538170    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-model-cache\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.538250 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.538224    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-dshm\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.538467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.538334    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-tmp-dir\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.538467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.538391    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqjhw\" (UniqueName: \"kubernetes.io/projected/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-kube-api-access-fqjhw\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.538467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.538413    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-tls-certs\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.538467 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.538447    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-home\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.538721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.538562    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-model-cache\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.538721 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.538701    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-tmp-dir\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.538802 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.538764    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-home\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.540564 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.540545    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-dshm\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.541174 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.541152    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-tls-certs\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.546451 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.546425    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqjhw\" (UniqueName: \"kubernetes.io/projected/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-kube-api-access-fqjhw\") pod \"e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") " pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.597606 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.597582    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:11.874244 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:11.874216    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"]
Sep 11 15:42:11.877095 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:42:11.877068    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf6d81ff_2132_4b28_94d9_08ecdeb36e7d.slice/crio-7623861cec10693357ab7faa42c04b6329dd960d543f349f46578c2d2878eb2e WatchSource:0}: Error finding container 7623861cec10693357ab7faa42c04b6329dd960d543f349f46578c2d2878eb2e: Status 404 returned error can't find the container with id 7623861cec10693357ab7faa42c04b6329dd960d543f349f46578c2d2878eb2e
Sep 11 15:42:12.137679 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:12.137583    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq" event={"ID":"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d","Type":"ContainerStarted","Data":"0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808"}
Sep 11 15:42:12.137679 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:12.137652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq" event={"ID":"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d","Type":"ContainerStarted","Data":"7623861cec10693357ab7faa42c04b6329dd960d543f349f46578c2d2878eb2e"}
Sep 11 15:42:12.156338 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:12.156285    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq" podStartSLOduration=1.156268768 podStartE2EDuration="1.156268768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:42:12.155203536 +0000 UTC m=+2006.614920538" watchObservedRunningTime="2026-09-11 15:42:12.156268768 +0000 UTC m=+2006.615985766"
Sep 11 15:42:21.598153 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:21.598113    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:21.598783 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:21.598180    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:21.610537 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:21.610507    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:22.200840 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:22.200814    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:42:44.801853 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:44.801810    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"]
Sep 11 15:42:59.822915 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:42:59.822873    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq" podUID="cf6d81ff-2132-4b28-94d9-08ecdeb36e7d" containerName="main" containerID="cri-o://0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808" gracePeriod=45
Sep 11 15:43:00.080127 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.080064    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:43:00.181283 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.181248    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-tmp-dir\") pod \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") "
Sep 11 15:43:00.181283 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.181288    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-model-cache\") pod \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") "
Sep 11 15:43:00.181535 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.181318    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-tls-certs\") pod \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") "
Sep 11 15:43:00.181535 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.181334    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-home\") pod \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") "
Sep 11 15:43:00.181535 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.181403    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqjhw\" (UniqueName: \"kubernetes.io/projected/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-kube-api-access-fqjhw\") pod \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") "
Sep 11 15:43:00.181535 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.181437    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-dshm\") pod \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\" (UID: \"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d\") "
Sep 11 15:43:00.181750 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.181638    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-model-cache" (OuterVolumeSpecName: "model-cache") pod "cf6d81ff-2132-4b28-94d9-08ecdeb36e7d" (UID: "cf6d81ff-2132-4b28-94d9-08ecdeb36e7d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:43:00.181750 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.181660    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cf6d81ff-2132-4b28-94d9-08ecdeb36e7d" (UID: "cf6d81ff-2132-4b28-94d9-08ecdeb36e7d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:43:00.181750 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.181672    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-home" (OuterVolumeSpecName: "home") pod "cf6d81ff-2132-4b28-94d9-08ecdeb36e7d" (UID: "cf6d81ff-2132-4b28-94d9-08ecdeb36e7d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:43:00.183752 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.183728    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-kube-api-access-fqjhw" (OuterVolumeSpecName: "kube-api-access-fqjhw") pod "cf6d81ff-2132-4b28-94d9-08ecdeb36e7d" (UID: "cf6d81ff-2132-4b28-94d9-08ecdeb36e7d"). InnerVolumeSpecName "kube-api-access-fqjhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:43:00.183852 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.183753    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cf6d81ff-2132-4b28-94d9-08ecdeb36e7d" (UID: "cf6d81ff-2132-4b28-94d9-08ecdeb36e7d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:43:00.183852 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.183791    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-dshm" (OuterVolumeSpecName: "dshm") pod "cf6d81ff-2132-4b28-94d9-08ecdeb36e7d" (UID: "cf6d81ff-2132-4b28-94d9-08ecdeb36e7d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 15:43:00.282154 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.282113    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqjhw\" (UniqueName: \"kubernetes.io/projected/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-kube-api-access-fqjhw\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:43:00.282154 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.282146    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-dshm\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:43:00.282154 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.282157    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-tmp-dir\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:43:00.282154 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.282166    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-model-cache\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:43:00.282437 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.282176    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-tls-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:43:00.282437 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.282185    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d-home\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:43:00.380678 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.380644    2574 generic.go:356] "Generic (PLEG): container finished" podID="cf6d81ff-2132-4b28-94d9-08ecdeb36e7d" containerID="0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808" exitCode=0
Sep 11 15:43:00.380858 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.380690    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"
Sep 11 15:43:00.380858 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.380714    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq" event={"ID":"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d","Type":"ContainerDied","Data":"0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808"}
Sep 11 15:43:00.380858 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.380758    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq" event={"ID":"cf6d81ff-2132-4b28-94d9-08ecdeb36e7d","Type":"ContainerDied","Data":"7623861cec10693357ab7faa42c04b6329dd960d543f349f46578c2d2878eb2e"}
Sep 11 15:43:00.380858 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.380776    2574 scope.go:117] "RemoveContainer" containerID="0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808"
Sep 11 15:43:00.389992 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.389973    2574 scope.go:117] "RemoveContainer" containerID="0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808"
Sep 11 15:43:00.390252 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:43:00.390234    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808\": container with ID starting with 0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808 not found: ID does not exist" containerID="0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808"
Sep 11 15:43:00.390299 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.390260    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808"} err="failed to get container status \"0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808\": rpc error: code = NotFound desc = could not find container \"0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808\": container with ID starting with 0af214fd8dfd51366a5f2d73ee4826e0afb0fcfc313ec8b64e00809d59ec7808 not found: ID does not exist"
Sep 11 15:43:00.400881 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.400855    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"]
Sep 11 15:43:00.404537 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:00.404515    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-0cbe456e-kserve-5ff64898f9-tg5jq"]
Sep 11 15:43:01.994997 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:01.994962    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf6d81ff-2132-4b28-94d9-08ecdeb36e7d" path="/var/lib/kubelet/pods/cf6d81ff-2132-4b28-94d9-08ecdeb36e7d/volumes"
Sep 11 15:43:08.029718 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.029588    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"]
Sep 11 15:43:08.030199 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.030181    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6d81ff-2132-4b28-94d9-08ecdeb36e7d" containerName="main"
Sep 11 15:43:08.030275 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.030202    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6d81ff-2132-4b28-94d9-08ecdeb36e7d" containerName="main"
Sep 11 15:43:08.030337 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.030282    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6d81ff-2132-4b28-94d9-08ecdeb36e7d" containerName="main"
Sep 11 15:43:08.035174 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.035148    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.044517 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.044287    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"]
Sep 11 15:43:08.153855 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.153814    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62ca0199-32fc-4362-8f98-7f41aabeb92f-maas-api-tls\") pod \"maas-api-cd89654bd-mbgtx\" (UID: \"62ca0199-32fc-4362-8f98-7f41aabeb92f\") " pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.154042 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.153886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5kmh\" (UniqueName: \"kubernetes.io/projected/62ca0199-32fc-4362-8f98-7f41aabeb92f-kube-api-access-k5kmh\") pod \"maas-api-cd89654bd-mbgtx\" (UID: \"62ca0199-32fc-4362-8f98-7f41aabeb92f\") " pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.154042 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.153937    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62ca0199-32fc-4362-8f98-7f41aabeb92f-openshift-service-ca\") pod \"maas-api-cd89654bd-mbgtx\" (UID: \"62ca0199-32fc-4362-8f98-7f41aabeb92f\") " pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.154042 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.153973    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62ca0199-32fc-4362-8f98-7f41aabeb92f-metrics-certs\") pod \"maas-api-cd89654bd-mbgtx\" (UID: \"62ca0199-32fc-4362-8f98-7f41aabeb92f\") " pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.254908 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.254872    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62ca0199-32fc-4362-8f98-7f41aabeb92f-metrics-certs\") pod \"maas-api-cd89654bd-mbgtx\" (UID: \"62ca0199-32fc-4362-8f98-7f41aabeb92f\") " pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.255073 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.254946    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62ca0199-32fc-4362-8f98-7f41aabeb92f-maas-api-tls\") pod \"maas-api-cd89654bd-mbgtx\" (UID: \"62ca0199-32fc-4362-8f98-7f41aabeb92f\") " pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.255073 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.254977    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5kmh\" (UniqueName: \"kubernetes.io/projected/62ca0199-32fc-4362-8f98-7f41aabeb92f-kube-api-access-k5kmh\") pod \"maas-api-cd89654bd-mbgtx\" (UID: \"62ca0199-32fc-4362-8f98-7f41aabeb92f\") " pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.255073 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.255002    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62ca0199-32fc-4362-8f98-7f41aabeb92f-openshift-service-ca\") pod \"maas-api-cd89654bd-mbgtx\" (UID: \"62ca0199-32fc-4362-8f98-7f41aabeb92f\") " pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.255709 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.255663    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62ca0199-32fc-4362-8f98-7f41aabeb92f-openshift-service-ca\") pod \"maas-api-cd89654bd-mbgtx\" (UID: \"62ca0199-32fc-4362-8f98-7f41aabeb92f\") " pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.257440 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.257409    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62ca0199-32fc-4362-8f98-7f41aabeb92f-metrics-certs\") pod \"maas-api-cd89654bd-mbgtx\" (UID: \"62ca0199-32fc-4362-8f98-7f41aabeb92f\") " pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.257552 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.257534    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62ca0199-32fc-4362-8f98-7f41aabeb92f-maas-api-tls\") pod \"maas-api-cd89654bd-mbgtx\" (UID: \"62ca0199-32fc-4362-8f98-7f41aabeb92f\") " pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.262681 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.262660    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5kmh\" (UniqueName: \"kubernetes.io/projected/62ca0199-32fc-4362-8f98-7f41aabeb92f-kube-api-access-k5kmh\") pod \"maas-api-cd89654bd-mbgtx\" (UID: \"62ca0199-32fc-4362-8f98-7f41aabeb92f\") " pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.348292 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.348211    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:08.622048 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:08.622024    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"]
Sep 11 15:43:08.624299 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:43:08.624271    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ca0199_32fc_4362_8f98_7f41aabeb92f.slice/crio-a642f955139d0e75d05c6f69e04aea5a3c03616eb78253b17152d817c7e25279 WatchSource:0}: Error finding container a642f955139d0e75d05c6f69e04aea5a3c03616eb78253b17152d817c7e25279: Status 404 returned error can't find the container with id a642f955139d0e75d05c6f69e04aea5a3c03616eb78253b17152d817c7e25279
Sep 11 15:43:09.425417 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:09.425384    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx" event={"ID":"62ca0199-32fc-4362-8f98-7f41aabeb92f","Type":"ContainerStarted","Data":"acd268a332b6c98004a4a2fa90cc243ec67535b0f42662a6222308bbb1dc7807"}
Sep 11 15:43:09.425933 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:09.425440    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx" event={"ID":"62ca0199-32fc-4362-8f98-7f41aabeb92f","Type":"ContainerStarted","Data":"a642f955139d0e75d05c6f69e04aea5a3c03616eb78253b17152d817c7e25279"}
Sep 11 15:43:09.425933 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:09.425472    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:09.441770 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:09.441677    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx" podStartSLOduration=1.007487312 podStartE2EDuration="1.441654529s" totalImagesPullingTime="434.167217ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 15:43:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:43:09.441360985 +0000 UTC m=+2063.901077984" watchObservedRunningTime="2026-09-11 15:43:09.441654529 +0000 UTC m=+2063.901371528"
Sep 11 15:43:15.436709 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:15.436683    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-cd89654bd-mbgtx"
Sep 11 15:43:22.636907 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:22.636869    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"]
Sep 11 15:43:22.637377 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:22.637129    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh" podUID="0959529e-aa82-43b0-ab63-476d6bf6e6e7" containerName="maas-api" containerID="cri-o://993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40" gracePeriod=30
Sep 11 15:43:23.456626 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:23.456581    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh" podUID="0959529e-aa82-43b0-ab63-476d6bf6e6e7" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.37:8443/health\": dial tcp 10.134.0.37:8443: connect: connection refused"
Sep 11 15:43:23.880134 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:23.880100    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:43:23.997648 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:23.997562    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0959529e-aa82-43b0-ab63-476d6bf6e6e7-openshift-service-ca\") pod \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") "
Sep 11 15:43:23.997648 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:23.997609    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwcrr\" (UniqueName: \"kubernetes.io/projected/0959529e-aa82-43b0-ab63-476d6bf6e6e7-kube-api-access-mwcrr\") pod \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") "
Sep 11 15:43:23.997838 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:23.997694    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0959529e-aa82-43b0-ab63-476d6bf6e6e7-maas-api-tls\") pod \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") "
Sep 11 15:43:23.997838 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:23.997745    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0959529e-aa82-43b0-ab63-476d6bf6e6e7-metrics-certs\") pod \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\" (UID: \"0959529e-aa82-43b0-ab63-476d6bf6e6e7\") "
Sep 11 15:43:23.997986 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:23.997957    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0959529e-aa82-43b0-ab63-476d6bf6e6e7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0959529e-aa82-43b0-ab63-476d6bf6e6e7" (UID: "0959529e-aa82-43b0-ab63-476d6bf6e6e7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 15:43:23.999913 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:23.999878    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0959529e-aa82-43b0-ab63-476d6bf6e6e7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0959529e-aa82-43b0-ab63-476d6bf6e6e7" (UID: "0959529e-aa82-43b0-ab63-476d6bf6e6e7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:43:23.999996 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:23.999921    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0959529e-aa82-43b0-ab63-476d6bf6e6e7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0959529e-aa82-43b0-ab63-476d6bf6e6e7" (UID: "0959529e-aa82-43b0-ab63-476d6bf6e6e7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 15:43:23.999996 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:23.999921    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0959529e-aa82-43b0-ab63-476d6bf6e6e7-kube-api-access-mwcrr" (OuterVolumeSpecName: "kube-api-access-mwcrr") pod "0959529e-aa82-43b0-ab63-476d6bf6e6e7" (UID: "0959529e-aa82-43b0-ab63-476d6bf6e6e7"). InnerVolumeSpecName "kube-api-access-mwcrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 15:43:24.099024 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.098996    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0959529e-aa82-43b0-ab63-476d6bf6e6e7-metrics-certs\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:43:24.099024 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.099021    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0959529e-aa82-43b0-ab63-476d6bf6e6e7-openshift-service-ca\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:43:24.099202 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.099030    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwcrr\" (UniqueName: \"kubernetes.io/projected/0959529e-aa82-43b0-ab63-476d6bf6e6e7-kube-api-access-mwcrr\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:43:24.099202 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.099039    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0959529e-aa82-43b0-ab63-476d6bf6e6e7-maas-api-tls\") on node \"ip-10-0-138-215.ec2.internal\" DevicePath \"\""
Sep 11 15:43:24.498806 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.498768    2574 generic.go:356] "Generic (PLEG): container finished" podID="0959529e-aa82-43b0-ab63-476d6bf6e6e7" containerID="993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40" exitCode=0
Sep 11 15:43:24.498966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.498811    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"
Sep 11 15:43:24.498966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.498854    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh" event={"ID":"0959529e-aa82-43b0-ab63-476d6bf6e6e7","Type":"ContainerDied","Data":"993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40"}
Sep 11 15:43:24.498966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.498904    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh" event={"ID":"0959529e-aa82-43b0-ab63-476d6bf6e6e7","Type":"ContainerDied","Data":"142751dea7d5ba2832a344a0aa0276fbef35177c018b8e44f75dd58749beebdd"}
Sep 11 15:43:24.498966 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.498928    2574 scope.go:117] "RemoveContainer" containerID="993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40"
Sep 11 15:43:24.508139 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.508120    2574 scope.go:117] "RemoveContainer" containerID="993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40"
Sep 11 15:43:24.508393 ip-10-0-138-215 kubenswrapper[2574]: E0911 15:43:24.508376    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40\": container with ID starting with 993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40 not found: ID does not exist" containerID="993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40"
Sep 11 15:43:24.508438 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.508404    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40"} err="failed to get container status \"993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40\": rpc error: code = NotFound desc = could not find container \"993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40\": container with ID starting with 993cd63c1bd5948a988581d8de4b47dd59b7c2e579a45e8034196c9ad9ac9a40 not found: ID does not exist"
Sep 11 15:43:24.519500 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.519481    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"]
Sep 11 15:43:24.522475 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:24.522454    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b6fb88c84-dbbmh"]
Sep 11 15:43:26.000675 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:26.000644    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0959529e-aa82-43b0-ab63-476d6bf6e6e7" path="/var/lib/kubelet/pods/0959529e-aa82-43b0-ab63-476d6bf6e6e7/volumes"
Sep 11 15:43:37.743776 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:37.743738    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c844bc58-dhspd_47185cc0-91ac-43e1-9be4-f750489d71df/authorino/0.log"
Sep 11 15:43:43.206308 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:43.206274    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zs2fk_d82d1815-29af-4e5d-8aec-6191e37c0282/manager/0.log"
Sep 11 15:43:43.325249 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:43.325220    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8mn2j_cfbcec46-30a2-4b6e-846f-a95c74b0cc88/manager/0.log"
Sep 11 15:43:43.444683 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:43.444653    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-89f8bdf64-5jwgp_e7256fd9-a4ef-4980-acb0-1f493ff313f3/manager/0.log"
Sep 11 15:43:43.919559 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:43.919529    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87954dbdf-8bh4v_fc57b77d-e890-4662-85ee-722b6735d0c8/copy-manifests/0.log"
Sep 11 15:43:43.931294 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:43.931270    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87954dbdf-8bh4v_fc57b77d-e890-4662-85ee-722b6735d0c8/manager/0.log"
Sep 11 15:43:44.412546 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:44.412524    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-cd89654bd-mbgtx_62ca0199-32fc-4362-8f98-7f41aabeb92f/maas-api/0.log"
Sep 11 15:43:44.750713 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:44.750638    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-v4zkc_6ded728e-7824-4eab-8503-5e327b86ebb2/postgres/0.log"
Sep 11 15:43:45.513986 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:45.513953    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c844bc58-dhspd_47185cc0-91ac-43e1-9be4-f750489d71df/authorino/0.log"
Sep 11 15:43:45.628848 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:45.628822    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-jkfs4_6885e70b-8735-4dcf-a209-9ea73d422e55/manager/0.log"
Sep 11 15:43:45.739544 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:45.739518    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-bh4bv_85e26c9f-1b35-4352-81bb-4463f2c8697a/manager/0.log"
Sep 11 15:43:45.843921 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:45.843855    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-b2kvd_2177d6e5-86a2-46b6-b2f4-016e45011b19/kuadrant-console-plugin/0.log"
Sep 11 15:43:45.960401 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:45.960377    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-xbnjb_a8cf98c6-4747-49df-834e-8be2d185c95f/manager/0.log"
Sep 11 15:43:46.539076 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:46.539047    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cstcvc_1e36c575-4d64-4153-9702-9636e4cd0dfd/istio-proxy/0.log"
Sep 11 15:43:46.871577 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:46.871553    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85b8bff76-p9fgz_7aa4add0-de80-4e59-be7d-914d361b8a16/kube-auth-proxy/0.log"
Sep 11 15:43:46.990299 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:46.990268    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wgwc4_5b2702f2-528f-4c94-8a00-cf65bbf8031d/istio-proxy/1.log"
Sep 11 15:43:47.263654 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:47.263564    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jdnwd_1efdddb6-ee3c-4f1a-8474-2dc38031e665/payload-processing/0.log"
Sep 11 15:43:47.385662 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:47.385605    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ff9ffd588-8d7t4_92321919-f0c2-4635-a454-4601466d148b/router/0.log"
Sep 11 15:43:47.837969 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:47.837943    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-dvzcm_2b74388a-f9ea-44de-a5dd-53c15b375e0f/main/0.log"
Sep 11 15:43:48.396119 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:48.396091    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-jjxbv_bbcfbd0b-4e75-49f6-ae04-702671ee6d78/main/0.log"
Sep 11 15:43:56.442279 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:56.442229    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-564ps_0163d627-b988-4307-a7df-d5c3971306ff/global-pull-secret-syncer/0.log"
Sep 11 15:43:56.612894 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:56.612840    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8x5g2_cba69abe-6178-4c82-9abb-bb8deb31ffaf/konnectivity-agent/0.log"
Sep 11 15:43:56.719139 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:43:56.719049    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-215.ec2.internal_34fcac9a5f075670faf70c4db03d88c0/haproxy/0.log"
Sep 11 15:44:01.665327 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:01.665292    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c844bc58-dhspd_47185cc0-91ac-43e1-9be4-f750489d71df/authorino/0.log"
Sep 11 15:44:01.691254 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:01.691224    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-jkfs4_6885e70b-8735-4dcf-a209-9ea73d422e55/manager/0.log"
Sep 11 15:44:01.723627 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:01.723592    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-bh4bv_85e26c9f-1b35-4352-81bb-4463f2c8697a/manager/0.log"
Sep 11 15:44:01.752448 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:01.752425    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-b2kvd_2177d6e5-86a2-46b6-b2f4-016e45011b19/kuadrant-console-plugin/0.log"
Sep 11 15:44:01.800758 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:01.800727    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-xbnjb_a8cf98c6-4747-49df-834e-8be2d185c95f/manager/0.log"
Sep 11 15:44:03.269879 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:03.269848    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b25df72c-490c-4d4b-a397-9375cc3450d4/alertmanager/0.log"
Sep 11 15:44:03.295303 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:03.295281    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b25df72c-490c-4d4b-a397-9375cc3450d4/config-reloader/0.log"
Sep 11 15:44:03.323218 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:03.323201    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b25df72c-490c-4d4b-a397-9375cc3450d4/kube-rbac-proxy-web/0.log"
Sep 11 15:44:03.346405 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:03.346390    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b25df72c-490c-4d4b-a397-9375cc3450d4/kube-rbac-proxy/0.log"
Sep 11 15:44:03.370268 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:03.370252    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b25df72c-490c-4d4b-a397-9375cc3450d4/kube-rbac-proxy-metric/0.log"
Sep 11 15:44:03.394887 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:03.394869    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b25df72c-490c-4d4b-a397-9375cc3450d4/prom-label-proxy/0.log"
Sep 11 15:44:03.418290 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:03.418273    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b25df72c-490c-4d4b-a397-9375cc3450d4/init-config-reloader/0.log"
Sep 11 15:44:03.733741 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:03.733721    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kt8sz_d0556a24-0d76-4d3f-b78f-e7c96ac550d4/node-exporter/0.log"
Sep 11 15:44:03.762156 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:03.762138    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kt8sz_d0556a24-0d76-4d3f-b78f-e7c96ac550d4/kube-rbac-proxy/0.log"
Sep 11 15:44:03.792242 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:03.792217    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kt8sz_d0556a24-0d76-4d3f-b78f-e7c96ac550d4/init-textfile/0.log"
Sep 11 15:44:06.452498 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.452463    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"]
Sep 11 15:44:06.452899 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.452885    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0959529e-aa82-43b0-ab63-476d6bf6e6e7" containerName="maas-api"
Sep 11 15:44:06.452944 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.452901    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0959529e-aa82-43b0-ab63-476d6bf6e6e7" containerName="maas-api"
Sep 11 15:44:06.452983 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.452974    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0959529e-aa82-43b0-ab63-476d6bf6e6e7" containerName="maas-api"
Sep 11 15:44:06.456072 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.456054    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.458863 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.458841    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7pwf\"/\"openshift-service-ca.crt\""
Sep 11 15:44:06.458998 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.458955    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c7pwf\"/\"default-dockercfg-5nlz8\""
Sep 11 15:44:06.459871 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.459854    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7pwf\"/\"kube-root-ca.crt\""
Sep 11 15:44:06.466831 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.466812    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"]
Sep 11 15:44:06.539442 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.539411    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a5e148f-a187-4e34-ba46-24034bdb3300-proc\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.539608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.539463    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxcxd\" (UniqueName: \"kubernetes.io/projected/9a5e148f-a187-4e34-ba46-24034bdb3300-kube-api-access-lxcxd\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.539608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.539483    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a5e148f-a187-4e34-ba46-24034bdb3300-podres\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.539608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.539515    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a5e148f-a187-4e34-ba46-24034bdb3300-sys\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.539608 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.539544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a5e148f-a187-4e34-ba46-24034bdb3300-lib-modules\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.640369 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.640337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a5e148f-a187-4e34-ba46-24034bdb3300-proc\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.640530 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.640381    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxcxd\" (UniqueName: \"kubernetes.io/projected/9a5e148f-a187-4e34-ba46-24034bdb3300-kube-api-access-lxcxd\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.640530 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.640407    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a5e148f-a187-4e34-ba46-24034bdb3300-podres\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.640530 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.640439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a5e148f-a187-4e34-ba46-24034bdb3300-sys\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.640530 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.640459    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a5e148f-a187-4e34-ba46-24034bdb3300-proc\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.640530 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.640497    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a5e148f-a187-4e34-ba46-24034bdb3300-lib-modules\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.640530 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.640503    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a5e148f-a187-4e34-ba46-24034bdb3300-sys\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.640831 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.640564    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a5e148f-a187-4e34-ba46-24034bdb3300-podres\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.640831 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.640626    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a5e148f-a187-4e34-ba46-24034bdb3300-lib-modules\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.648729 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.648708    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxcxd\" (UniqueName: \"kubernetes.io/projected/9a5e148f-a187-4e34-ba46-24034bdb3300-kube-api-access-lxcxd\") pod \"perf-node-gather-daemonset-bz7g9\" (UID: \"9a5e148f-a187-4e34-ba46-24034bdb3300\") " pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:06.766171 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:06.766099    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:07.035218 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:07.035194    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"]
Sep 11 15:44:07.036815 ip-10-0-138-215 kubenswrapper[2574]: W0911 15:44:07.036787    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9a5e148f_a187_4e34_ba46_24034bdb3300.slice/crio-f5be99b600144a6f438c49216532c49b6f60aba3deee23ac33e542a11c27bd0c WatchSource:0}: Error finding container f5be99b600144a6f438c49216532c49b6f60aba3deee23ac33e542a11c27bd0c: Status 404 returned error can't find the container with id f5be99b600144a6f438c49216532c49b6f60aba3deee23ac33e542a11c27bd0c
Sep 11 15:44:07.701090 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:07.701050    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9" event={"ID":"9a5e148f-a187-4e34-ba46-24034bdb3300","Type":"ContainerStarted","Data":"cf126d336d37f4b6519625250f8f9354806b6a6d688840559a0bba4384f91551"}
Sep 11 15:44:07.701499 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:07.701150    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9" event={"ID":"9a5e148f-a187-4e34-ba46-24034bdb3300","Type":"ContainerStarted","Data":"f5be99b600144a6f438c49216532c49b6f60aba3deee23ac33e542a11c27bd0c"}
Sep 11 15:44:07.701499 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:07.701274    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:07.720892 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:07.720844    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9" podStartSLOduration=1.720830201 podStartE2EDuration="1.720830201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 15:44:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 15:44:07.718330438 +0000 UTC m=+2122.178047429" watchObservedRunningTime="2026-09-11 15:44:07.720830201 +0000 UTC m=+2122.180547199"
Sep 11 15:44:07.856304 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:07.856279    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-ktskk_4ba73a4b-2fd0-48c5-9968-bf039932ca57/volume-data-source-validator/0.log"
Sep 11 15:44:08.900001 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:08.899967    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4cjxh_5dff78c9-a59f-45c1-90ff-98e020990538/dns/0.log"
Sep 11 15:44:08.922226 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:08.922203    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4cjxh_5dff78c9-a59f-45c1-90ff-98e020990538/kube-rbac-proxy/0.log"
Sep 11 15:44:09.047268 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:09.047233    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6hhmc_2608766e-f60a-4e61-846a-4f569aab6e5b/dns-node-resolver/0.log"
Sep 11 15:44:09.659406 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:09.659375    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kbnd2_3185ded6-e599-494c-8445-ec7d3e8eb611/node-ca/0.log"
Sep 11 15:44:10.663332 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:10.663297    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cstcvc_1e36c575-4d64-4153-9702-9636e4cd0dfd/istio-proxy/0.log"
Sep 11 15:44:11.052262 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:11.052183    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85b8bff76-p9fgz_7aa4add0-de80-4e59-be7d-914d361b8a16/kube-auth-proxy/0.log"
Sep 11 15:44:11.085425 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:11.085403    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wgwc4_5b2702f2-528f-4c94-8a00-cf65bbf8031d/istio-proxy/0.log"
Sep 11 15:44:11.093416 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:11.093398    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wgwc4_5b2702f2-528f-4c94-8a00-cf65bbf8031d/istio-proxy/1.log"
Sep 11 15:44:11.173230 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:11.173203    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jdnwd_1efdddb6-ee3c-4f1a-8474-2dc38031e665/payload-processing/0.log"
Sep 11 15:44:11.198051 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:11.198012    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ff9ffd588-8d7t4_92321919-f0c2-4635-a454-4601466d148b/router/0.log"
Sep 11 15:44:12.049726 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:12.049703    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m99lc_226b5e7c-1a27-4c4d-a559-eb75e44a6d52/serve-healthcheck-canary/0.log"
Sep 11 15:44:12.583673 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:12.583638    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-22ppp_6d909c90-2653-4d91-a82c-4774d65db370/insights-operator/0.log"
Sep 11 15:44:12.583901 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:12.583884    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-22ppp_6d909c90-2653-4d91-a82c-4774d65db370/insights-operator/1.log"
Sep 11 15:44:12.696534 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:12.696503    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lh82f_752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8/kube-rbac-proxy/0.log"
Sep 11 15:44:12.719551 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:12.719529    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lh82f_752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8/exporter/0.log"
Sep 11 15:44:12.742101 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:12.742077    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lh82f_752cdc71-9e33-4ca8-b8fd-6aaba05d3ad8/extractor/0.log"
Sep 11 15:44:13.715508 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:13.715485    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c7pwf/perf-node-gather-daemonset-bz7g9"
Sep 11 15:44:15.042915 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:15.042890    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zs2fk_d82d1815-29af-4e5d-8aec-6191e37c0282/manager/0.log"
Sep 11 15:44:15.209826 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:15.209794    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8mn2j_cfbcec46-30a2-4b6e-846f-a95c74b0cc88/manager/0.log"
Sep 11 15:44:15.253666 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:15.253573    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-89f8bdf64-5jwgp_e7256fd9-a4ef-4980-acb0-1f493ff313f3/manager/0.log"
Sep 11 15:44:15.485313 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:15.485289    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87954dbdf-8bh4v_fc57b77d-e890-4662-85ee-722b6735d0c8/manager/0.log"
Sep 11 15:44:15.508650 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:15.508563    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87954dbdf-8bh4v_fc57b77d-e890-4662-85ee-722b6735d0c8/copy-manifests/0.log"
Sep 11 15:44:16.889437 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:16.889407    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cstcvc_1e36c575-4d64-4153-9702-9636e4cd0dfd/istio-proxy/0.log"
Sep 11 15:44:17.242067 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:17.241988    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85b8bff76-p9fgz_7aa4add0-de80-4e59-be7d-914d361b8a16/kube-auth-proxy/0.log"
Sep 11 15:44:17.284569 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:17.284535    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wgwc4_5b2702f2-528f-4c94-8a00-cf65bbf8031d/istio-proxy/0.log"
Sep 11 15:44:17.290826 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:17.290806    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wgwc4_5b2702f2-528f-4c94-8a00-cf65bbf8031d/istio-proxy/1.log"
Sep 11 15:44:17.358199 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:17.358177    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jdnwd_1efdddb6-ee3c-4f1a-8474-2dc38031e665/payload-processing/0.log"
Sep 11 15:44:17.375045 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:17.375022    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ff9ffd588-8d7t4_92321919-f0c2-4635-a454-4601466d148b/router/0.log"
Sep 11 15:44:18.841471 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:18.841448    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cstcvc_1e36c575-4d64-4153-9702-9636e4cd0dfd/istio-proxy/0.log"
Sep 11 15:44:19.180758 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:19.180734    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85b8bff76-p9fgz_7aa4add0-de80-4e59-be7d-914d361b8a16/kube-auth-proxy/0.log"
Sep 11 15:44:19.214466 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:19.214438    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wgwc4_5b2702f2-528f-4c94-8a00-cf65bbf8031d/istio-proxy/0.log"
Sep 11 15:44:19.222173 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:19.222158    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wgwc4_5b2702f2-528f-4c94-8a00-cf65bbf8031d/istio-proxy/1.log"
Sep 11 15:44:19.276153 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:19.276130    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jdnwd_1efdddb6-ee3c-4f1a-8474-2dc38031e665/payload-processing/0.log"
Sep 11 15:44:19.292728 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:19.292700    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ff9ffd588-8d7t4_92321919-f0c2-4635-a454-4601466d148b/router/0.log"
Sep 11 15:44:22.140415 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:22.140376    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-h9rf7_5745c1b2-45ad-4f40-a7e3-94121b52cec9/migrator/0.log"
Sep 11 15:44:22.161915 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:22.161895    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-h9rf7_5745c1b2-45ad-4f40-a7e3-94121b52cec9/graceful-termination/0.log"
Sep 11 15:44:23.630378 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:23.630351    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlqk7_b770d260-7414-4aa1-b96e-ca8e653982f7/kube-multus-additional-cni-plugins/0.log"
Sep 11 15:44:23.670923 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:23.670902    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlqk7_b770d260-7414-4aa1-b96e-ca8e653982f7/egress-router-binary-copy/0.log"
Sep 11 15:44:23.715501 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:23.715474    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlqk7_b770d260-7414-4aa1-b96e-ca8e653982f7/cni-plugins/0.log"
Sep 11 15:44:23.781030 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:23.781004    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlqk7_b770d260-7414-4aa1-b96e-ca8e653982f7/bond-cni-plugin/0.log"
Sep 11 15:44:23.829600 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:23.829573    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlqk7_b770d260-7414-4aa1-b96e-ca8e653982f7/routeoverride-cni/0.log"
Sep 11 15:44:23.853525 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:23.853504    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlqk7_b770d260-7414-4aa1-b96e-ca8e653982f7/whereabouts-cni-bincopy/0.log"
Sep 11 15:44:23.876720 ip-10-0-138-215 kubenswrapper[2574]: I0911 15:44:23.876700    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlqk7_b770d260-7414-4aa1-b96e-ca8e653982f7/whereabouts-cni/0.log"