Sep 16 18:14:16.235798 ip-10-0-130-4 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 18:14:16.235807 ip-10-0-130-4 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 18:14:16.235814 ip-10-0-130-4 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 18:14:16.236099 ip-10-0-130-4 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 18:14:26.355918 ip-10-0-130-4 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 18:14:26.355934 ip-10-0-130-4 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b488da2cee7e45c1966c048a5446d9b6 --
Sep 16 18:16:21.245638 ip-10-0-130-4 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 18:16:21.652265 ip-10-0-130-4 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 18:16:21.652265 ip-10-0-130-4 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 18:16:21.652265 ip-10-0-130-4 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 18:16:21.652265 ip-10-0-130-4 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 18:16:21.652265 ip-10-0-130-4 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 18:16:21.653298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.653213    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 18:16:21.658145 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658129    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 18:16:21.658145 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658146    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658150    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658155    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658159    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658163    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658166    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658169    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658172    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658174    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658177    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658179    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658182    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658185    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658187    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658190    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658193    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658195    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658197    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658202    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658204    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 18:16:21.658207 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658207    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658209    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658212    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658214    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658217    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658220    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658223    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658226    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658228    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658230    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658233    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658235    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658238    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658240    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658243    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658245    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658248    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658250    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658253    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658255    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 18:16:21.658678 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658258    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658260    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658262    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658265    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658267    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658270    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658272    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658274    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658277    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658279    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658283    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658286    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658288    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658290    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658294    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658296    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658299    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658301    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658304    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658306    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 18:16:21.659146 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658309    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658311    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658314    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658317    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658319    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658322    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658325    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658327    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658330    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658332    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658335    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658337    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658340    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658343    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658346    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658349    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658352    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658356    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658358    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 18:16:21.659626 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658361    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658376    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658381    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658383    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658386    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658389    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658392    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658395    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658399    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658401    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658404    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658406    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658409    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658411    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658414    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658417    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658421    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658423    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.658426    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 18:16:21.660070 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659847    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659856    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659859    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659862    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659865    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659869    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659873    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659876    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659879    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659882    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659884    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659887    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659889    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659891    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659894    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659896    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659899    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659902    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659904    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659907    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 18:16:21.660562 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659911    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659913    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659917    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659920    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659923    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659926    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659929    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659932    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659935    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659937    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659940    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659942    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659944    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659947    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659949    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659951    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659954    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659957    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659959    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 18:16:21.661033 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659962    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659964    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659967    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659969    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659972    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659975    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659978    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659980    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659983    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659985    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659988    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659990    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659993    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659996    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.659999    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660001    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660003    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660006    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660008    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660011    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 18:16:21.661496 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660013    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660016    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660018    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660021    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660023    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660026    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660028    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660031    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660033    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660035    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660038    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660040    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660043    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660045    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660047    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660050    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660053    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660056    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660060    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660062    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 18:16:21.661971 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660064    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660067    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660069    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660072    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660076    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660080    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660083    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660085    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660088    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660090    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660093    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660095    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660097    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660100    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660102    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660104    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660107    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660109    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660111    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 18:16:21.662464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660114    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660495    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660500    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660503    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660506    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660509    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660512    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660514    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660517    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660520    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660522    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660525    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660528    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660530    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660532    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660535    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660538    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660543    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660545    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660548    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 18:16:21.662919 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660551    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660554    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660556    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660559    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660561    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660564    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660566    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660569    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660571    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660574    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660576    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660579    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660581    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660584    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660586    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660589    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660592    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660595    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660598    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660600    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 18:16:21.663388 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660603    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660605    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660608    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660611    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660613    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660616    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660619    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660621    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660624    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660626    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660629    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660632    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660637    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660639    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660642    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660644    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660647    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660649    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660651    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660655    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 18:16:21.663856 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660659    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660662    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660664    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660667    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660669    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660672    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660674    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660677    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660679    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660682    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660685    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660687    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660689    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660692    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660694    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660697    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660699    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660701    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660704    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660706    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 18:16:21.664320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660709    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660713    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660715    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660718    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660720    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660723    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660725    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660727    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660730    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660734    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660737    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660739    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660743    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660746    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660749    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660751    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660754    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660756    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660759    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 18:16:21.664842 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.660761    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660837    2580 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660881    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660888    2580 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660892    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660896    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660899    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660903    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660907    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660910    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660913    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660916    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660919    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660922    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660925    2580 flags.go:64] FLAG: --cgroup-root=""
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660928    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660931    2580 flags.go:64] FLAG: --client-ca-file=""
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660934    2580 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660937    2580 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660941    2580 flags.go:64] FLAG: --cluster-domain=""
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660944    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660947    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660950    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660953    2580 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 18:16:21.665282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660957    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660960    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660963    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660966    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660969    2580 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660972    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660974    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660977    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660980    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660984    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660987    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660990    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660993    2580 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660996    2580 flags.go:64] FLAG: --enable-server="true"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.660999    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661003    2580 flags.go:64] FLAG: --event-burst="100"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661006    2580 flags.go:64] FLAG: --event-qps="50"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661009    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661012    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661015    2580 flags.go:64] FLAG: --eviction-hard=""
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661018    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661021    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661024    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661026    2580 flags.go:64] FLAG: --eviction-soft=""
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661029    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 18:16:21.665851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661032    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661035    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661038    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661041    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661044    2580 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661047    2580 flags.go:64] FLAG: --feature-gates=""
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661051    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661053    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661056    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661060    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661062    2580 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661065    2580 flags.go:64] FLAG: --help="false"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661068    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-130-4.ec2.internal"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661071    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661074    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661077    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661080    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661084    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661087    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661089    2580 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661092    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661095    2580 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661098    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661101    2580 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 18:16:21.666489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661104    2580 flags.go:64] FLAG: --kube-reserved=""
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661107    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661109    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661112    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661117    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661120    2580 flags.go:64] FLAG: --lock-file=""
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661123    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661125    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661128    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661134    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661137    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661140    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661143    2580 flags.go:64] FLAG: --logging-format="text"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661146    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661149    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661152    2580 flags.go:64] FLAG: --manifest-url=""
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661155    2580 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661159    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661162    2580 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661165    2580 flags.go:64] FLAG: --max-pods="110"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661168    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661171    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661174    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661177    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661180    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 18:16:21.667052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661187    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661190    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661196    2580 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661200    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661203    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661206    2580 flags.go:64] FLAG: --pod-cidr=""
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661209    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661214    2580 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661217    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661220    2580 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661223    2580 flags.go:64] FLAG: --port="10250"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661227    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661230    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fdcd042a35be5807"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661233    2580 flags.go:64] FLAG: --qos-reserved=""
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661236    2580 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661239    2580 flags.go:64] FLAG: --register-node="true"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661242    2580 flags.go:64] FLAG: --register-with-taints=""
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661245    2580 flags.go:64] FLAG: --registry-burst="10"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661248    2580 flags.go:64] FLAG: --registry-qps="5"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661251    2580 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661254    2580 flags.go:64] FLAG: --reserved-memory=""
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661258    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661261    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661264    2580 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661267    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 18:16:21.667697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661270    2580 flags.go:64] FLAG: --runonce="false"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661273    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661276    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661279    2580 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661282    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661284    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661287    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661290    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661295    2580 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661298    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661301    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661303    2580 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661306    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661309    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661312    2580 flags.go:64] FLAG: --system-cgroups=""
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661315    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661320    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661323    2580 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661327    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661331    2580 flags.go:64] FLAG: --tls-min-version=""
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661334    2580 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661337    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661339    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661342    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661345    2580 flags.go:64] FLAG: --v="2"
Sep 16 18:16:21.668747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661349    2580 flags.go:64] FLAG: --version="false"
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661353    2580 flags.go:64] FLAG: --vmodule=""
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661356    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661360    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661486    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661491    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661494    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661497    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661501    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661504    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661507    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661510    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661513    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661516    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661519    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661523    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661526    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661528    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661531    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661534    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 18:16:21.669804 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661536    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661539    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661541    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661544    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661548    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661552    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661555    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661558    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661561    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661564    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661566    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661569    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661571    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661574    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661576    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661579    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661582    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661584    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661587    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 18:16:21.670667 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661590    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661592    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661595    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661597    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661600    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661602    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661605    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661608    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661611    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661614    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661617    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661621    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661624    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661627    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661630    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661632    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661635    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661639    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661642    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 18:16:21.671258 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661645    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661648    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661651    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661653    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661656    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661659    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661661    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661663    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661666    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661669    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661671    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661674    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661677    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661679    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661682    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661685    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661687    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661689    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661692    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661694    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 18:16:21.671733 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661697    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661701    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661703    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661706    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661708    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661710    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661713    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661716    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661718    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661721    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661723    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661727    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661730    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661732    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661735    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661737    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661740    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661742    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661745    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661748    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 18:16:21.672302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661751    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661753    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661756    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661758    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.661761    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.661766    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.672506    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.672520    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.672537    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.672546    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672600    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672606    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672610    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672613    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 18:16:21.672803 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672616    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672619    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672622    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672625    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672629    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672632    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672635    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672637    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672640    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672643    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672646    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672649    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672651    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672654    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672657    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672659    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672662    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672664    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672667    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 18:16:21.673187 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672669    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672673    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672676    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672679    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672682    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672684    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672686    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672689    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672691    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672694    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672696    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672699    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672701    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672704    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672706    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672709    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672712    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672714    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672717    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672719    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 18:16:21.673654 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672721    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672724    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672726    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672730    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672733    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672736    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672738    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672741    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672743    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672746    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672749    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672751    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672754    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672757    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672760    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672763    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672765    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672768    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672770    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672772    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 18:16:21.674211 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672775    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672777    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672780    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672782    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672785    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672787    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672790    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672793    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672795    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672798    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672800    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672804    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672806    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672809    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672812    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672814    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672819    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672823    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672827    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 18:16:21.674750 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672830    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672833    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672835    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672838    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672842    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672845    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672847    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672850    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672853    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672855    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672858    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672860    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672863    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672865    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672868    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672871    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 18:16:21.675190 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672873    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.672878    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672981    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672986    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672989    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672992    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672995    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.672997    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673000    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673003    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673005    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673008    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673011    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673013    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673017    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 18:16:21.675586 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673019    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673022    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673024    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673027    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673029    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673032    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673035    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673037    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673040    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673043    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673046    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673048    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673051    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673053    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673056    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673058    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673061    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673063    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673066    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673068    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 18:16:21.676009 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673071    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673074    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673076    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673079    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673081    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673084    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673086    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673089    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673091    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673094    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673096    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673099    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673102    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673105    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673107    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673110    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673112    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673116    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673120    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 18:16:21.676502 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673123    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673126    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673129    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673131    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673134    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673137    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673139    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673142    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673145    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673147    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673150    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673153    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673155    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673158    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673160    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673163    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673166    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673168    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673171    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 18:16:21.676946 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673173    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673176    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673180    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673183    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673185    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673188    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673191    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673194    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673197    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673199    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673202    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673204    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673207    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673210    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673214    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673217    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673220    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673223    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673225    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 18:16:21.677406 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673228    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673230    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673233    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673236    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673240    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673243    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673246    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673248    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:21.673251    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.673255    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.673351    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.675504    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.676473    2580 server.go:1019] "Starting client certificate rotation"
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.676564    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 18:16:21.677845 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.676599    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 18:16:21.678831 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.678818    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 18:16:21.679927 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.679909    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 18:16:21.690893 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.690876    2580 log.go:25] "Validated CRI v1 runtime API"
Sep 16 18:16:21.693903 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.693890    2580 log.go:25] "Validated CRI v1 image API"
Sep 16 18:16:21.698344 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.698330    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 18:16:21.703117 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.703085    2580 fs.go:135] Filesystem UUIDs: map[300b554c-809b-4db3-b9d6-b28e7857a3e6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f5bb6fd5-6a9d-42e1-90ad-9536b66a855b:/dev/nvme0n1p3]
Sep 16 18:16:21.703195 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.703117    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 18:16:21.709465 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.709344    2580 manager.go:216] Machine: {Timestamp:2026-09-16 18:16:21.708868142 +0000 UTC m=+0.351894173 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3202885 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20b1086defbbdf911bea34d96c9aff SystemUUID:ec20b108-6def-bbdf-911b-ea34d96c9aff BootID:b488da2c-ee7e-45c1-966c-048a5446d9b6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ca:c9:6b:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ca:c9:6b:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:b5:79:0e:e7:f5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 18:16:21.709465 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.709460    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 18:16:21.709573 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.709530    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 18:16:21.709957 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.709940    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 18:16:21.711516 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.711493    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 18:16:21.711741 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.711518    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 18:16:21.712347 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.712338    2580 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 18:16:21.712393 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.712350    2580 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 18:16:21.712393 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.712357    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 18:16:21.713669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.713659    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 18:16:21.714553 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.714543    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 18:16:21.718539 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.718528    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 18:16:21.718657 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.718648    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 18:16:21.718684 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.718677    2580 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 18:16:21.718710 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.718696    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 18:16:21.718754 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.718717    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 18:16:21.718754 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.718730    2580 kubelet.go:398] "Adding apiserver pod source"
Sep 16 18:16:21.718754 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.718741    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 18:16:21.719279 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.719261    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 18:16:21.719344 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.719297    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 18:16:21.723528 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.723506    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 18:16:21.725276 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.725254    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 18:16:21.725346 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.725289    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 18:16:21.727461 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.727449    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 18:16:21.727504 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.727468    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 18:16:21.727504 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.727474    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 18:16:21.727504 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.727479    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 18:16:21.727504 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.727487    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 18:16:21.727504 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.727492    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 18:16:21.727632 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.727504    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 18:16:21.727632 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.727515    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 18:16:21.727632 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.727521    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 18:16:21.727632 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.727526    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 18:16:21.727632 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.727536    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 18:16:21.727632 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.727541    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 18:16:21.728174 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.728163    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 18:16:21.728174 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.728172    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 18:16:21.730496 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.730478    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 18:16:21.730572 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.730497    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 18:16:21.730572 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.730521    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 18:16:21.731840 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.731826    2580 server.go:1268] "Started kubelet"
Sep 16 18:16:21.731971 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.731922    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 18:16:21.732019 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.731994    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 18:16:21.732475 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.732448    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 18:16:21.732776 ip-10-0-130-4 systemd[1]: Started Kubernetes Kubelet.
Sep 16 18:16:21.733637 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.733622    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 18:16:21.734102 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.734081    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f5k7j"
Sep 16 18:16:21.735208 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.735194    2580 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 18:16:21.737143 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.736194    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-4.ec2.internal.18d5dfe06059b546  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-4.ec2.internal,UID:ip-10-0-130-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-4.ec2.internal,},FirstTimestamp:2026-09-16 18:16:21.73180039 +0000 UTC m=+0.374826421,LastTimestamp:2026-09-16 18:16:21.73180039 +0000 UTC m=+0.374826421,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-4.ec2.internal,}"
Sep 16 18:16:21.737493 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.737475    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 18:16:21.737588 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.737576    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 18:16:21.738113 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.738097    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 18:16:21.738223 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.738207    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Sep 16 18:16:21.739098 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.739083    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 18:16:21.739206 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.739191    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 18:16:21.739294 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.739092    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 18:16:21.739348 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.739313    2580 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 18:16:21.739348 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.739319    2580 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 18:16:21.739652 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.739599    2580 factory.go:55] Registering systemd factory
Sep 16 18:16:21.739652 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.739614    2580 factory.go:223] Registration of the systemd container factory successfully
Sep 16 18:16:21.739835 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.739823    2580 factory.go:153] Registering CRI-O factory
Sep 16 18:16:21.739879 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.739839    2580 factory.go:223] Registration of the crio container factory successfully
Sep 16 18:16:21.739930 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.739899    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 18:16:21.739930 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.739916    2580 factory.go:103] Registering Raw factory
Sep 16 18:16:21.740026 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.739934    2580 manager.go:1196] Started watching for new ooms in manager
Sep 16 18:16:21.740320 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.740308    2580 manager.go:349] Starting recovery of all containers
Sep 16 18:16:21.743084 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.743064    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f5k7j"
Sep 16 18:16:21.750148 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.750114    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 18:16:21.750227 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.750184    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 18:16:21.751729 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.751690    2580 manager.go:354] Recovery completed
Sep 16 18:16:21.758120 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.757200    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:21.758950 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.758931    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:21.759020 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.758963    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:21.759020 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.758978    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:21.759599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.759584    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 18:16:21.759599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.759599    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 18:16:21.759704 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.759615    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 18:16:21.759704 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.759651    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:21.760336 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.760315    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:21.760436 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.760343    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:21.760436 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.760357    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:21.761674 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.761659    2580 policy_none.go:49] "None policy: Start"
Sep 16 18:16:21.761674 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.761676    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 18:16:21.761751 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.761685    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 18:16:21.763635 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.763623    2580 policy_none.go:47] "Start"
Sep 16 18:16:21.814824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.804954    2580 manager.go:337] "Starting Device Plugin manager"
Sep 16 18:16:21.814824 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.804996    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 18:16:21.814824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.805009    2580 server.go:87] "Starting device plugin registration server"
Sep 16 18:16:21.814824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.805302    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 18:16:21.814824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.805314    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 18:16:21.814824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.805409    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 18:16:21.814824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.805479    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 18:16:21.814824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.805486    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 18:16:21.814824 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.805957    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 18:16:21.814824 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.806005    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-4.ec2.internal\" not found"
Sep 16 18:16:21.858633 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.858604    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 18:16:21.859784 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.859767    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 18:16:21.859876 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.859821    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 18:16:21.859876 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.859844    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 18:16:21.859974 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.859923    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 18:16:21.862450 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.862433    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 18:16:21.905821 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.905731    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:21.906710 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.906692    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:21.906785 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.906725    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:21.906785 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.906737    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:21.906785 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.906761    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-4.ec2.internal"
Sep 16 18:16:21.917080 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.917064    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-4.ec2.internal"
Sep 16 18:16:21.917163 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.917086    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-4.ec2.internal\": node \"ip-10-0-130-4.ec2.internal\" not found"
Sep 16 18:16:21.930788 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.930770    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Sep 16 18:16:21.960906 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.960879    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"]
Sep 16 18:16:21.961038 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.960953    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:21.961855 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.961840    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:21.961909 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.961875    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:21.961909 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.961885    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:21.965066 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.965054    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:21.965183 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.965170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:21.965228 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.965196    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:21.965784 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.965767    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:21.965784 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.965774    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:21.965913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.965792    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:21.965913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.965796    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:21.965913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.965801    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:21.965913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.965805    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:21.967926 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.967906    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:21.967996 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.967939    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:21.968614 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.968591    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:21.968702 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.968616    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:21.968702 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:21.968627    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:21.981878 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.981857    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-4.ec2.internal\" not found" node="ip-10-0-130-4.ec2.internal"
Sep 16 18:16:21.985524 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:21.985510    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-4.ec2.internal\" not found" node="ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.031553 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.031531    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Sep 16 18:16:22.040449 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.040427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b215942334fadb1e5657317484eaae0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal\" (UID: \"2b215942334fadb1e5657317484eaae0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.040523 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.040452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b215942334fadb1e5657317484eaae0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal\" (UID: \"2b215942334fadb1e5657317484eaae0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.040523 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.040467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3855482ecf545e291be557b4f332fc2e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-4.ec2.internal\" (UID: \"3855482ecf545e291be557b4f332fc2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.132010 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.131983    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Sep 16 18:16:22.141337 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.141308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b215942334fadb1e5657317484eaae0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal\" (UID: \"2b215942334fadb1e5657317484eaae0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.141421 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.141340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3855482ecf545e291be557b4f332fc2e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-4.ec2.internal\" (UID: \"3855482ecf545e291be557b4f332fc2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.141421 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.141375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b215942334fadb1e5657317484eaae0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal\" (UID: \"2b215942334fadb1e5657317484eaae0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.141421 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.141415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3855482ecf545e291be557b4f332fc2e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-4.ec2.internal\" (UID: \"3855482ecf545e291be557b4f332fc2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.141522 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.141415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b215942334fadb1e5657317484eaae0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal\" (UID: \"2b215942334fadb1e5657317484eaae0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.141522 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.141430    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b215942334fadb1e5657317484eaae0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal\" (UID: \"2b215942334fadb1e5657317484eaae0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.232805 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.232737    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Sep 16 18:16:22.284297 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.284259    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.289204 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.289114    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.333883 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.333854    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Sep 16 18:16:22.437457 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.437413    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Sep 16 18:16:22.539683 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.539605    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Sep 16 18:16:22.619612 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.619584    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 18:16:22.638667 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.638643    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.647448 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.647424    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 18:16:22.649274 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.649259    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Sep 16 18:16:22.659587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.659568    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 18:16:22.676352 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.676329    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 18:16:22.676507 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.676488    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 18:16:22.676557 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.676527    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 18:16:22.720196 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.720164    2580 apiserver.go:52] "Watching apiserver"
Sep 16 18:16:22.737938 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.737906    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 18:16:22.738354 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.738326    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 18:16:22.742580 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.742552    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vm6px","kube-system/konnectivity-agent-pq9c5","kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal","openshift-dns/node-resolver-k69k7","openshift-image-registry/node-ca-2cflm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal","openshift-multus/multus-g86w8","openshift-multus/network-metrics-daemon-qdft4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm","openshift-cluster-node-tuning-operator/tuned-wwnfv","openshift-multus/multus-additional-cni-plugins-kjszn","openshift-network-diagnostics/network-check-target-kd9hb","openshift-network-operator/iptables-alerter-8flws","openshift-ovn-kubernetes/ovnkube-node-z5wvm"]
Sep 16 18:16:22.745017 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.745001    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.747164 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.747142    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 18:16:22.747235 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.747196    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 18:16:22.747235 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.747218    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-frzft\""
Sep 16 18:16:22.747325 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.747234    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.748010 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.747993    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 18:16:22.749152 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.749119    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 18:16:22.749419 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.749402    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-twspf\""
Sep 16 18:16:22.749482 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.749471    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 18:16:22.749536 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.749524    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 18:16:22.749660 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.749643    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8flws"
Sep 16 18:16:22.751673 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.751655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k69k7"
Sep 16 18:16:22.751817 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.751796    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 18:16:22.751917 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.751802    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 18:16:22.751979 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.751964    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 18:16:22.752109 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.752092    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d6tnz\""
Sep 16 18:16:22.753189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.753167    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 18:11:21 +0000 UTC" deadline="2028-02-15 14:35:40.736113496 +0000 UTC"
Sep 16 18:16:22.753189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.753189    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12404h19m17.982927044s"
Sep 16 18:16:22.753543 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.753529    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kmk6v\""
Sep 16 18:16:22.753855 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.753826    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 18:16:22.753947 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.753932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2cflm"
Sep 16 18:16:22.754006 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.753954    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 18:16:22.756116 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.756099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.756420 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.756175    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 18:16:22.756420 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.756274    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 18:16:22.756420 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.756286    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-85n7x\""
Sep 16 18:16:22.756562 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.756547    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 18:16:22.758290 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.758274    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 18:16:22.758439 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.758425    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pq9c5"
Sep 16 18:16:22.758504 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.758457    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 18:16:22.758611 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.758593    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fx5tq\""
Sep 16 18:16:22.758781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.758765    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 18:16:22.758870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.758856    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 18:16:22.760978 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.760965    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 18:16:22.761457 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.761444    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:22.761520 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.761495    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:22.761588 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.761575    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 18:16:22.761626 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.761611    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dhcfw\""
Sep 16 18:16:22.763813 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.763797    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.766005 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.765987    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:22.766093 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.766055    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:22.766657 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.766640    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 18:16:22.766744 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.766673    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 18:16:22.766744 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.766682    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qhgwc\""
Sep 16 18:16:22.768445 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.768389    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:22.768520 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.768458    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:22.770814 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.770799    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.773209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.773192    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zlfxn\""
Sep 16 18:16:22.773302 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.773232    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 18:16:22.776540 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.776522    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 18:16:22.776683 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.776656    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 18:16:22.776793 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.776693    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 18:16:22.776793 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.776693    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 18:16:22.776793 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.776709    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 18:16:22.783192 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.783175    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9rxnl"
Sep 16 18:16:22.793552 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.793502    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9rxnl"
Sep 16 18:16:22.840685 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.840662    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 18:16:22.845112 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-socket-dir\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.845222 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845118    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-etc-kubernetes\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.845222 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-device-dir\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.845222 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn77p\" (UniqueName: \"kubernetes.io/projected/87decdc9-1d76-402c-8fbb-d996fcaf8ce6-kube-api-access-fn77p\") pod \"node-resolver-k69k7\" (UID: \"87decdc9-1d76-402c-8fbb-d996fcaf8ce6\") " pod="openshift-dns/node-resolver-k69k7"
Sep 16 18:16:22.845222 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-run-multus-certs\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.845447 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/261ed063-baba-46b3-a3ef-60200ba41266-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.845447 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845260    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-systemd-units\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.845447 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845292    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-sys-fs\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.845447 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:22.845447 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845351    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-cni-netd\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.845447 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-sysctl-d\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.845447 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-sysctl-conf\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.845447 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4faeab58-7f14-4555-9bc8-db6c5cb61fce-serviceca\") pod \"node-ca-2cflm\" (UID: \"4faeab58-7f14-4555-9bc8-db6c5cb61fce\") " pod="openshift-image-registry/node-ca-2cflm"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/261ed063-baba-46b3-a3ef-60200ba41266-system-cni-dir\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/261ed063-baba-46b3-a3ef-60200ba41266-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc5s2\" (UniqueName: \"kubernetes.io/projected/261ed063-baba-46b3-a3ef-60200ba41266-kube-api-access-fc5s2\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-slash\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-run-netns\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-sysconfig\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845625    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845648    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87decdc9-1d76-402c-8fbb-d996fcaf8ce6-tmp-dir\") pod \"node-resolver-k69k7\" (UID: \"87decdc9-1d76-402c-8fbb-d996fcaf8ce6\") " pod="openshift-dns/node-resolver-k69k7"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-run-ovn\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-node-log\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jddmg\" (UniqueName: \"kubernetes.io/projected/07924692-e25e-4a8f-91e7-ad3b901a01ec-kube-api-access-jddmg\") pod \"iptables-alerter-8flws\" (UID: \"07924692-e25e-4a8f-91e7-ad3b901a01ec\") " pod="openshift-network-operator/iptables-alerter-8flws"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-kubelet-config\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc72d\" (UniqueName: \"kubernetes.io/projected/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-kube-api-access-kc72d\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.845826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b16330df-7050-44b6-acf9-326d07374804-agent-certs\") pod \"konnectivity-agent-pq9c5\" (UID: \"b16330df-7050-44b6-acf9-326d07374804\") " pod="kube-system/konnectivity-agent-pq9c5"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-kubernetes\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845864    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89ccdf99-6291-4e06-8430-03249c76f153-tmp\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845883    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-cnibin\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5d73922-631e-4ce1-a5bb-d3c34095c12a-cni-binary-copy\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnbnn\" (UniqueName: \"kubernetes.io/projected/d5d73922-631e-4ce1-a5bb-d3c34095c12a-kube-api-access-hnbnn\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-kubelet\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.845984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-registration-dir\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07924692-e25e-4a8f-91e7-ad3b901a01ec-host-slash\") pod \"iptables-alerter-8flws\" (UID: \"07924692-e25e-4a8f-91e7-ad3b901a01ec\") " pod="openshift-network-operator/iptables-alerter-8flws"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzb99\" (UniqueName: \"kubernetes.io/projected/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-kube-api-access-kzb99\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-run-netns\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-var-lib-kubelet\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846078    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-var-lib-openvswitch\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846093    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-run-openvswitch\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-ovnkube-script-lib\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-modprobe-d\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.846209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-run\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xqc2\" (UniqueName: \"kubernetes.io/projected/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-kube-api-access-9xqc2\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-var-lib-cni-bin\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-ovn-node-metrics-cert\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-systemd\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89ccdf99-6291-4e06-8430-03249c76f153-etc-tuned\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07924692-e25e-4a8f-91e7-ad3b901a01ec-iptables-alerter-script\") pod \"iptables-alerter-8flws\" (UID: \"07924692-e25e-4a8f-91e7-ad3b901a01ec\") " pod="openshift-network-operator/iptables-alerter-8flws"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846329    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-run-systemd\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-run-ovn-kubernetes\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-env-overrides\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-sys\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-var-lib-kubelet\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkkjn\" (UniqueName: \"kubernetes.io/projected/89ccdf99-6291-4e06-8430-03249c76f153-kube-api-access-nkkjn\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846463    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87decdc9-1d76-402c-8fbb-d996fcaf8ce6-hosts-file\") pod \"node-resolver-k69k7\" (UID: \"87decdc9-1d76-402c-8fbb-d996fcaf8ce6\") " pod="openshift-dns/node-resolver-k69k7"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-multus-socket-dir-parent\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.846833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-hostroot\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/261ed063-baba-46b3-a3ef-60200ba41266-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-cni-bin\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvjp2\" (UniqueName: \"kubernetes.io/projected/4faeab58-7f14-4555-9bc8-db6c5cb61fce-kube-api-access-vvjp2\") pod \"node-ca-2cflm\" (UID: \"4faeab58-7f14-4555-9bc8-db6c5cb61fce\") " pod="openshift-image-registry/node-ca-2cflm"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-dbus\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-var-lib-cni-multus\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-etc-openvswitch\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4faeab58-7f14-4555-9bc8-db6c5cb61fce-host\") pod \"node-ca-2cflm\" (UID: \"4faeab58-7f14-4555-9bc8-db6c5cb61fce\") " pod="openshift-image-registry/node-ca-2cflm"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-run-k8s-cni-cncf-io\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846696    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-log-socket\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-multus-cni-dir\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-multus-conf-dir\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846764    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b16330df-7050-44b6-acf9-326d07374804-konnectivity-ca\") pod \"konnectivity-agent-pq9c5\" (UID: \"b16330df-7050-44b6-acf9-326d07374804\") " pod="kube-system/konnectivity-agent-pq9c5"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846801    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/261ed063-baba-46b3-a3ef-60200ba41266-cnibin\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846838    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgdjf\" (UniqueName: \"kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf\") pod \"network-check-target-kd9hb\" (UID: \"34926487-20cd-4648-95bc-a2fa6ea71769\") " pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-ovnkube-config\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.847669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846872    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-lib-modules\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.848552 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-host\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.848552 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.848552 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.848552 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-system-cni-dir\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.848552 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.846998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5d73922-631e-4ce1-a5bb-d3c34095c12a-multus-daemon-config\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.848552 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.847013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/261ed063-baba-46b3-a3ef-60200ba41266-cni-binary-copy\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.942147 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.942112    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 18:16:22.947593 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4faeab58-7f14-4555-9bc8-db6c5cb61fce-host\") pod \"node-ca-2cflm\" (UID: \"4faeab58-7f14-4555-9bc8-db6c5cb61fce\") " pod="openshift-image-registry/node-ca-2cflm"
Sep 16 18:16:22.947759 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-run-k8s-cni-cncf-io\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.947759 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-log-socket\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.947759 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-multus-cni-dir\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.947759 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-multus-conf-dir\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.947759 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-run-k8s-cni-cncf-io\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.947759 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4faeab58-7f14-4555-9bc8-db6c5cb61fce-host\") pod \"node-ca-2cflm\" (UID: \"4faeab58-7f14-4555-9bc8-db6c5cb61fce\") " pod="openshift-image-registry/node-ca-2cflm"
Sep 16 18:16:22.947759 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947705    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b16330df-7050-44b6-acf9-326d07374804-konnectivity-ca\") pod \"konnectivity-agent-pq9c5\" (UID: \"b16330df-7050-44b6-acf9-326d07374804\") " pod="kube-system/konnectivity-agent-pq9c5"
Sep 16 18:16:22.947759 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947731    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-multus-cni-dir\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.947759 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/261ed063-baba-46b3-a3ef-60200ba41266-cnibin\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947769    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-log-socket\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-multus-conf-dir\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgdjf\" (UniqueName: \"kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf\") pod \"network-check-target-kd9hb\" (UID: \"34926487-20cd-4648-95bc-a2fa6ea71769\") " pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-ovnkube-config\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/261ed063-baba-46b3-a3ef-60200ba41266-cnibin\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-lib-modules\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-host\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-system-cni-dir\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5d73922-631e-4ce1-a5bb-d3c34095c12a-multus-daemon-config\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-host\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947999    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/261ed063-baba-46b3-a3ef-60200ba41266-cni-binary-copy\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-socket-dir\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.948189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-etc-kubernetes\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-device-dir\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn77p\" (UniqueName: \"kubernetes.io/projected/87decdc9-1d76-402c-8fbb-d996fcaf8ce6-kube-api-access-fn77p\") pod \"node-resolver-k69k7\" (UID: \"87decdc9-1d76-402c-8fbb-d996fcaf8ce6\") " pod="openshift-dns/node-resolver-k69k7"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948162    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-system-cni-dir\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-run-multus-certs\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-socket-dir\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948203    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-run-multus-certs\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948213    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/261ed063-baba-46b3-a3ef-60200ba41266-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-etc-kubernetes\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.947979    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-lib-modules\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-systemd-units\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-sys-fs\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948302    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-ovnkube-config\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-cni-netd\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948334    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-device-dir\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-sysctl-d\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.949024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948302    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b16330df-7050-44b6-acf9-326d07374804-konnectivity-ca\") pod \"konnectivity-agent-pq9c5\" (UID: \"b16330df-7050-44b6-acf9-326d07374804\") " pod="kube-system/konnectivity-agent-pq9c5"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-systemd-units\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-sysctl-conf\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4faeab58-7f14-4555-9bc8-db6c5cb61fce-serviceca\") pod \"node-ca-2cflm\" (UID: \"4faeab58-7f14-4555-9bc8-db6c5cb61fce\") " pod="openshift-image-registry/node-ca-2cflm"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-cni-netd\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.948429    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/261ed063-baba-46b3-a3ef-60200ba41266-system-cni-dir\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/261ed063-baba-46b3-a3ef-60200ba41266-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.948481    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs podName:4e6a401a-b5b2-4ae6-a2d0-965b2658777b nodeName:}" failed. No retries permitted until 2026-09-16 18:16:23.448463286 +0000 UTC m=+2.091489323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs") pod "network-metrics-daemon-qdft4" (UID: "4e6a401a-b5b2-4ae6-a2d0-965b2658777b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948503    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-sys-fs\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc5s2\" (UniqueName: \"kubernetes.io/projected/261ed063-baba-46b3-a3ef-60200ba41266-kube-api-access-fc5s2\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-slash\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-sysctl-conf\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-run-netns\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-sysconfig\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/261ed063-baba-46b3-a3ef-60200ba41266-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.949847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87decdc9-1d76-402c-8fbb-d996fcaf8ce6-tmp-dir\") pod \"node-resolver-k69k7\" (UID: \"87decdc9-1d76-402c-8fbb-d996fcaf8ce6\") " pod="openshift-dns/node-resolver-k69k7"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948647    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/261ed063-baba-46b3-a3ef-60200ba41266-cni-binary-copy\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-sysctl-d\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-run-ovn\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/261ed063-baba-46b3-a3ef-60200ba41266-system-cni-dir\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-sysconfig\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-node-log\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-slash\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-run-netns\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948712    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-run-ovn\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.948784    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.948844    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret podName:390d10d8-4834-4fd7-b1ce-1abd2943c8b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:23.448825021 +0000 UTC m=+2.091851057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret") pod "global-pull-secret-syncer-vm6px" (UID: "390d10d8-4834-4fd7-b1ce-1abd2943c8b4") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-node-log\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/261ed063-baba-46b3-a3ef-60200ba41266-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddmg\" (UniqueName: \"kubernetes.io/projected/07924692-e25e-4a8f-91e7-ad3b901a01ec-kube-api-access-jddmg\") pod \"iptables-alerter-8flws\" (UID: \"07924692-e25e-4a8f-91e7-ad3b901a01ec\") " pod="openshift-network-operator/iptables-alerter-8flws"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-kubelet-config\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc72d\" (UniqueName: \"kubernetes.io/projected/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-kube-api-access-kc72d\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.950619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b16330df-7050-44b6-acf9-326d07374804-agent-certs\") pod \"konnectivity-agent-pq9c5\" (UID: \"b16330df-7050-44b6-acf9-326d07374804\") " pod="kube-system/konnectivity-agent-pq9c5"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4faeab58-7f14-4555-9bc8-db6c5cb61fce-serviceca\") pod \"node-ca-2cflm\" (UID: \"4faeab58-7f14-4555-9bc8-db6c5cb61fce\") " pod="openshift-image-registry/node-ca-2cflm"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-kubernetes\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.948984    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-kubelet-config\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949000    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-kubernetes\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89ccdf99-6291-4e06-8430-03249c76f153-tmp\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-cnibin\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5d73922-631e-4ce1-a5bb-d3c34095c12a-cni-binary-copy\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnbnn\" (UniqueName: \"kubernetes.io/projected/d5d73922-631e-4ce1-a5bb-d3c34095c12a-kube-api-access-hnbnn\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949115    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-cnibin\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-kubelet\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-registration-dir\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949155    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-kubelet\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87decdc9-1d76-402c-8fbb-d996fcaf8ce6-tmp-dir\") pod \"node-resolver-k69k7\" (UID: \"87decdc9-1d76-402c-8fbb-d996fcaf8ce6\") " pod="openshift-dns/node-resolver-k69k7"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-registration-dir\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949285    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5d73922-631e-4ce1-a5bb-d3c34095c12a-multus-daemon-config\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07924692-e25e-4a8f-91e7-ad3b901a01ec-host-slash\") pod \"iptables-alerter-8flws\" (UID: \"07924692-e25e-4a8f-91e7-ad3b901a01ec\") " pod="openshift-network-operator/iptables-alerter-8flws"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzb99\" (UniqueName: \"kubernetes.io/projected/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-kube-api-access-kzb99\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:22.951374 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949350    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-run-netns\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-var-lib-kubelet\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-var-lib-openvswitch\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949437    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07924692-e25e-4a8f-91e7-ad3b901a01ec-host-slash\") pod \"iptables-alerter-8flws\" (UID: \"07924692-e25e-4a8f-91e7-ad3b901a01ec\") " pod="openshift-network-operator/iptables-alerter-8flws"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-run-netns\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949466    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-run-openvswitch\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949471    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-var-lib-kubelet\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-var-lib-openvswitch\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949497    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5d73922-631e-4ce1-a5bb-d3c34095c12a-cni-binary-copy\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-ovnkube-script-lib\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949508    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-run-openvswitch\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-modprobe-d\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-run\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xqc2\" (UniqueName: \"kubernetes.io/projected/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-kube-api-access-9xqc2\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949624    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-modprobe-d\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949627    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-run\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-var-lib-cni-bin\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.952298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-var-lib-cni-bin\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-ovn-node-metrics-cert\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-systemd\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89ccdf99-6291-4e06-8430-03249c76f153-etc-tuned\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949789    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07924692-e25e-4a8f-91e7-ad3b901a01ec-iptables-alerter-script\") pod \"iptables-alerter-8flws\" (UID: \"07924692-e25e-4a8f-91e7-ad3b901a01ec\") " pod="openshift-network-operator/iptables-alerter-8flws"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-run-systemd\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-etc-systemd\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949886    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-run-systemd\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-run-ovn-kubernetes\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-env-overrides\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949956    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-sys\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-ovnkube-script-lib\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.949975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-var-lib-kubelet\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkkjn\" (UniqueName: \"kubernetes.io/projected/89ccdf99-6291-4e06-8430-03249c76f153-kube-api-access-nkkjn\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950023    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87decdc9-1d76-402c-8fbb-d996fcaf8ce6-hosts-file\") pod \"node-resolver-k69k7\" (UID: \"87decdc9-1d76-402c-8fbb-d996fcaf8ce6\") " pod="openshift-dns/node-resolver-k69k7"
Sep 16 18:16:22.953078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-multus-socket-dir-parent\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-hostroot\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950099    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-var-lib-kubelet\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/261ed063-baba-46b3-a3ef-60200ba41266-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-cni-bin\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950162    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvjp2\" (UniqueName: \"kubernetes.io/projected/4faeab58-7f14-4555-9bc8-db6c5cb61fce-kube-api-access-vvjp2\") pod \"node-ca-2cflm\" (UID: \"4faeab58-7f14-4555-9bc8-db6c5cb61fce\") " pod="openshift-image-registry/node-ca-2cflm"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-dbus\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-var-lib-cni-multus\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-etc-openvswitch\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-etc-openvswitch\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950302    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-env-overrides\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89ccdf99-6291-4e06-8430-03249c76f153-sys\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950354    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-run-ovn-kubernetes\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-host-cni-bin\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950368    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07924692-e25e-4a8f-91e7-ad3b901a01ec-iptables-alerter-script\") pod \"iptables-alerter-8flws\" (UID: \"07924692-e25e-4a8f-91e7-ad3b901a01ec\") " pod="openshift-network-operator/iptables-alerter-8flws"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950436    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-hostroot\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-multus-socket-dir-parent\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.953587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/261ed063-baba-46b3-a3ef-60200ba41266-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.954053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87decdc9-1d76-402c-8fbb-d996fcaf8ce6-hosts-file\") pod \"node-resolver-k69k7\" (UID: \"87decdc9-1d76-402c-8fbb-d996fcaf8ce6\") " pod="openshift-dns/node-resolver-k69k7"
Sep 16 18:16:22.954053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950589    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-dbus\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:22.954053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.950624    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5d73922-631e-4ce1-a5bb-d3c34095c12a-host-var-lib-cni-multus\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.954053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.952912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89ccdf99-6291-4e06-8430-03249c76f153-etc-tuned\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.954053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.952970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89ccdf99-6291-4e06-8430-03249c76f153-tmp\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.954053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.953122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b16330df-7050-44b6-acf9-326d07374804-agent-certs\") pod \"konnectivity-agent-pq9c5\" (UID: \"b16330df-7050-44b6-acf9-326d07374804\") " pod="kube-system/konnectivity-agent-pq9c5"
Sep 16 18:16:22.954053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.953129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-ovn-node-metrics-cert\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.958027 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.958009    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:22.958075 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.958034    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:22.958075 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.958048    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lgdjf for pod openshift-network-diagnostics/network-check-target-kd9hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:22.958154 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:22.958141    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf podName:34926487-20cd-4648-95bc-a2fa6ea71769 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:23.458102674 +0000 UTC m=+2.101128710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lgdjf" (UniqueName: "kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf") pod "network-check-target-kd9hb" (UID: "34926487-20cd-4648-95bc-a2fa6ea71769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:22.960465 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.960432    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnbnn\" (UniqueName: \"kubernetes.io/projected/d5d73922-631e-4ce1-a5bb-d3c34095c12a-kube-api-access-hnbnn\") pod \"multus-g86w8\" (UID: \"d5d73922-631e-4ce1-a5bb-d3c34095c12a\") " pod="openshift-multus/multus-g86w8"
Sep 16 18:16:22.960572 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.960478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn77p\" (UniqueName: \"kubernetes.io/projected/87decdc9-1d76-402c-8fbb-d996fcaf8ce6-kube-api-access-fn77p\") pod \"node-resolver-k69k7\" (UID: \"87decdc9-1d76-402c-8fbb-d996fcaf8ce6\") " pod="openshift-dns/node-resolver-k69k7"
Sep 16 18:16:22.960776 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.960754    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc72d\" (UniqueName: \"kubernetes.io/projected/7be1fdca-ed0b-43e6-bbd0-0649f6a6572f-kube-api-access-kc72d\") pod \"ovnkube-node-z5wvm\" (UID: \"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:22.960909 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.960884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xqc2\" (UniqueName: \"kubernetes.io/projected/ee7b2b65-4a88-41a2-a2ea-3022fd491aa9-kube-api-access-9xqc2\") pod \"aws-ebs-csi-driver-node-mdjkm\" (UID: \"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:22.961834 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.961804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc5s2\" (UniqueName: \"kubernetes.io/projected/261ed063-baba-46b3-a3ef-60200ba41266-kube-api-access-fc5s2\") pod \"multus-additional-cni-plugins-kjszn\" (UID: \"261ed063-baba-46b3-a3ef-60200ba41266\") " pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:22.962252 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.962232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkkjn\" (UniqueName: \"kubernetes.io/projected/89ccdf99-6291-4e06-8430-03249c76f153-kube-api-access-nkkjn\") pod \"tuned-wwnfv\" (UID: \"89ccdf99-6291-4e06-8430-03249c76f153\") " pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:22.962552 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.962531    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvjp2\" (UniqueName: \"kubernetes.io/projected/4faeab58-7f14-4555-9bc8-db6c5cb61fce-kube-api-access-vvjp2\") pod \"node-ca-2cflm\" (UID: \"4faeab58-7f14-4555-9bc8-db6c5cb61fce\") " pod="openshift-image-registry/node-ca-2cflm"
Sep 16 18:16:22.962627 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.962573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzb99\" (UniqueName: \"kubernetes.io/projected/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-kube-api-access-kzb99\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:22.963243 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:22.963223    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jddmg\" (UniqueName: \"kubernetes.io/projected/07924692-e25e-4a8f-91e7-ad3b901a01ec-kube-api-access-jddmg\") pod \"iptables-alerter-8flws\" (UID: \"07924692-e25e-4a8f-91e7-ad3b901a01ec\") " pod="openshift-network-operator/iptables-alerter-8flws"
Sep 16 18:16:22.996739 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:22.996709    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b215942334fadb1e5657317484eaae0.slice/crio-b8824ca1cf360e2f7940b3a209c69df5702c290bfbf96a607e01867c442dea0d WatchSource:0}: Error finding container b8824ca1cf360e2f7940b3a209c69df5702c290bfbf96a607e01867c442dea0d: Status 404 returned error can't find the container with id b8824ca1cf360e2f7940b3a209c69df5702c290bfbf96a607e01867c442dea0d
Sep 16 18:16:22.996915 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:22.996890    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3855482ecf545e291be557b4f332fc2e.slice/crio-9c73c38a938c1da6e98a2b948cc869f039bd145aa32dcd5bd1f6876fbe046c1a WatchSource:0}: Error finding container 9c73c38a938c1da6e98a2b948cc869f039bd145aa32dcd5bd1f6876fbe046c1a: Status 404 returned error can't find the container with id 9c73c38a938c1da6e98a2b948cc869f039bd145aa32dcd5bd1f6876fbe046c1a
Sep 16 18:16:23.001782 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.001759    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:16:23.078918 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.078836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wwnfv"
Sep 16 18:16:23.088968 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:23.088940    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ccdf99_6291_4e06_8430_03249c76f153.slice/crio-ee20c72230708504a9c519e080ef154677624e222567b37996c77a2607b20ea3 WatchSource:0}: Error finding container ee20c72230708504a9c519e080ef154677624e222567b37996c77a2607b20ea3: Status 404 returned error can't find the container with id ee20c72230708504a9c519e080ef154677624e222567b37996c77a2607b20ea3
Sep 16 18:16:23.101421 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.101394    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm"
Sep 16 18:16:23.108567 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.108547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8flws"
Sep 16 18:16:23.109582 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:23.109554    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7b2b65_4a88_41a2_a2ea_3022fd491aa9.slice/crio-ea69a3a6ac72422b9fe5946ea9ddf1599be331882ab551926bc55c2500350fc2 WatchSource:0}: Error finding container ea69a3a6ac72422b9fe5946ea9ddf1599be331882ab551926bc55c2500350fc2: Status 404 returned error can't find the container with id ea69a3a6ac72422b9fe5946ea9ddf1599be331882ab551926bc55c2500350fc2
Sep 16 18:16:23.118268 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:23.118244    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07924692_e25e_4a8f_91e7_ad3b901a01ec.slice/crio-2d61336432537a2f8516bed662f265749dcc62788bca7a0d85c2c3111fcc50fc WatchSource:0}: Error finding container 2d61336432537a2f8516bed662f265749dcc62788bca7a0d85c2c3111fcc50fc: Status 404 returned error can't find the container with id 2d61336432537a2f8516bed662f265749dcc62788bca7a0d85c2c3111fcc50fc
Sep 16 18:16:23.135852 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.135822    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k69k7"
Sep 16 18:16:23.144482 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:23.144460    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87decdc9_1d76_402c_8fbb_d996fcaf8ce6.slice/crio-7995eb0902aeb90efc3ee62e0f9158a4c0b460c0b4989ce9534797490846a65a WatchSource:0}: Error finding container 7995eb0902aeb90efc3ee62e0f9158a4c0b460c0b4989ce9534797490846a65a: Status 404 returned error can't find the container with id 7995eb0902aeb90efc3ee62e0f9158a4c0b460c0b4989ce9534797490846a65a
Sep 16 18:16:23.148734 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.148709    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2cflm"
Sep 16 18:16:23.155708 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.155692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g86w8"
Sep 16 18:16:23.156464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:23.156444    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4faeab58_7f14_4555_9bc8_db6c5cb61fce.slice/crio-5929500f6bbfcfbfb076fc4e86816a23b2379ab5e10097af3d71c9cff408eb19 WatchSource:0}: Error finding container 5929500f6bbfcfbfb076fc4e86816a23b2379ab5e10097af3d71c9cff408eb19: Status 404 returned error can't find the container with id 5929500f6bbfcfbfb076fc4e86816a23b2379ab5e10097af3d71c9cff408eb19
Sep 16 18:16:23.163245 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:23.163227    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d73922_631e_4ce1_a5bb_d3c34095c12a.slice/crio-c7cdbfd37d46fa00544b7136883fac220ab2300da6bfc53b0d928f37a2cae388 WatchSource:0}: Error finding container c7cdbfd37d46fa00544b7136883fac220ab2300da6bfc53b0d928f37a2cae388: Status 404 returned error can't find the container with id c7cdbfd37d46fa00544b7136883fac220ab2300da6bfc53b0d928f37a2cae388
Sep 16 18:16:23.169200 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.169180    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pq9c5"
Sep 16 18:16:23.175092 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.175073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kjszn"
Sep 16 18:16:23.177905 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:23.177822    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16330df_7050_44b6_acf9_326d07374804.slice/crio-018823c0133c9fa6930c49e231bb6fdab3e18b556bc35897ff87a9c60ea57a05 WatchSource:0}: Error finding container 018823c0133c9fa6930c49e231bb6fdab3e18b556bc35897ff87a9c60ea57a05: Status 404 returned error can't find the container with id 018823c0133c9fa6930c49e231bb6fdab3e18b556bc35897ff87a9c60ea57a05
Sep 16 18:16:23.183144 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:23.183120    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261ed063_baba_46b3_a3ef_60200ba41266.slice/crio-a86b53dcf8f393acb226d7a0c6ea2ff0a6ac45e824d0e30510ada189ce0ef3b3 WatchSource:0}: Error finding container a86b53dcf8f393acb226d7a0c6ea2ff0a6ac45e824d0e30510ada189ce0ef3b3: Status 404 returned error can't find the container with id a86b53dcf8f393acb226d7a0c6ea2ff0a6ac45e824d0e30510ada189ce0ef3b3
Sep 16 18:16:23.187424 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.187403    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:23.196315 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:23.196291    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be1fdca_ed0b_43e6_bbd0_0649f6a6572f.slice/crio-c3cbd45df78a31d9aebfd3dc9162801856967c2ae7854a7fa5bacf16fc10f6eb WatchSource:0}: Error finding container c3cbd45df78a31d9aebfd3dc9162801856967c2ae7854a7fa5bacf16fc10f6eb: Status 404 returned error can't find the container with id c3cbd45df78a31d9aebfd3dc9162801856967c2ae7854a7fa5bacf16fc10f6eb
Sep 16 18:16:23.197959 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:23.197936    2580 kuberuntime_manager.go:1459] "Unhandled Error" err="container ovn-controller start failed in pod ovnkube-node-z5wvm_openshift-ovn-kubernetes(7be1fdca-ed0b-43e6-bbd0-0649f6a6572f): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Sep 16 18:16:23.199210 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:23.199194    2580 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-rbac-proxy-node start failed in pod ovnkube-node-z5wvm_openshift-ovn-kubernetes(7be1fdca-ed0b-43e6-bbd0-0649f6a6572f): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Sep 16 18:16:23.203256 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:23.203203    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f416b510fcb7bc202c9983b4402fda0000c1565e3a1c5cab4d877aad9ec460\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm" podUID="7be1fdca-ed0b-43e6-bbd0-0649f6a6572f"
Sep 16 18:16:23.327091 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.327061    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 18:16:23.454286 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.454196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:23.454286 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.454233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:23.454485 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:23.454343    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:23.454485 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:23.454343    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:23.454485 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:23.454430    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs podName:4e6a401a-b5b2-4ae6-a2d0-965b2658777b nodeName:}" failed. No retries permitted until 2026-09-16 18:16:24.454410694 +0000 UTC m=+3.097436728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs") pod "network-metrics-daemon-qdft4" (UID: "4e6a401a-b5b2-4ae6-a2d0-965b2658777b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:23.454485 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:23.454452    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret podName:390d10d8-4834-4fd7-b1ce-1abd2943c8b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:24.454441701 +0000 UTC m=+3.097467732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret") pod "global-pull-secret-syncer-vm6px" (UID: "390d10d8-4834-4fd7-b1ce-1abd2943c8b4") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:23.554915 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.554881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgdjf\" (UniqueName: \"kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf\") pod \"network-check-target-kd9hb\" (UID: \"34926487-20cd-4648-95bc-a2fa6ea71769\") " pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:23.555077 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:23.555024    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:23.555077 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:23.555043    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:23.555077 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:23.555054    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lgdjf for pod openshift-network-diagnostics/network-check-target-kd9hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:23.555203 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:23.555110    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf podName:34926487-20cd-4648-95bc-a2fa6ea71769 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:24.555092321 +0000 UTC m=+3.198118361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lgdjf" (UniqueName: "kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf") pod "network-check-target-kd9hb" (UID: "34926487-20cd-4648-95bc-a2fa6ea71769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:23.566191 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.566162    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 18:16:23.797955 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.797684    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 18:11:22 +0000 UTC" deadline="2028-05-07 10:37:24.523088648 +0000 UTC"
Sep 16 18:16:23.797955 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.797752    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14368h21m0.725341824s"
Sep 16 18:16:23.907175 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.907115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8flws" event={"ID":"07924692-e25e-4a8f-91e7-ad3b901a01ec","Type":"ContainerStarted","Data":"2d61336432537a2f8516bed662f265749dcc62788bca7a0d85c2c3111fcc50fc"}
Sep 16 18:16:23.921352 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.921315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm" event={"ID":"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9","Type":"ContainerStarted","Data":"ea69a3a6ac72422b9fe5946ea9ddf1599be331882ab551926bc55c2500350fc2"}
Sep 16 18:16:23.925348 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.925316    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wwnfv" event={"ID":"89ccdf99-6291-4e06-8430-03249c76f153","Type":"ContainerStarted","Data":"ee20c72230708504a9c519e080ef154677624e222567b37996c77a2607b20ea3"}
Sep 16 18:16:23.937596 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.937565    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal" event={"ID":"2b215942334fadb1e5657317484eaae0","Type":"ContainerStarted","Data":"b8824ca1cf360e2f7940b3a209c69df5702c290bfbf96a607e01867c442dea0d"}
Sep 16 18:16:23.960532 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.960451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal" event={"ID":"3855482ecf545e291be557b4f332fc2e","Type":"ContainerStarted","Data":"9c73c38a938c1da6e98a2b948cc869f039bd145aa32dcd5bd1f6876fbe046c1a"}
Sep 16 18:16:23.968268 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.968229    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjszn" event={"ID":"261ed063-baba-46b3-a3ef-60200ba41266","Type":"ContainerStarted","Data":"a86b53dcf8f393acb226d7a0c6ea2ff0a6ac45e824d0e30510ada189ce0ef3b3"}
Sep 16 18:16:23.978162 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.978075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g86w8" event={"ID":"d5d73922-631e-4ce1-a5bb-d3c34095c12a","Type":"ContainerStarted","Data":"c7cdbfd37d46fa00544b7136883fac220ab2300da6bfc53b0d928f37a2cae388"}
Sep 16 18:16:23.988769 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.988725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2cflm" event={"ID":"4faeab58-7f14-4555-9bc8-db6c5cb61fce","Type":"ContainerStarted","Data":"5929500f6bbfcfbfb076fc4e86816a23b2379ab5e10097af3d71c9cff408eb19"}
Sep 16 18:16:23.993170 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:23.993124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm" event={"ID":"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f","Type":"ContainerStarted","Data":"c3cbd45df78a31d9aebfd3dc9162801856967c2ae7854a7fa5bacf16fc10f6eb"}
Sep 16 18:16:24.012413 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:24.012383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pq9c5" event={"ID":"b16330df-7050-44b6-acf9-326d07374804","Type":"ContainerStarted","Data":"018823c0133c9fa6930c49e231bb6fdab3e18b556bc35897ff87a9c60ea57a05"}
Sep 16 18:16:24.032577 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:24.032546    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k69k7" event={"ID":"87decdc9-1d76-402c-8fbb-d996fcaf8ce6","Type":"ContainerStarted","Data":"7995eb0902aeb90efc3ee62e0f9158a4c0b460c0b4989ce9534797490846a65a"}
Sep 16 18:16:24.037817 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:24.037748    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f416b510fcb7bc202c9983b4402fda0000c1565e3a1c5cab4d877aad9ec460\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f416b510fcb7bc202c9983b4402fda0000c1565e3a1c5cab4d877aad9ec460\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm" podUID="7be1fdca-ed0b-43e6-bbd0-0649f6a6572f"
Sep 16 18:16:24.463663 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:24.463622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:24.463904 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:24.463677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:24.463904 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:24.463802    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:24.463904 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:24.463873    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret podName:390d10d8-4834-4fd7-b1ce-1abd2943c8b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:26.463855101 +0000 UTC m=+5.106881132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret") pod "global-pull-secret-syncer-vm6px" (UID: "390d10d8-4834-4fd7-b1ce-1abd2943c8b4") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:24.464264 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:24.464248    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:24.464340 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:24.464301    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs podName:4e6a401a-b5b2-4ae6-a2d0-965b2658777b nodeName:}" failed. No retries permitted until 2026-09-16 18:16:26.464286752 +0000 UTC m=+5.107312773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs") pod "network-metrics-daemon-qdft4" (UID: "4e6a401a-b5b2-4ae6-a2d0-965b2658777b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:24.564314 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:24.564274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgdjf\" (UniqueName: \"kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf\") pod \"network-check-target-kd9hb\" (UID: \"34926487-20cd-4648-95bc-a2fa6ea71769\") " pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:24.564552 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:24.564474    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:24.564552 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:24.564497    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:24.564552 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:24.564509    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lgdjf for pod openshift-network-diagnostics/network-check-target-kd9hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:24.564741 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:24.564567    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf podName:34926487-20cd-4648-95bc-a2fa6ea71769 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:26.564548235 +0000 UTC m=+5.207574258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lgdjf" (UniqueName: "kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf") pod "network-check-target-kd9hb" (UID: "34926487-20cd-4648-95bc-a2fa6ea71769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:24.798761 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:24.798640    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 18:11:22 +0000 UTC" deadline="2028-04-26 20:43:18.149660081 +0000 UTC"
Sep 16 18:16:24.798761 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:24.798681    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14114h26m53.350983666s"
Sep 16 18:16:24.862271 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:24.861493    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:24.862271 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:24.861631    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:24.862271 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:24.862006    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:24.862271 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:24.862090    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:24.862271 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:24.862148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:24.862271 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:24.862215    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:25.191240 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:25.190979    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 18:16:26.479113 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:26.478889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:26.479610 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:26.479139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:26.479610 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:26.479035    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:26.479610 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:26.479263    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:26.479610 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:26.479324    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs podName:4e6a401a-b5b2-4ae6-a2d0-965b2658777b nodeName:}" failed. No retries permitted until 2026-09-16 18:16:30.479297349 +0000 UTC m=+9.122323389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs") pod "network-metrics-daemon-qdft4" (UID: "4e6a401a-b5b2-4ae6-a2d0-965b2658777b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:26.479610 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:26.479347    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret podName:390d10d8-4834-4fd7-b1ce-1abd2943c8b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:30.479337609 +0000 UTC m=+9.122363640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret") pod "global-pull-secret-syncer-vm6px" (UID: "390d10d8-4834-4fd7-b1ce-1abd2943c8b4") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:26.579935 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:26.579897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgdjf\" (UniqueName: \"kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf\") pod \"network-check-target-kd9hb\" (UID: \"34926487-20cd-4648-95bc-a2fa6ea71769\") " pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:26.580136 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:26.580111    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:26.580225 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:26.580142    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:26.580225 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:26.580158    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lgdjf for pod openshift-network-diagnostics/network-check-target-kd9hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:26.580314 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:26.580226    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf podName:34926487-20cd-4648-95bc-a2fa6ea71769 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:30.580206144 +0000 UTC m=+9.223232175 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lgdjf" (UniqueName: "kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf") pod "network-check-target-kd9hb" (UID: "34926487-20cd-4648-95bc-a2fa6ea71769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:26.860296 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:26.860210    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:26.860296 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:26.860248    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:26.860510 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:26.860219    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:26.860510 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:26.860380    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:26.860510 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:26.860449    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:26.860673 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:26.860526    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:28.860884 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:28.860841    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:28.861356 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:28.860965    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:28.861356 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:28.861129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:28.861356 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:28.861129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:28.861356 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:28.861235    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:28.861356 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:28.861300    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:30.510008 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:30.509970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:30.510426 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:30.510015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:30.510426 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:30.510127    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:30.510426 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:30.510185    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret podName:390d10d8-4834-4fd7-b1ce-1abd2943c8b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:38.510172599 +0000 UTC m=+17.153198617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret") pod "global-pull-secret-syncer-vm6px" (UID: "390d10d8-4834-4fd7-b1ce-1abd2943c8b4") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:30.510426 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:30.510127    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:30.510426 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:30.510246    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs podName:4e6a401a-b5b2-4ae6-a2d0-965b2658777b nodeName:}" failed. No retries permitted until 2026-09-16 18:16:38.510234257 +0000 UTC m=+17.153260287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs") pod "network-metrics-daemon-qdft4" (UID: "4e6a401a-b5b2-4ae6-a2d0-965b2658777b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:30.610755 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:30.610672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgdjf\" (UniqueName: \"kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf\") pod \"network-check-target-kd9hb\" (UID: \"34926487-20cd-4648-95bc-a2fa6ea71769\") " pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:30.610920 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:30.610817    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:30.610920 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:30.610836    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:30.610920 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:30.610848    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lgdjf for pod openshift-network-diagnostics/network-check-target-kd9hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:30.610920 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:30.610914    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf podName:34926487-20cd-4648-95bc-a2fa6ea71769 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:38.610897299 +0000 UTC m=+17.253923337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lgdjf" (UniqueName: "kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf") pod "network-check-target-kd9hb" (UID: "34926487-20cd-4648-95bc-a2fa6ea71769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:30.860594 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:30.860557    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:30.860594 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:30.860595    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:30.860813 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:30.860595    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:30.860813 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:30.860678    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:30.860813 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:30.860759    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:30.860902 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:30.860831    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:32.861023 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:32.860981    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:32.861517 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:32.861029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:32.861517 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:32.860981    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:32.861517 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:32.861114    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:32.861517 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:32.861236    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:32.861517 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:32.861322    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:34.860559 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:34.860528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:34.861074 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:34.860525    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:34.861074 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:34.860652    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:34.861074 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:34.860663    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:34.861074 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:34.860740    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:34.861074 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:34.860817    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:36.860826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:36.860572    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:36.860826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:36.860568    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:36.861557 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:36.860824    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:36.861557 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:36.860595    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:36.861557 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:36.860983    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:36.861557 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:36.861096    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:37.069730 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:37.069696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wwnfv" event={"ID":"89ccdf99-6291-4e06-8430-03249c76f153","Type":"ContainerStarted","Data":"0d7715161d60409fc3fea30ae6867a9c2ab4dd2a6d7d7807a638692cb870a9c9"}
Sep 16 18:16:37.071252 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:37.071224    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal" event={"ID":"3855482ecf545e291be557b4f332fc2e","Type":"ContainerStarted","Data":"d17942cd457b50971515057ca1b1077a9aaf9db1c889e9d73a0b558e75d3341c"}
Sep 16 18:16:37.072584 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:37.072560    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g86w8" event={"ID":"d5d73922-631e-4ce1-a5bb-d3c34095c12a","Type":"ContainerStarted","Data":"76822c1129601473e5c19bb893a3129efdaf63c620a1f3265b6387e3f486132d"}
Sep 16 18:16:37.087120 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:37.087080    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wwnfv" podStartSLOduration=3.276541141 podStartE2EDuration="16.08706785s" totalImagesPullingTime="12.810526709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:37.08675746 +0000 UTC m=+15.729783499" watchObservedRunningTime="2026-09-16 18:16:37.08706785 +0000 UTC m=+15.730093890"
Sep 16 18:16:37.100291 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:37.100163    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal" podStartSLOduration=15.100146701 podStartE2EDuration="15.100146701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:37.100025578 +0000 UTC m=+15.743051618" watchObservedRunningTime="2026-09-16 18:16:37.100146701 +0000 UTC m=+15.743172741"
Sep 16 18:16:37.119388 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:37.119227    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g86w8" podStartSLOduration=2.079513297 podStartE2EDuration="15.119215913s" totalImagesPullingTime="13.039702616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:37.119124017 +0000 UTC m=+15.762150056" watchObservedRunningTime="2026-09-16 18:16:37.119215913 +0000 UTC m=+15.762241953"
Sep 16 18:16:38.076890 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.076848    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2cflm" event={"ID":"4faeab58-7f14-4555-9bc8-db6c5cb61fce","Type":"ContainerStarted","Data":"237fe98679225b95cf15b2e9abe6f9b795c5d45290f33e6f286c7b907928e70c"}
Sep 16 18:16:38.079033 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.079004    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pq9c5" event={"ID":"b16330df-7050-44b6-acf9-326d07374804","Type":"ContainerStarted","Data":"b5e5782a01bf9c34eb5c566e54185a180dae046147385a63d144c4899439d52f"}
Sep 16 18:16:38.081179 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.081151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k69k7" event={"ID":"87decdc9-1d76-402c-8fbb-d996fcaf8ce6","Type":"ContainerStarted","Data":"058ac86c5941e662a915bc088be265fd8ed40dab224d562a53beb811755c3807"}
Sep 16 18:16:38.083185 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.083156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8flws" event={"ID":"07924692-e25e-4a8f-91e7-ad3b901a01ec","Type":"ContainerStarted","Data":"d137fb402ace4fbb71da7bb3bac4db85166ea0c4180d64271528ff2b1dc9b5a9"}
Sep 16 18:16:38.085081 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.085058    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm" event={"ID":"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9","Type":"ContainerStarted","Data":"cc4e2d9652f7b29482ff27d60d182f8ad5296ff3f339972a0e72bfce41934748"}
Sep 16 18:16:38.086695 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.086667    2580 generic.go:356] "Generic (PLEG): container finished" podID="2b215942334fadb1e5657317484eaae0" containerID="abfb42962b17dd58915a457e476812d997e090a1d81c7e4c0ca2af9b99b71849" exitCode=0
Sep 16 18:16:38.086794 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.086744    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal" event={"ID":"2b215942334fadb1e5657317484eaae0","Type":"ContainerDied","Data":"abfb42962b17dd58915a457e476812d997e090a1d81c7e4c0ca2af9b99b71849"}
Sep 16 18:16:38.088642 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.088618    2580 generic.go:356] "Generic (PLEG): container finished" podID="261ed063-baba-46b3-a3ef-60200ba41266" containerID="65f861065a866cdecfcd2a7910e761b563c7a9a70ffd4075b2cb0613684140b1" exitCode=0
Sep 16 18:16:38.089488 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.088850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjszn" event={"ID":"261ed063-baba-46b3-a3ef-60200ba41266","Type":"ContainerDied","Data":"65f861065a866cdecfcd2a7910e761b563c7a9a70ffd4075b2cb0613684140b1"}
Sep 16 18:16:38.102730 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.102681    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2cflm" podStartSLOduration=3.378241098 podStartE2EDuration="16.102662037s" totalImagesPullingTime="12.724420939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:38.102100795 +0000 UTC m=+16.745126835" watchObservedRunningTime="2026-09-16 18:16:38.102662037 +0000 UTC m=+16.745688077"
Sep 16 18:16:38.117729 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.117684    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k69k7" podStartSLOduration=4.354019924 podStartE2EDuration="17.117673205s" totalImagesPullingTime="12.763653281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:38.117325586 +0000 UTC m=+16.760351626" watchObservedRunningTime="2026-09-16 18:16:38.117673205 +0000 UTC m=+16.760699242"
Sep 16 18:16:38.187840 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.185654    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8flws" podStartSLOduration=4.422827071 podStartE2EDuration="17.185631327s" totalImagesPullingTime="12.762804256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:38.169583758 +0000 UTC m=+16.812609797" watchObservedRunningTime="2026-09-16 18:16:38.185631327 +0000 UTC m=+16.828657370"
Sep 16 18:16:38.187840 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.186102    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pq9c5" podStartSLOduration=7.36640881 podStartE2EDuration="16.186082468s" totalImagesPullingTime="8.819673658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:38.185195151 +0000 UTC m=+16.828221191" watchObservedRunningTime="2026-09-16 18:16:38.186082468 +0000 UTC m=+16.829108509"
Sep 16 18:16:38.569347 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.569268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:38.569599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.569376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:38.569599 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:38.569487    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:38.569599 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:38.569487    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:38.569719 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:38.569552    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs podName:4e6a401a-b5b2-4ae6-a2d0-965b2658777b nodeName:}" failed. No retries permitted until 2026-09-16 18:16:54.569532571 +0000 UTC m=+33.212558602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs") pod "network-metrics-daemon-qdft4" (UID: "4e6a401a-b5b2-4ae6-a2d0-965b2658777b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:38.569719 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:38.569647    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret podName:390d10d8-4834-4fd7-b1ce-1abd2943c8b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:54.569621261 +0000 UTC m=+33.212647292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret") pod "global-pull-secret-syncer-vm6px" (UID: "390d10d8-4834-4fd7-b1ce-1abd2943c8b4") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:38.670039 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.670002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgdjf\" (UniqueName: \"kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf\") pod \"network-check-target-kd9hb\" (UID: \"34926487-20cd-4648-95bc-a2fa6ea71769\") " pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:38.670210 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:38.670198    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:38.670278 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:38.670218    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:38.670278 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:38.670231    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lgdjf for pod openshift-network-diagnostics/network-check-target-kd9hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:38.670398 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:38.670282    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf podName:34926487-20cd-4648-95bc-a2fa6ea71769 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:54.670265483 +0000 UTC m=+33.313291506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lgdjf" (UniqueName: "kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf") pod "network-check-target-kd9hb" (UID: "34926487-20cd-4648-95bc-a2fa6ea71769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:38.860502 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.860428    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:38.860669 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:38.860538    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:38.860669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.860428    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:38.860669 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:38.860661    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:38.860854 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:38.860429    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:38.860854 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:38.860734    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:39.165737 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:39.165686    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 18:16:39.815605 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:39.815193    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T18:16:39.16570824Z","UUID":"a7f092c8-d8e8-4d6a-a7e9-618ed83d4640","Handler":null,"Name":"","Endpoint":""}
Sep 16 18:16:39.816827 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:39.816803    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 18:16:39.816954 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:39.816838    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 18:16:40.096025 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:40.095940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm" event={"ID":"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9","Type":"ContainerStarted","Data":"9689a758393516c49c37349fabcd648a2f38cd4b632c5d9d542076296d5fdb3b"}
Sep 16 18:16:40.096025 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:40.096004    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm" event={"ID":"ee7b2b65-4a88-41a2-a2ea-3022fd491aa9","Type":"ContainerStarted","Data":"8f1d858ee10196d1733fc22850fa02386769101b7a5b1f4dc9c2c9998ce17683"}
Sep 16 18:16:40.098225 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:40.098194    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal" event={"ID":"2b215942334fadb1e5657317484eaae0","Type":"ContainerStarted","Data":"82b6c4b0a1c88ca692576d38a2ad58e7cb01c393b24034fbe52c5a81ce145882"}
Sep 16 18:16:40.117541 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:40.117492    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mdjkm" podStartSLOduration=3.714266307 podStartE2EDuration="19.117470268s" totalImagesPullingTime="15.403203961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:40.116758426 +0000 UTC m=+18.759784457" watchObservedRunningTime="2026-09-16 18:16:40.117470268 +0000 UTC m=+18.760496308"
Sep 16 18:16:40.137220 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:40.137169    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal" podStartSLOduration=18.137151085 podStartE2EDuration="18.137151085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:40.136899719 +0000 UTC m=+18.779925758" watchObservedRunningTime="2026-09-16 18:16:40.137151085 +0000 UTC m=+18.780177127"
Sep 16 18:16:40.311512 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:40.311382    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pq9c5"
Sep 16 18:16:40.861492 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:40.860820    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:40.861492 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:40.861259    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:40.861492 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:40.860902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:40.861492 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:40.861379    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:40.861492 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:40.860860    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:40.861492 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:40.861455    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:42.576410 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:42.576358    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pq9c5"
Sep 16 18:16:42.576983 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:42.576965    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pq9c5"
Sep 16 18:16:42.860166 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:42.860139    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:42.860331 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:42.860139    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:42.860331 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:42.860259    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:42.860471 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:42.860324    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:42.860471 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:42.860139    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:42.860471 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:42.860417    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:43.105482 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:43.105457    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pq9c5"
Sep 16 18:16:44.860691 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:44.860658    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:44.861181 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:44.860667    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:44.861181 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:44.860676    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:44.861181 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:44.860916    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:44.861181 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:44.860791    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:44.861181 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:44.860973    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:46.860357 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:46.860193    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:46.860866 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:46.860195    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:46.860866 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:46.860438    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:46.860866 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:46.860195    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:46.860866 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:46.860491    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:46.860866 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:46.860565    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:47.114995 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:47.114960    2580 generic.go:356] "Generic (PLEG): container finished" podID="261ed063-baba-46b3-a3ef-60200ba41266" containerID="a726636cae17fa34908ddbc5fe49edb4295fe0722a81538c0e7a8a85e1b9672a" exitCode=0
Sep 16 18:16:47.115185 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:47.115041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjszn" event={"ID":"261ed063-baba-46b3-a3ef-60200ba41266","Type":"ContainerDied","Data":"a726636cae17fa34908ddbc5fe49edb4295fe0722a81538c0e7a8a85e1b9672a"}
Sep 16 18:16:47.117914 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:47.117888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm" event={"ID":"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f","Type":"ContainerStarted","Data":"45af9fdeb973a448d31264674458fb1bd30209482490a22d6d43c684195704ba"}
Sep 16 18:16:47.118005 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:47.117949    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm" event={"ID":"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f","Type":"ContainerStarted","Data":"9fbefcdfdd65614f2eac65b9ebeb65eb81a612f2e9a7efa8cc99b0a5ed21c10f"}
Sep 16 18:16:47.118005 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:47.117991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm" event={"ID":"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f","Type":"ContainerStarted","Data":"52f5ca5174697e208060adb28cc2380f953184446f6d11c355a79b9f05ffc292"}
Sep 16 18:16:47.118085 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:47.118019    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm" event={"ID":"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f","Type":"ContainerStarted","Data":"93138a0f539b78711d33c72712153392c26a16beea7c997fbb8830c286c088d0"}
Sep 16 18:16:47.118085 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:47.118045    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm" event={"ID":"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f","Type":"ContainerStarted","Data":"8bea09878bbfe4e29e659c485f01efbe1aac6c7c5ead85321666ec210aaff924"}
Sep 16 18:16:47.118164 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:47.118084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm" event={"ID":"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f","Type":"ContainerStarted","Data":"7bc62aa393346838533d5f186e025c94f2967814f6cb7b2cf7601e4b1493c2b8"}
Sep 16 18:16:48.121520 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:48.121478    2580 generic.go:356] "Generic (PLEG): container finished" podID="261ed063-baba-46b3-a3ef-60200ba41266" containerID="5583478d03bf48e820739a5821d80d6ecaa611a30f489dab1c08e059888e2404" exitCode=0
Sep 16 18:16:48.121898 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:48.121524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjszn" event={"ID":"261ed063-baba-46b3-a3ef-60200ba41266","Type":"ContainerDied","Data":"5583478d03bf48e820739a5821d80d6ecaa611a30f489dab1c08e059888e2404"}
Sep 16 18:16:48.860019 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:48.859993    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:48.860116 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:48.860083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:48.860116 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:48.860089    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:48.860116 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:48.860109    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:48.860240 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:48.860175    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:48.860240 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:48.860228    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:49.126744 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:49.126710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm" event={"ID":"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f","Type":"ContainerStarted","Data":"36da13f263be1531d06f4011a4c81494e2ae2069f2b0fd76b11aadd29829b805"}
Sep 16 18:16:49.128973 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:49.128949    2580 generic.go:356] "Generic (PLEG): container finished" podID="261ed063-baba-46b3-a3ef-60200ba41266" containerID="7b39a931d58309eca7a8efc7b3b92fca364f0116f22af46e30a5bbb75d43d914" exitCode=0
Sep 16 18:16:49.129069 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:49.128988    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjszn" event={"ID":"261ed063-baba-46b3-a3ef-60200ba41266","Type":"ContainerDied","Data":"7b39a931d58309eca7a8efc7b3b92fca364f0116f22af46e30a5bbb75d43d914"}
Sep 16 18:16:50.860578 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:50.860546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:50.861015 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:50.860584    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:50.861015 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:50.860585    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:50.861015 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:50.860680    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:50.861015 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:50.860768    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:50.861015 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:50.860853    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:51.139186 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:51.138756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm" event={"ID":"7be1fdca-ed0b-43e6-bbd0-0649f6a6572f","Type":"ContainerStarted","Data":"7730ee3b12a1deebfcc29a3f966e4a4ddb3ce13e1f260374552e95ea5f965851"}
Sep 16 18:16:51.139186 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:51.139111    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:51.139186 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:51.139172    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:51.139414 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:51.139220    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:51.159006 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:51.158800    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:51.159525 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:51.159399    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:16:51.170632 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:51.170539    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm" podStartSLOduration=5.8095809769999995 podStartE2EDuration="29.170519995s" totalImagesPullingTime="23.360939018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=2 observedRunningTime="2026-09-16 18:16:51.170074302 +0000 UTC m=+29.813100344" watchObservedRunningTime="2026-09-16 18:16:51.170519995 +0000 UTC m=+29.813546035"
Sep 16 18:16:52.860846 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:52.860811    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:52.860846 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:52.860828    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:52.861679 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:52.860815    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:52.861679 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:52.860937    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:52.861679 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:52.861042    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:52.861679 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:52.861136    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:53.374215 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:53.374017    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qdft4"]
Sep 16 18:16:53.374338 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:53.374297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:53.374428 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:53.374401    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:53.376145 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:53.376119    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kd9hb"]
Sep 16 18:16:53.376240 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:53.376206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:53.376314 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:53.376296    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:53.390582 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:53.390495    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vm6px"]
Sep 16 18:16:53.390582 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:53.390574    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:53.390726 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:53.390664    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:54.147975 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:54.147940    2580 generic.go:356] "Generic (PLEG): container finished" podID="261ed063-baba-46b3-a3ef-60200ba41266" containerID="a07f378e50faf7e9e5ba8277b7dd4378ee68aa0376b6a5117466ed9127a0f140" exitCode=0
Sep 16 18:16:54.148351 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:54.148022    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjszn" event={"ID":"261ed063-baba-46b3-a3ef-60200ba41266","Type":"ContainerDied","Data":"a07f378e50faf7e9e5ba8277b7dd4378ee68aa0376b6a5117466ed9127a0f140"}
Sep 16 18:16:54.584214 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:54.584193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:54.584406 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:54.584226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:54.584406 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:54.584320    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:54.584406 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:54.584321    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:54.584406 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:54.584363    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret podName:390d10d8-4834-4fd7-b1ce-1abd2943c8b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:26.584352043 +0000 UTC m=+65.227378061 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret") pod "global-pull-secret-syncer-vm6px" (UID: "390d10d8-4834-4fd7-b1ce-1abd2943c8b4") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:54.584406 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:54.584393    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs podName:4e6a401a-b5b2-4ae6-a2d0-965b2658777b nodeName:}" failed. No retries permitted until 2026-09-16 18:17:26.584384494 +0000 UTC m=+65.227410512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs") pod "network-metrics-daemon-qdft4" (UID: "4e6a401a-b5b2-4ae6-a2d0-965b2658777b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:54.685453 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:54.685415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgdjf\" (UniqueName: \"kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf\") pod \"network-check-target-kd9hb\" (UID: \"34926487-20cd-4648-95bc-a2fa6ea71769\") " pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:54.685620 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:54.685531    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:54.685620 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:54.685544    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:54.685620 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:54.685554    2580 projected.go:196] Error preparing data for projected volume kube-api-access-lgdjf for pod openshift-network-diagnostics/network-check-target-kd9hb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:54.685620 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:54.685595    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf podName:34926487-20cd-4648-95bc-a2fa6ea71769 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:26.685583066 +0000 UTC m=+65.328609085 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lgdjf" (UniqueName: "kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf") pod "network-check-target-kd9hb" (UID: "34926487-20cd-4648-95bc-a2fa6ea71769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:54.860648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:54.860573    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:54.860648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:54.860643    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:54.860865 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:54.860667    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:54.860865 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:54.860760    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:54.860865 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:54.860791    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:54.860865 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:54.860857    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:55.153564 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:55.153538    2580 generic.go:356] "Generic (PLEG): container finished" podID="261ed063-baba-46b3-a3ef-60200ba41266" containerID="f7370373c1fa0c569b5fae76b396b13130da6f33ec19d90e895df9ec67def27e" exitCode=0
Sep 16 18:16:55.153851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:55.153600    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjszn" event={"ID":"261ed063-baba-46b3-a3ef-60200ba41266","Type":"ContainerDied","Data":"f7370373c1fa0c569b5fae76b396b13130da6f33ec19d90e895df9ec67def27e"}
Sep 16 18:16:56.158913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:56.158835    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjszn" event={"ID":"261ed063-baba-46b3-a3ef-60200ba41266","Type":"ContainerStarted","Data":"8d6be2d5d4f59d3c564f81fb0a22bd1cc2ddb365a4a673e5ef037121f0933ac0"}
Sep 16 18:16:56.184135 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:56.184090    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kjszn" podStartSLOduration=7.6212795490000005 podStartE2EDuration="34.184076929s" totalImagesPullingTime="26.56279738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:56.182957761 +0000 UTC m=+34.825983811" watchObservedRunningTime="2026-09-16 18:16:56.184076929 +0000 UTC m=+34.827102968"
Sep 16 18:16:56.861063 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:56.861034    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:56.861063 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:56.861048    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:56.861292 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:56.861131    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:56.861292 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:56.861191    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:56.861414 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:56.861286    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:56.861414 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:56.861396    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:58.861023 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:58.860993    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:16:58.861480 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:58.860993    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:16:58.861480 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:58.861086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:16:58.861480 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:58.861089    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdft4" podUID="4e6a401a-b5b2-4ae6-a2d0-965b2658777b"
Sep 16 18:16:58.861480 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:58.861153    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kd9hb" podUID="34926487-20cd-4648-95bc-a2fa6ea71769"
Sep 16 18:16:58.861480 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:58.861238    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6px" podUID="390d10d8-4834-4fd7-b1ce-1abd2943c8b4"
Sep 16 18:16:59.145138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.145110    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeReady"
Sep 16 18:16:59.145261 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.145225    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 18:16:59.193651 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.193619    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xbx5k"]
Sep 16 18:16:59.218614 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.218591    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rgv5m"]
Sep 16 18:16:59.218748 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.218707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.221201 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.221180    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 18:16:59.221312 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.221244    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 18:16:59.221660 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.221645    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f8sdc\""
Sep 16 18:16:59.242191 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.242170    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rgv5m"]
Sep 16 18:16:59.242275 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.242196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xbx5k"]
Sep 16 18:16:59.242311 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.242270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rgv5m"
Sep 16 18:16:59.244447 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.244433    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 18:16:59.244588 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.244567    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 18:16:59.244710 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.244694    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 18:16:59.244845 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.244829    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zhggq\""
Sep 16 18:16:59.319465 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.319431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.319614 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.319471    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsjxh\" (UniqueName: \"kubernetes.io/projected/dece4fee-3ac5-4f85-afb3-037f880df056-kube-api-access-lsjxh\") pod \"ingress-canary-rgv5m\" (UID: \"dece4fee-3ac5-4f85-afb3-037f880df056\") " pod="openshift-ingress-canary/ingress-canary-rgv5m"
Sep 16 18:16:59.319614 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.319491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gfft\" (UniqueName: \"kubernetes.io/projected/596d0e8d-6220-4472-be11-369dd730bb6f-kube-api-access-4gfft\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.319614 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.319509    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dece4fee-3ac5-4f85-afb3-037f880df056-cert\") pod \"ingress-canary-rgv5m\" (UID: \"dece4fee-3ac5-4f85-afb3-037f880df056\") " pod="openshift-ingress-canary/ingress-canary-rgv5m"
Sep 16 18:16:59.319614 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.319565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/596d0e8d-6220-4472-be11-369dd730bb6f-config-volume\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.319614 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.319593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/596d0e8d-6220-4472-be11-369dd730bb6f-tmp-dir\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.420700 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.420625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.420700 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.420663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsjxh\" (UniqueName: \"kubernetes.io/projected/dece4fee-3ac5-4f85-afb3-037f880df056-kube-api-access-lsjxh\") pod \"ingress-canary-rgv5m\" (UID: \"dece4fee-3ac5-4f85-afb3-037f880df056\") " pod="openshift-ingress-canary/ingress-canary-rgv5m"
Sep 16 18:16:59.420700 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.420682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gfft\" (UniqueName: \"kubernetes.io/projected/596d0e8d-6220-4472-be11-369dd730bb6f-kube-api-access-4gfft\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.420902 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:59.420770    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 18:16:59.420902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.420802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dece4fee-3ac5-4f85-afb3-037f880df056-cert\") pod \"ingress-canary-rgv5m\" (UID: \"dece4fee-3ac5-4f85-afb3-037f880df056\") " pod="openshift-ingress-canary/ingress-canary-rgv5m"
Sep 16 18:16:59.420902 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:59.420830    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls podName:596d0e8d-6220-4472-be11-369dd730bb6f nodeName:}" failed. No retries permitted until 2026-09-16 18:16:59.920814738 +0000 UTC m=+38.563840757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls") pod "dns-default-xbx5k" (UID: "596d0e8d-6220-4472-be11-369dd730bb6f") : secret "dns-default-metrics-tls" not found
Sep 16 18:16:59.420902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.420871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/596d0e8d-6220-4472-be11-369dd730bb6f-config-volume\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.420902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.420888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/596d0e8d-6220-4472-be11-369dd730bb6f-tmp-dir\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.421563 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.421541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/596d0e8d-6220-4472-be11-369dd730bb6f-tmp-dir\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.421744 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.421729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/596d0e8d-6220-4472-be11-369dd730bb6f-config-volume\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.424825 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.424707    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dece4fee-3ac5-4f85-afb3-037f880df056-cert\") pod \"ingress-canary-rgv5m\" (UID: \"dece4fee-3ac5-4f85-afb3-037f880df056\") " pod="openshift-ingress-canary/ingress-canary-rgv5m"
Sep 16 18:16:59.431347 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.431325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsjxh\" (UniqueName: \"kubernetes.io/projected/dece4fee-3ac5-4f85-afb3-037f880df056-kube-api-access-lsjxh\") pod \"ingress-canary-rgv5m\" (UID: \"dece4fee-3ac5-4f85-afb3-037f880df056\") " pod="openshift-ingress-canary/ingress-canary-rgv5m"
Sep 16 18:16:59.431437 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.431416    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gfft\" (UniqueName: \"kubernetes.io/projected/596d0e8d-6220-4472-be11-369dd730bb6f-kube-api-access-4gfft\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.549716 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.549684    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rgv5m"
Sep 16 18:16:59.864469 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.864447    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rgv5m"]
Sep 16 18:16:59.865545 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:16:59.865520    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddece4fee_3ac5_4f85_afb3_037f880df056.slice/crio-9fe9e79d4be35d20313ee36130116a675b80ab079b4174b8689c12d3d957b458 WatchSource:0}: Error finding container 9fe9e79d4be35d20313ee36130116a675b80ab079b4174b8689c12d3d957b458: Status 404 returned error can't find the container with id 9fe9e79d4be35d20313ee36130116a675b80ab079b4174b8689c12d3d957b458
Sep 16 18:16:59.924139 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:16:59.924119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:16:59.924248 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:59.924237    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 18:16:59.924287 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:16:59.924282    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls podName:596d0e8d-6220-4472-be11-369dd730bb6f nodeName:}" failed. No retries permitted until 2026-09-16 18:17:00.924269635 +0000 UTC m=+39.567295653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls") pod "dns-default-xbx5k" (UID: "596d0e8d-6220-4472-be11-369dd730bb6f") : secret "dns-default-metrics-tls" not found
Sep 16 18:17:00.168418 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:00.168327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rgv5m" event={"ID":"dece4fee-3ac5-4f85-afb3-037f880df056","Type":"ContainerStarted","Data":"9fe9e79d4be35d20313ee36130116a675b80ab079b4174b8689c12d3d957b458"}
Sep 16 18:17:00.860909 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:00.860875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:17:00.861094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:00.860875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:17:00.861094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:00.860875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:17:00.864472 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:00.864441    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 18:17:00.864902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:00.864484    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 18:17:00.864902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:00.864511    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5rgdl\""
Sep 16 18:17:00.864902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:00.864456    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bfgtt\""
Sep 16 18:17:00.864902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:00.864744    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 18:17:00.864902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:00.864858    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 18:17:00.932534 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:00.932508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:17:00.932663 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:00.932613    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 18:17:00.932714 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:00.932671    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls podName:596d0e8d-6220-4472-be11-369dd730bb6f nodeName:}" failed. No retries permitted until 2026-09-16 18:17:02.93265823 +0000 UTC m=+41.575684248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls") pod "dns-default-xbx5k" (UID: "596d0e8d-6220-4472-be11-369dd730bb6f") : secret "dns-default-metrics-tls" not found
Sep 16 18:17:02.950404 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:02.950193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:17:02.950835 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:02.950344    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 18:17:02.950835 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:02.950498    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls podName:596d0e8d-6220-4472-be11-369dd730bb6f nodeName:}" failed. No retries permitted until 2026-09-16 18:17:06.950483935 +0000 UTC m=+45.593509966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls") pod "dns-default-xbx5k" (UID: "596d0e8d-6220-4472-be11-369dd730bb6f") : secret "dns-default-metrics-tls" not found
Sep 16 18:17:03.176294 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:03.176256    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rgv5m" event={"ID":"dece4fee-3ac5-4f85-afb3-037f880df056","Type":"ContainerStarted","Data":"108499e9fadd912f29256ed7b456f0c8221cb4e2c73795ed80ecb10d5729cb02"}
Sep 16 18:17:03.192887 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:03.192831    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rgv5m" podStartSLOduration=1.6506870500000002 podStartE2EDuration="4.192812707s" totalImagesPullingTime="2.542125657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:03.192353598 +0000 UTC m=+41.835379641" watchObservedRunningTime="2026-09-16 18:17:03.192812707 +0000 UTC m=+41.835838749"
Sep 16 18:17:06.977192 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:06.977152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:17:06.977621 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:06.977273    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 18:17:06.977621 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:06.977332    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls podName:596d0e8d-6220-4472-be11-369dd730bb6f nodeName:}" failed. No retries permitted until 2026-09-16 18:17:14.977319549 +0000 UTC m=+53.620345568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls") pod "dns-default-xbx5k" (UID: "596d0e8d-6220-4472-be11-369dd730bb6f") : secret "dns-default-metrics-tls" not found
Sep 16 18:17:15.030254 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:15.030210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:17:15.030707 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:15.030396    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 18:17:15.030707 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:15.030468    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls podName:596d0e8d-6220-4472-be11-369dd730bb6f nodeName:}" failed. No retries permitted until 2026-09-16 18:17:31.030450944 +0000 UTC m=+69.673476962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls") pod "dns-default-xbx5k" (UID: "596d0e8d-6220-4472-be11-369dd730bb6f") : secret "dns-default-metrics-tls" not found
Sep 16 18:17:17.121660 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.121627    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"]
Sep 16 18:17:17.123253 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.123238    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:17.137709 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.137685    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"]
Sep 16 18:17:17.140754 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.140736    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 18:17:17.140754 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.140741    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 16 18:17:17.141201 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.141184    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 18:17:17.142687 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.142669    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zvz67\""
Sep 16 18:17:17.142769 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.142703    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 16 18:17:17.224416 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.224388    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65687db45b-r2p28"]
Sep 16 18:17:17.226158 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.226145    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.230218 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.230198    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 18:17:17.231047 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.231031    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 18:17:17.231251 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.231234    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 18:17:17.232064 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.232048    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mlk5x\""
Sep 16 18:17:17.236897 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.236879    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 18:17:17.245038 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.245014    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bbdd6d73-7b95-466f-aa35-4f398daabb71-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:17.245173 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.245064    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfxg2\" (UniqueName: \"kubernetes.io/projected/bbdd6d73-7b95-466f-aa35-4f398daabb71-kube-api-access-wfxg2\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:17.245173 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.245097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:17.246131 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.246112    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65687db45b-r2p28"]
Sep 16 18:17:17.316011 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.315978    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"]
Sep 16 18:17:17.318046 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.318028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:17.320014 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.319998    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dr99j\""
Sep 16 18:17:17.320226 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.320210    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 16 18:17:17.320622 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.320607    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 16 18:17:17.320743 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.320731    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 16 18:17:17.332665 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.332644    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"]
Sep 16 18:17:17.345970 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.345951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-bound-sa-token\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.346069 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.345980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:17.346069 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.346002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9887t\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-kube-api-access-9887t\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.346163 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.346077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bbdd6d73-7b95-466f-aa35-4f398daabb71-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:17.346163 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:17.346108    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 18:17:17.346163 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.346112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-image-registry-private-configuration\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.346302 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:17.346181    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls podName:bbdd6d73-7b95-466f-aa35-4f398daabb71 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:17.846162004 +0000 UTC m=+56.489188024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-44q9j" (UID: "bbdd6d73-7b95-466f-aa35-4f398daabb71") : secret "cluster-monitoring-operator-tls" not found
Sep 16 18:17:17.346302 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.346218    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-certificates\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.346302 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.346262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.346302 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.346288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-trusted-ca\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.346476 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.346359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfxg2\" (UniqueName: \"kubernetes.io/projected/bbdd6d73-7b95-466f-aa35-4f398daabb71-kube-api-access-wfxg2\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:17.346476 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.346445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-ca-trust-extracted\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.346476 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.346465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-installation-pull-secrets\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.346791 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.346773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bbdd6d73-7b95-466f-aa35-4f398daabb71-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:17.356704 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.356683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfxg2\" (UniqueName: \"kubernetes.io/projected/bbdd6d73-7b95-466f-aa35-4f398daabb71-kube-api-access-wfxg2\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:17.447270 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.447201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.447270 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.447231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-trusted-ca\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.447270 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.447251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rxps\" (UniqueName: \"kubernetes.io/projected/6a870b30-9dca-4bc0-b707-7980d8290a7a-kube-api-access-7rxps\") pod \"cluster-samples-operator-86499c89c4-qtmx7\" (UID: \"6a870b30-9dca-4bc0-b707-7980d8290a7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:17.447481 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.447285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-ca-trust-extracted\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.447481 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:17.447349    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 18:17:17.447481 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:17.447386    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65687db45b-r2p28: secret "image-registry-tls" not found
Sep 16 18:17:17.447481 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.447457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-installation-pull-secrets\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.447859 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.447838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-bound-sa-token\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.447963 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:17.447901    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls podName:89f29206-7d2e-4dc3-a7a5-42ef0c7c110b nodeName:}" failed. No retries permitted until 2026-09-16 18:17:17.947874728 +0000 UTC m=+56.590900747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls") pod "image-registry-65687db45b-r2p28" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b") : secret "image-registry-tls" not found
Sep 16 18:17:17.448118 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.448096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-ca-trust-extracted\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.448177 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.448097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9887t\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-kube-api-access-9887t\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.448623 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.448602    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qtmx7\" (UID: \"6a870b30-9dca-4bc0-b707-7980d8290a7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:17.448848 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.448797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-image-registry-private-configuration\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.448964 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.448951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-certificates\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.449548 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.449529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-certificates\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.449678 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.448677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-trusted-ca\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.451831 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.451805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-installation-pull-secrets\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.452156 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.452137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-image-registry-private-configuration\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.456348 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.456331    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9887t\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-kube-api-access-9887t\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.458578 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.458555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-bound-sa-token\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.549994 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.549955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rxps\" (UniqueName: \"kubernetes.io/projected/6a870b30-9dca-4bc0-b707-7980d8290a7a-kube-api-access-7rxps\") pod \"cluster-samples-operator-86499c89c4-qtmx7\" (UID: \"6a870b30-9dca-4bc0-b707-7980d8290a7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:17.550151 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.550033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qtmx7\" (UID: \"6a870b30-9dca-4bc0-b707-7980d8290a7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:17.550201 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:17.550162    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 18:17:17.550241 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:17.550230    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls podName:6a870b30-9dca-4bc0-b707-7980d8290a7a nodeName:}" failed. No retries permitted until 2026-09-16 18:17:18.050215491 +0000 UTC m=+56.693241510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-qtmx7" (UID: "6a870b30-9dca-4bc0-b707-7980d8290a7a") : secret "samples-operator-tls" not found
Sep 16 18:17:17.558382 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.558351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rxps\" (UniqueName: \"kubernetes.io/projected/6a870b30-9dca-4bc0-b707-7980d8290a7a-kube-api-access-7rxps\") pod \"cluster-samples-operator-86499c89c4-qtmx7\" (UID: \"6a870b30-9dca-4bc0-b707-7980d8290a7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:17.852708 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.852672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:17.852853 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:17.852816    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 18:17:17.852905 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:17.852895    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls podName:bbdd6d73-7b95-466f-aa35-4f398daabb71 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:18.852879748 +0000 UTC m=+57.495905787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-44q9j" (UID: "bbdd6d73-7b95-466f-aa35-4f398daabb71") : secret "cluster-monitoring-operator-tls" not found
Sep 16 18:17:17.953579 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:17.953544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:17.953737 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:17.953669    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 18:17:17.953737 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:17.953682    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65687db45b-r2p28: secret "image-registry-tls" not found
Sep 16 18:17:17.953808 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:17.953742    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls podName:89f29206-7d2e-4dc3-a7a5-42ef0c7c110b nodeName:}" failed. No retries permitted until 2026-09-16 18:17:18.953724625 +0000 UTC m=+57.596750643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls") pod "image-registry-65687db45b-r2p28" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b") : secret "image-registry-tls" not found
Sep 16 18:17:18.054870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:18.054837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qtmx7\" (UID: \"6a870b30-9dca-4bc0-b707-7980d8290a7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:18.055013 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:18.054974    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 18:17:18.055055 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:18.055032    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls podName:6a870b30-9dca-4bc0-b707-7980d8290a7a nodeName:}" failed. No retries permitted until 2026-09-16 18:17:19.05501761 +0000 UTC m=+57.698043628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-qtmx7" (UID: "6a870b30-9dca-4bc0-b707-7980d8290a7a") : secret "samples-operator-tls" not found
Sep 16 18:17:18.861957 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:18.861895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:18.862347 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:18.862039    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 18:17:18.862347 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:18.862101    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls podName:bbdd6d73-7b95-466f-aa35-4f398daabb71 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:20.862087348 +0000 UTC m=+59.505113366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-44q9j" (UID: "bbdd6d73-7b95-466f-aa35-4f398daabb71") : secret "cluster-monitoring-operator-tls" not found
Sep 16 18:17:18.962917 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:18.962883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:18.963080 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:18.963060    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 18:17:18.963142 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:18.963086    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65687db45b-r2p28: secret "image-registry-tls" not found
Sep 16 18:17:18.963188 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:18.963155    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls podName:89f29206-7d2e-4dc3-a7a5-42ef0c7c110b nodeName:}" failed. No retries permitted until 2026-09-16 18:17:20.963135289 +0000 UTC m=+59.606161328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls") pod "image-registry-65687db45b-r2p28" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b") : secret "image-registry-tls" not found
Sep 16 18:17:19.064035 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:19.064002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qtmx7\" (UID: \"6a870b30-9dca-4bc0-b707-7980d8290a7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:19.064184 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:19.064106    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 18:17:19.064184 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:19.064153    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls podName:6a870b30-9dca-4bc0-b707-7980d8290a7a nodeName:}" failed. No retries permitted until 2026-09-16 18:17:21.06414024 +0000 UTC m=+59.707166258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-qtmx7" (UID: "6a870b30-9dca-4bc0-b707-7980d8290a7a") : secret "samples-operator-tls" not found
Sep 16 18:17:20.877042 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:20.877008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:20.877449 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:20.877108    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 18:17:20.877449 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:20.877177    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls podName:bbdd6d73-7b95-466f-aa35-4f398daabb71 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:24.877163795 +0000 UTC m=+63.520189813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-44q9j" (UID: "bbdd6d73-7b95-466f-aa35-4f398daabb71") : secret "cluster-monitoring-operator-tls" not found
Sep 16 18:17:20.978230 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:20.978199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:20.978384 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:20.978350    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 18:17:20.978421 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:20.978390    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65687db45b-r2p28: secret "image-registry-tls" not found
Sep 16 18:17:20.978468 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:20.978459    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls podName:89f29206-7d2e-4dc3-a7a5-42ef0c7c110b nodeName:}" failed. No retries permitted until 2026-09-16 18:17:24.978442578 +0000 UTC m=+63.621468609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls") pod "image-registry-65687db45b-r2p28" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b") : secret "image-registry-tls" not found
Sep 16 18:17:21.079604 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:21.079578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qtmx7\" (UID: \"6a870b30-9dca-4bc0-b707-7980d8290a7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:21.079734 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:21.079719    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 18:17:21.079783 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:21.079774    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls podName:6a870b30-9dca-4bc0-b707-7980d8290a7a nodeName:}" failed. No retries permitted until 2026-09-16 18:17:25.079759747 +0000 UTC m=+63.722785782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-qtmx7" (UID: "6a870b30-9dca-4bc0-b707-7980d8290a7a") : secret "samples-operator-tls" not found
Sep 16 18:17:22.128607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.128570    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jf5sk"]
Sep 16 18:17:22.132230 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.132215    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.134735 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.134709    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 18:17:22.134856 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.134749    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 18:17:22.135199 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.135185    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 18:17:22.135572 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.135555    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 18:17:22.135653 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.135606    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9v5nj\""
Sep 16 18:17:22.151610 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.151586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jf5sk"]
Sep 16 18:17:22.291025 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.291001    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.291145 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.291059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-crio-socket\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.291145 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.291124    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn4fd\" (UniqueName: \"kubernetes.io/projected/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-api-access-dn4fd\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.291211 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.291142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-data-volume\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.291243 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.291205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.391601 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.391544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.391601 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.391598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-crio-socket\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.391727 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.391629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn4fd\" (UniqueName: \"kubernetes.io/projected/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-api-access-dn4fd\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.391727 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.391646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-data-volume\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.391727 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.391667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.391727 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:22.391667    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 18:17:22.391862 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:22.391746    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm podName:11cc9377-86f2-4ff3-a9d6-aae718ecc1b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:22.891731382 +0000 UTC m=+61.534757400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jf5sk" (UID: "11cc9377-86f2-4ff3-a9d6-aae718ecc1b4") : configmap "kube-rbac-proxy" not found
Sep 16 18:17:22.391862 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:22.391764    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 18:17:22.391862 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:22.391818    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls podName:11cc9377-86f2-4ff3-a9d6-aae718ecc1b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:22.891800992 +0000 UTC m=+61.534827023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jf5sk" (UID: "11cc9377-86f2-4ff3-a9d6-aae718ecc1b4") : secret "insights-runtime-extractor-tls" not found
Sep 16 18:17:22.391862 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.391762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-crio-socket\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.392000 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.391923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-data-volume\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.400022 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.399998    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn4fd\" (UniqueName: \"kubernetes.io/projected/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-api-access-dn4fd\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.895182 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.895147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.895337 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:22.895197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:22.895337 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:22.895289    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 18:17:22.895440 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:22.895337    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 18:17:22.895440 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:22.895353    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls podName:11cc9377-86f2-4ff3-a9d6-aae718ecc1b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:23.89533961 +0000 UTC m=+62.538365642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jf5sk" (UID: "11cc9377-86f2-4ff3-a9d6-aae718ecc1b4") : secret "insights-runtime-extractor-tls" not found
Sep 16 18:17:22.895440 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:22.895401    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm podName:11cc9377-86f2-4ff3-a9d6-aae718ecc1b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:23.895385778 +0000 UTC m=+62.538411807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jf5sk" (UID: "11cc9377-86f2-4ff3-a9d6-aae718ecc1b4") : configmap "kube-rbac-proxy" not found
Sep 16 18:17:23.153551 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:23.153473    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z5wvm"
Sep 16 18:17:23.902839 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:23.902804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:23.903013 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:23.902853    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:23.903013 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:23.902913    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 18:17:23.903013 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:23.902940    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 18:17:23.903013 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:23.902954    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm podName:11cc9377-86f2-4ff3-a9d6-aae718ecc1b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:25.902941414 +0000 UTC m=+64.545967433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jf5sk" (UID: "11cc9377-86f2-4ff3-a9d6-aae718ecc1b4") : configmap "kube-rbac-proxy" not found
Sep 16 18:17:23.903013 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:23.902985    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls podName:11cc9377-86f2-4ff3-a9d6-aae718ecc1b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:25.902972949 +0000 UTC m=+64.545998967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jf5sk" (UID: "11cc9377-86f2-4ff3-a9d6-aae718ecc1b4") : secret "insights-runtime-extractor-tls" not found
Sep 16 18:17:24.256152 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:24.256080    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k69k7_87decdc9-1d76-402c-8fbb-d996fcaf8ce6/dns-node-resolver/0.log"
Sep 16 18:17:24.858947 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:24.858923    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2cflm_4faeab58-7f14-4555-9bc8-db6c5cb61fce/node-ca/0.log"
Sep 16 18:17:24.884316 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:24.884286    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-rf8ds"]
Sep 16 18:17:24.886352 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:24.886338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-rf8ds"
Sep 16 18:17:24.889026 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:24.889006    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 16 18:17:24.889166 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:24.889152    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 16 18:17:24.889962 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:24.889946    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-77cv6\""
Sep 16 18:17:24.889962 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:24.889947    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 16 18:17:24.890093 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:24.889973    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 16 18:17:24.899112 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:24.899088    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-rf8ds"]
Sep 16 18:17:24.910580 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:24.910558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:24.910668 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:24.910657    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 18:17:24.910714 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:24.910706    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls podName:bbdd6d73-7b95-466f-aa35-4f398daabb71 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:32.910693523 +0000 UTC m=+71.553719541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-44q9j" (UID: "bbdd6d73-7b95-466f-aa35-4f398daabb71") : secret "cluster-monitoring-operator-tls" not found
Sep 16 18:17:25.011343 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.011316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ntx8\" (UniqueName: \"kubernetes.io/projected/4b695cd3-37f2-4f7c-91f6-349559ecc888-kube-api-access-5ntx8\") pod \"service-ca-568869fdc5-rf8ds\" (UID: \"4b695cd3-37f2-4f7c-91f6-349559ecc888\") " pod="openshift-service-ca/service-ca-568869fdc5-rf8ds"
Sep 16 18:17:25.011470 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.011387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b695cd3-37f2-4f7c-91f6-349559ecc888-signing-key\") pod \"service-ca-568869fdc5-rf8ds\" (UID: \"4b695cd3-37f2-4f7c-91f6-349559ecc888\") " pod="openshift-service-ca/service-ca-568869fdc5-rf8ds"
Sep 16 18:17:25.011470 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.011423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b695cd3-37f2-4f7c-91f6-349559ecc888-signing-cabundle\") pod \"service-ca-568869fdc5-rf8ds\" (UID: \"4b695cd3-37f2-4f7c-91f6-349559ecc888\") " pod="openshift-service-ca/service-ca-568869fdc5-rf8ds"
Sep 16 18:17:25.011592 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.011496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:25.011646 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:25.011634    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 18:17:25.011682 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:25.011647    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65687db45b-r2p28: secret "image-registry-tls" not found
Sep 16 18:17:25.011717 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:25.011695    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls podName:89f29206-7d2e-4dc3-a7a5-42ef0c7c110b nodeName:}" failed. No retries permitted until 2026-09-16 18:17:33.011682865 +0000 UTC m=+71.654708888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls") pod "image-registry-65687db45b-r2p28" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b") : secret "image-registry-tls" not found
Sep 16 18:17:25.112340 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.112272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntx8\" (UniqueName: \"kubernetes.io/projected/4b695cd3-37f2-4f7c-91f6-349559ecc888-kube-api-access-5ntx8\") pod \"service-ca-568869fdc5-rf8ds\" (UID: \"4b695cd3-37f2-4f7c-91f6-349559ecc888\") " pod="openshift-service-ca/service-ca-568869fdc5-rf8ds"
Sep 16 18:17:25.112340 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.112307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qtmx7\" (UID: \"6a870b30-9dca-4bc0-b707-7980d8290a7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:25.112494 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.112342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b695cd3-37f2-4f7c-91f6-349559ecc888-signing-key\") pod \"service-ca-568869fdc5-rf8ds\" (UID: \"4b695cd3-37f2-4f7c-91f6-349559ecc888\") " pod="openshift-service-ca/service-ca-568869fdc5-rf8ds"
Sep 16 18:17:25.112494 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.112384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b695cd3-37f2-4f7c-91f6-349559ecc888-signing-cabundle\") pod \"service-ca-568869fdc5-rf8ds\" (UID: \"4b695cd3-37f2-4f7c-91f6-349559ecc888\") " pod="openshift-service-ca/service-ca-568869fdc5-rf8ds"
Sep 16 18:17:25.112494 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:25.112430    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 18:17:25.112494 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:25.112485    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls podName:6a870b30-9dca-4bc0-b707-7980d8290a7a nodeName:}" failed. No retries permitted until 2026-09-16 18:17:33.112471292 +0000 UTC m=+71.755497322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-qtmx7" (UID: "6a870b30-9dca-4bc0-b707-7980d8290a7a") : secret "samples-operator-tls" not found
Sep 16 18:17:25.112995 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.112978    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b695cd3-37f2-4f7c-91f6-349559ecc888-signing-cabundle\") pod \"service-ca-568869fdc5-rf8ds\" (UID: \"4b695cd3-37f2-4f7c-91f6-349559ecc888\") " pod="openshift-service-ca/service-ca-568869fdc5-rf8ds"
Sep 16 18:17:25.114625 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.114608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b695cd3-37f2-4f7c-91f6-349559ecc888-signing-key\") pod \"service-ca-568869fdc5-rf8ds\" (UID: \"4b695cd3-37f2-4f7c-91f6-349559ecc888\") " pod="openshift-service-ca/service-ca-568869fdc5-rf8ds"
Sep 16 18:17:25.120254 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.120237    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ntx8\" (UniqueName: \"kubernetes.io/projected/4b695cd3-37f2-4f7c-91f6-349559ecc888-kube-api-access-5ntx8\") pod \"service-ca-568869fdc5-rf8ds\" (UID: \"4b695cd3-37f2-4f7c-91f6-349559ecc888\") " pod="openshift-service-ca/service-ca-568869fdc5-rf8ds"
Sep 16 18:17:25.196903 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.196878    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-rf8ds"
Sep 16 18:17:25.468712 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.468629    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-rf8ds"]
Sep 16 18:17:25.471491 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:17:25.471465    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b695cd3_37f2_4f7c_91f6_349559ecc888.slice/crio-1795fb6803acaf5be66fdd2b7e8a122142713a054b8b7930285e367ce886eaef WatchSource:0}: Error finding container 1795fb6803acaf5be66fdd2b7e8a122142713a054b8b7930285e367ce886eaef: Status 404 returned error can't find the container with id 1795fb6803acaf5be66fdd2b7e8a122142713a054b8b7930285e367ce886eaef
Sep 16 18:17:25.860493 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.860442    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rgv5m_dece4fee-3ac5-4f85-afb3-037f880df056/serve-healthcheck-canary/0.log"
Sep 16 18:17:25.918897 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.918863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:25.919078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:25.918923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:25.919078 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:25.919030    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 18:17:25.919078 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:25.919042    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 18:17:25.919244 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:25.919109    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls podName:11cc9377-86f2-4ff3-a9d6-aae718ecc1b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:29.919089811 +0000 UTC m=+68.562115858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jf5sk" (UID: "11cc9377-86f2-4ff3-a9d6-aae718ecc1b4") : secret "insights-runtime-extractor-tls" not found
Sep 16 18:17:25.919244 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:25.919131    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm podName:11cc9377-86f2-4ff3-a9d6-aae718ecc1b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:29.919122062 +0000 UTC m=+68.562148086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jf5sk" (UID: "11cc9377-86f2-4ff3-a9d6-aae718ecc1b4") : configmap "kube-rbac-proxy" not found
Sep 16 18:17:26.231209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.231126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-rf8ds" event={"ID":"4b695cd3-37f2-4f7c-91f6-349559ecc888","Type":"ContainerStarted","Data":"1795fb6803acaf5be66fdd2b7e8a122142713a054b8b7930285e367ce886eaef"}
Sep 16 18:17:26.623979 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.623948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:17:26.624326 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.623988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:17:26.626865 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.626846    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 18:17:26.626950 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.626933    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 18:17:26.634410 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:26.634395    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 18:17:26.634457 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:26.634446    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs podName:4e6a401a-b5b2-4ae6-a2d0-965b2658777b nodeName:}" failed. No retries permitted until 2026-09-16 18:18:30.634431414 +0000 UTC m=+129.277457432 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs") pod "network-metrics-daemon-qdft4" (UID: "4e6a401a-b5b2-4ae6-a2d0-965b2658777b") : secret "metrics-daemon-secret" not found
Sep 16 18:17:26.636519 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.636495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/390d10d8-4834-4fd7-b1ce-1abd2943c8b4-original-pull-secret\") pod \"global-pull-secret-syncer-vm6px\" (UID: \"390d10d8-4834-4fd7-b1ce-1abd2943c8b4\") " pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:17:26.672849 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.672829    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6px"
Sep 16 18:17:26.724923 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.724889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgdjf\" (UniqueName: \"kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf\") pod \"network-check-target-kd9hb\" (UID: \"34926487-20cd-4648-95bc-a2fa6ea71769\") " pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:17:26.728810 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.727625    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 18:17:26.738543 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.738521    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 18:17:26.748829 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.748807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgdjf\" (UniqueName: \"kubernetes.io/projected/34926487-20cd-4648-95bc-a2fa6ea71769-kube-api-access-lgdjf\") pod \"network-check-target-kd9hb\" (UID: \"34926487-20cd-4648-95bc-a2fa6ea71769\") " pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:17:26.947937 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.947862    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vm6px"]
Sep 16 18:17:26.951112 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:17:26.951084    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod390d10d8_4834_4fd7_b1ce_1abd2943c8b4.slice/crio-c36bf7fc2c71c858d35947ae947e5f44ad076a19db9ff9806b3c39ea5ebce602 WatchSource:0}: Error finding container c36bf7fc2c71c858d35947ae947e5f44ad076a19db9ff9806b3c39ea5ebce602: Status 404 returned error can't find the container with id c36bf7fc2c71c858d35947ae947e5f44ad076a19db9ff9806b3c39ea5ebce602
Sep 16 18:17:26.987231 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.987210    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bfgtt\""
Sep 16 18:17:26.995430 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:26.995413    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:17:27.235203 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:27.235116    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vm6px" event={"ID":"390d10d8-4834-4fd7-b1ce-1abd2943c8b4","Type":"ContainerStarted","Data":"c36bf7fc2c71c858d35947ae947e5f44ad076a19db9ff9806b3c39ea5ebce602"}
Sep 16 18:17:27.289842 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:27.289813    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kd9hb"]
Sep 16 18:17:27.566056 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:17:27.565977    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34926487_20cd_4648_95bc_a2fa6ea71769.slice/crio-077b086ef589d107f670f888bf180b677486543743f02585c0ebe49bc6bdf2ec WatchSource:0}: Error finding container 077b086ef589d107f670f888bf180b677486543743f02585c0ebe49bc6bdf2ec: Status 404 returned error can't find the container with id 077b086ef589d107f670f888bf180b677486543743f02585c0ebe49bc6bdf2ec
Sep 16 18:17:28.239820 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:28.239778    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-rf8ds" event={"ID":"4b695cd3-37f2-4f7c-91f6-349559ecc888","Type":"ContainerStarted","Data":"7fb66cdd54cea0a5b8fd4c9c2ef726ec74fc443e62ab05bca164612f3ccc804c"}
Sep 16 18:17:28.242131 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:28.242073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kd9hb" event={"ID":"34926487-20cd-4648-95bc-a2fa6ea71769","Type":"ContainerStarted","Data":"077b086ef589d107f670f888bf180b677486543743f02585c0ebe49bc6bdf2ec"}
Sep 16 18:17:28.282306 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:28.282253    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-rf8ds" podStartSLOduration=1.949905095 podStartE2EDuration="4.282235147s" totalImagesPullingTime="2.332330052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:28.2812407 +0000 UTC m=+66.924266737" watchObservedRunningTime="2026-09-16 18:17:28.282235147 +0000 UTC m=+66.925261188"
Sep 16 18:17:29.953387 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:29.952380    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:29.953387 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:29.952497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:29.953387 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:29.952647    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 18:17:29.953387 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:29.952709    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls podName:11cc9377-86f2-4ff3-a9d6-aae718ecc1b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:37.952690719 +0000 UTC m=+76.595716751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jf5sk" (UID: "11cc9377-86f2-4ff3-a9d6-aae718ecc1b4") : secret "insights-runtime-extractor-tls" not found
Sep 16 18:17:29.953387 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:29.953329    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 18:17:29.954023 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:29.953621    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm podName:11cc9377-86f2-4ff3-a9d6-aae718ecc1b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:37.953590508 +0000 UTC m=+76.596616540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jf5sk" (UID: "11cc9377-86f2-4ff3-a9d6-aae718ecc1b4") : configmap "kube-rbac-proxy" not found
Sep 16 18:17:31.062197 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:31.062155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:17:31.062580 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:31.062338    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 18:17:31.062580 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:31.062432    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls podName:596d0e8d-6220-4472-be11-369dd730bb6f nodeName:}" failed. No retries permitted until 2026-09-16 18:18:03.062410636 +0000 UTC m=+101.705436680 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls") pod "dns-default-xbx5k" (UID: "596d0e8d-6220-4472-be11-369dd730bb6f") : secret "dns-default-metrics-tls" not found
Sep 16 18:17:32.981850 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:32.981815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:32.982251 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:32.981974    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 18:17:32.982251 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:32.982041    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls podName:bbdd6d73-7b95-466f-aa35-4f398daabb71 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:48.982026078 +0000 UTC m=+87.625052108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-44q9j" (UID: "bbdd6d73-7b95-466f-aa35-4f398daabb71") : secret "cluster-monitoring-operator-tls" not found
Sep 16 18:17:33.082667 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:33.082629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls\") pod \"image-registry-65687db45b-r2p28\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") " pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:33.082796 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:33.082766    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 18:17:33.082796 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:33.082783    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65687db45b-r2p28: secret "image-registry-tls" not found
Sep 16 18:17:33.082874 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:33.082835    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls podName:89f29206-7d2e-4dc3-a7a5-42ef0c7c110b nodeName:}" failed. No retries permitted until 2026-09-16 18:17:49.082821666 +0000 UTC m=+87.725847685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls") pod "image-registry-65687db45b-r2p28" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b") : secret "image-registry-tls" not found
Sep 16 18:17:33.183797 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:33.183766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qtmx7\" (UID: \"6a870b30-9dca-4bc0-b707-7980d8290a7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:33.186130 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:33.186107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a870b30-9dca-4bc0-b707-7980d8290a7a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-qtmx7\" (UID: \"6a870b30-9dca-4bc0-b707-7980d8290a7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:33.228517 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:33.228494    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dr99j\""
Sep 16 18:17:33.236681 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:33.236640    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"
Sep 16 18:17:33.262968 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:33.262937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kd9hb" event={"ID":"34926487-20cd-4648-95bc-a2fa6ea71769","Type":"ContainerStarted","Data":"288986b71d88348ef4c3cd45bc5e2d1cdd697f532451a1e59f7c53a2e58b61d7"}
Sep 16 18:17:33.263115 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:33.262999    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:17:33.264751 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:33.264727    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vm6px" event={"ID":"390d10d8-4834-4fd7-b1ce-1abd2943c8b4","Type":"ContainerStarted","Data":"bf929831259618f5c7929a85ccb9a3f29d2d679c3d6e4ce302a7540f75ec2648"}
Sep 16 18:17:33.280511 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:33.280469    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kd9hb" podStartSLOduration=66.364722207 podStartE2EDuration="1m11.280454133s" totalImagesPullingTime="4.915731926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:33.27970029 +0000 UTC m=+71.922726330" watchObservedRunningTime="2026-09-16 18:17:33.280454133 +0000 UTC m=+71.923480208"
Sep 16 18:17:33.296471 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:33.296428    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vm6px" podStartSLOduration=65.762265404 podStartE2EDuration="1m11.296411245s" totalImagesPullingTime="5.534145841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:33.295268873 +0000 UTC m=+71.938294923" watchObservedRunningTime="2026-09-16 18:17:33.296411245 +0000 UTC m=+71.939437285"
Sep 16 18:17:33.507231 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:33.507157    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7"]
Sep 16 18:17:34.268861 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:34.268819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7" event={"ID":"6a870b30-9dca-4bc0-b707-7980d8290a7a","Type":"ContainerStarted","Data":"0d0fd727cdb23c6e445d208eae7eec3fd63442bd912ed3a4f31fb2371d426dae"}
Sep 16 18:17:35.273344 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:35.273316    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7" event={"ID":"6a870b30-9dca-4bc0-b707-7980d8290a7a","Type":"ContainerStarted","Data":"af9ff313b2e2c35db9f08e54bcdcf6eb8f16bfa3cbd8104a0710bfa675b16d2d"}
Sep 16 18:17:36.279341 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:36.279305    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7" event={"ID":"6a870b30-9dca-4bc0-b707-7980d8290a7a","Type":"ContainerStarted","Data":"7590dd024baa8f4f9226078ae4230a987fe074f7a4719f3de41d0294bcace5f9"}
Sep 16 18:17:36.299263 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:36.299214    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-qtmx7" podStartSLOduration=17.669159035 podStartE2EDuration="19.299199789s" totalImagesPullingTime="1.630040754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:17:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:36.299097806 +0000 UTC m=+74.942123845" watchObservedRunningTime="2026-09-16 18:17:36.299199789 +0000 UTC m=+74.942225830"
Sep 16 18:17:38.024317 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:38.024275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:38.024806 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:38.024383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:38.024806 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:38.024495    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 18:17:38.024806 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:38.024552    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls podName:11cc9377-86f2-4ff3-a9d6-aae718ecc1b4 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:54.024534704 +0000 UTC m=+92.667560722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jf5sk" (UID: "11cc9377-86f2-4ff3-a9d6-aae718ecc1b4") : secret "insights-runtime-extractor-tls" not found
Sep 16 18:17:38.024806 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:38.024778    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:44.719410 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.718958    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn"]
Sep 16 18:17:44.723660 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.723632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn"
Sep 16 18:17:44.727327 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.727306    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kmhqf\""
Sep 16 18:17:44.727477 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.727339    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"]
Sep 16 18:17:44.727540 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.727340    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 16 18:17:44.727648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.727626    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 16 18:17:44.729331 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.729314    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.731432 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.731414    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 16 18:17:44.731653 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.731640    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 16 18:17:44.732000 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.731982    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 16 18:17:44.732115 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.732095    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 16 18:17:44.732292 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.732280    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 16 18:17:44.733171 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.733155    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 16 18:17:44.733870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.733832    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 16 18:17:44.734569 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.734552    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn"]
Sep 16 18:17:44.754935 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.754917    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"]
Sep 16 18:17:44.780217 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.780194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/546b63d9-01af-4c4c-89ec-3f0bff97b5f0-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-x8cgn\" (UID: \"546b63d9-01af-4c4c-89ec-3f0bff97b5f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn"
Sep 16 18:17:44.780325 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.780222    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-ca\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.780325 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.780238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.780325 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.780256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.780522 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.780421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.780522 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.780506    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/546b63d9-01af-4c4c-89ec-3f0bff97b5f0-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-x8cgn\" (UID: \"546b63d9-01af-4c4c-89ec-3f0bff97b5f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn"
Sep 16 18:17:44.780619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.780533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvjfm\" (UniqueName: \"kubernetes.io/projected/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-kube-api-access-nvjfm\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.780619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.780598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-hub\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.804979 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.804955    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65687db45b-r2p28"]
Sep 16 18:17:44.805134 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:17:44.805118    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-65687db45b-r2p28" podUID="89f29206-7d2e-4dc3-a7a5-42ef0c7c110b"
Sep 16 18:17:44.881095 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.881067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-hub\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.881262 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.881107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/546b63d9-01af-4c4c-89ec-3f0bff97b5f0-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-x8cgn\" (UID: \"546b63d9-01af-4c4c-89ec-3f0bff97b5f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn"
Sep 16 18:17:44.881262 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.881123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-ca\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.881262 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.881144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.881262 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.881169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.881482 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.881461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.881562 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.881542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/546b63d9-01af-4c4c-89ec-3f0bff97b5f0-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-x8cgn\" (UID: \"546b63d9-01af-4c4c-89ec-3f0bff97b5f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn"
Sep 16 18:17:44.881629 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.881574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvjfm\" (UniqueName: \"kubernetes.io/projected/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-kube-api-access-nvjfm\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.882023 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.881994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.882505 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.882479    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/546b63d9-01af-4c4c-89ec-3f0bff97b5f0-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-x8cgn\" (UID: \"546b63d9-01af-4c4c-89ec-3f0bff97b5f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn"
Sep 16 18:17:44.883817 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.883796    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-ca\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.883900 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.883801    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/546b63d9-01af-4c4c-89ec-3f0bff97b5f0-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-x8cgn\" (UID: \"546b63d9-01af-4c4c-89ec-3f0bff97b5f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn"
Sep 16 18:17:44.884077 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.884056    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.884111 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.884089    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.884111 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.884102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-hub\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:44.892430 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:44.892409    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvjfm\" (UniqueName: \"kubernetes.io/projected/322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2-kube-api-access-nvjfm\") pod \"cluster-proxy-proxy-agent-69fddd54d-58c9d\" (UID: \"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:45.031681 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.031623    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn"
Sep 16 18:17:45.053649 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.053623    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"
Sep 16 18:17:45.300066 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.299991    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn"]
Sep 16 18:17:45.302745 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:17:45.302714    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546b63d9_01af_4c4c_89ec_3f0bff97b5f0.slice/crio-892da0a657f6e9cc6ed9019f8ddb28bd76e78923174b22e0356c00d878718030 WatchSource:0}: Error finding container 892da0a657f6e9cc6ed9019f8ddb28bd76e78923174b22e0356c00d878718030: Status 404 returned error can't find the container with id 892da0a657f6e9cc6ed9019f8ddb28bd76e78923174b22e0356c00d878718030
Sep 16 18:17:45.307491 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.307475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:45.307554 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.307515    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn" event={"ID":"546b63d9-01af-4c4c-89ec-3f0bff97b5f0","Type":"ContainerStarted","Data":"892da0a657f6e9cc6ed9019f8ddb28bd76e78923174b22e0356c00d878718030"}
Sep 16 18:17:45.313609 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.313593    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:45.345831 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.345810    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d"]
Sep 16 18:17:45.348547 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:17:45.348529    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod322ffd1b_5dc6_43f5_a65c_fa15cd4a40d2.slice/crio-5bb282a221e6590898a9e26e1f4d278f4ad6c3586c409ed64b011d78ac1f7f2d WatchSource:0}: Error finding container 5bb282a221e6590898a9e26e1f4d278f4ad6c3586c409ed64b011d78ac1f7f2d: Status 404 returned error can't find the container with id 5bb282a221e6590898a9e26e1f4d278f4ad6c3586c409ed64b011d78ac1f7f2d
Sep 16 18:17:45.387436 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.387401    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-installation-pull-secrets\") pod \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") "
Sep 16 18:17:45.387564 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.387455    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-bound-sa-token\") pod \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") "
Sep 16 18:17:45.387564 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.387485    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9887t\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-kube-api-access-9887t\") pod \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") "
Sep 16 18:17:45.387564 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.387508    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-image-registry-private-configuration\") pod \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") "
Sep 16 18:17:45.387564 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.387535    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-certificates\") pod \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") "
Sep 16 18:17:45.387876 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.387567    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-ca-trust-extracted\") pod \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") "
Sep 16 18:17:45.387876 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.387627    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-trusted-ca\") pod \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\" (UID: \"89f29206-7d2e-4dc3-a7a5-42ef0c7c110b\") "
Sep 16 18:17:45.387994 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.387901    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:17:45.387994 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.387951    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:17:45.388209 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.388183    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:17:45.389817 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.389786    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:17:45.389911 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.389865    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-kube-api-access-9887t" (OuterVolumeSpecName: "kube-api-access-9887t") pod "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b"). InnerVolumeSpecName "kube-api-access-9887t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:17:45.389911 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.389889    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:17:45.389974 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.389911    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b" (UID: "89f29206-7d2e-4dc3-a7a5-42ef0c7c110b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:17:45.488887 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.488857    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-trusted-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:17:45.488887 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.488882    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-installation-pull-secrets\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:17:45.488887 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.488891    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-bound-sa-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:17:45.489081 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.488900    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9887t\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-kube-api-access-9887t\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:17:45.489081 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.488910    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-image-registry-private-configuration\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:17:45.489081 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.488919    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-certificates\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:17:45.489081 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:45.488926    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-ca-trust-extracted\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:17:46.313772 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:46.313138    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65687db45b-r2p28"
Sep 16 18:17:46.313772 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:46.313142    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d" event={"ID":"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2","Type":"ContainerStarted","Data":"5bb282a221e6590898a9e26e1f4d278f4ad6c3586c409ed64b011d78ac1f7f2d"}
Sep 16 18:17:46.345286 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:46.345235    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65687db45b-r2p28"]
Sep 16 18:17:46.351069 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:46.351027    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65687db45b-r2p28"]
Sep 16 18:17:46.496074 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:46.496040    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b-registry-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:17:47.864901 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:47.864864    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89f29206-7d2e-4dc3-a7a5-42ef0c7c110b" path="/var/lib/kubelet/pods/89f29206-7d2e-4dc3-a7a5-42ef0c7c110b/volumes"
Sep 16 18:17:49.018267 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:49.018228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:49.020532 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:49.020502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bbdd6d73-7b95-466f-aa35-4f398daabb71-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-44q9j\" (UID: \"bbdd6d73-7b95-466f-aa35-4f398daabb71\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:49.233641 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:49.233614    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zvz67\""
Sep 16 18:17:49.241830 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:49.241811    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"
Sep 16 18:17:49.325919 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:49.325883    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d" event={"ID":"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2","Type":"ContainerStarted","Data":"3505bdc689963168bfeefc92e1984594aba92675b02545ced73b5217ebf2cec5"}
Sep 16 18:17:49.326078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:49.325923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d" event={"ID":"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2","Type":"ContainerStarted","Data":"ac18b55585e7e6be573b85359a9f5fdc53790216f83610329cce29eded0bf50a"}
Sep 16 18:17:49.326078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:49.325942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d" event={"ID":"322ffd1b-5dc6-43f5-a65c-fa15cd4a40d2","Type":"ContainerStarted","Data":"3227c809b58dc4441fb0311e881ff959b2c77fcb79321ddbf54525de6b60c6b5"}
Sep 16 18:17:49.327381 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:49.327347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn" event={"ID":"546b63d9-01af-4c4c-89ec-3f0bff97b5f0","Type":"ContainerStarted","Data":"3413485b332cdb325a52e2b48451783c0bcf89b5ff8290b596e8c8a4412e7dde"}
Sep 16 18:17:49.348703 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:49.348644    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fddd54d-58c9d" podStartSLOduration=2.11249546 podStartE2EDuration="5.348629616s" totalImagesPullingTime="3.236134156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:49.346793465 +0000 UTC m=+87.989819504" watchObservedRunningTime="2026-09-16 18:17:49.348629616 +0000 UTC m=+87.991655656"
Sep 16 18:17:49.363215 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:49.363177    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-x8cgn" podStartSLOduration=2.123722755 podStartE2EDuration="5.363164415s" totalImagesPullingTime="3.23944166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:49.362177564 +0000 UTC m=+88.005203606" watchObservedRunningTime="2026-09-16 18:17:49.363164415 +0000 UTC m=+88.006190455"
Sep 16 18:17:49.511474 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:49.511443    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j"]
Sep 16 18:17:49.514357 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:17:49.514333    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbdd6d73_7b95_466f_aa35_4f398daabb71.slice/crio-ac9f1eb34968a9cf9d951ba8077e5ce65dad8e4c8fb722bc9233f6dea4d250d6 WatchSource:0}: Error finding container ac9f1eb34968a9cf9d951ba8077e5ce65dad8e4c8fb722bc9233f6dea4d250d6: Status 404 returned error can't find the container with id ac9f1eb34968a9cf9d951ba8077e5ce65dad8e4c8fb722bc9233f6dea4d250d6
Sep 16 18:17:50.332501 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:50.332463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j" event={"ID":"bbdd6d73-7b95-466f-aa35-4f398daabb71","Type":"ContainerStarted","Data":"ac9f1eb34968a9cf9d951ba8077e5ce65dad8e4c8fb722bc9233f6dea4d250d6"}
Sep 16 18:17:52.341244 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:52.341209    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j" event={"ID":"bbdd6d73-7b95-466f-aa35-4f398daabb71","Type":"ContainerStarted","Data":"7aa29f0a6e48f331ab4790b0748c5612dda565be4488cd2554f0624837e7e5c7"}
Sep 16 18:17:52.362404 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:52.362340    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-44q9j" podStartSLOduration=33.567610198 podStartE2EDuration="35.362324984s" totalImagesPullingTime="1.794714786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:17:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:52.360954757 +0000 UTC m=+91.003980816" watchObservedRunningTime="2026-09-16 18:17:52.362324984 +0000 UTC m=+91.005351024"
Sep 16 18:17:54.057672 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:54.057633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:54.059863 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:54.059841    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11cc9377-86f2-4ff3-a9d6-aae718ecc1b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf5sk\" (UID: \"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4\") " pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:54.240699 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:54.240662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jf5sk"
Sep 16 18:17:54.510607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:54.510575    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jf5sk"]
Sep 16 18:17:54.513574 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:17:54.513552    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cc9377_86f2_4ff3_a9d6_aae718ecc1b4.slice/crio-7de44a05a82a64b1a1f3a74ffa785ac7efc422806acb5d664293f2d86860f3d9 WatchSource:0}: Error finding container 7de44a05a82a64b1a1f3a74ffa785ac7efc422806acb5d664293f2d86860f3d9: Status 404 returned error can't find the container with id 7de44a05a82a64b1a1f3a74ffa785ac7efc422806acb5d664293f2d86860f3d9
Sep 16 18:17:55.353560 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:55.353522    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jf5sk" event={"ID":"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4","Type":"ContainerStarted","Data":"ac319f8d516a95524bf3bf72e2eeeefd6053774153ba6c21d600de88770f8c1c"}
Sep 16 18:17:55.353914 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:55.353581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jf5sk" event={"ID":"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4","Type":"ContainerStarted","Data":"10a7e47e90bb2c2c0126328b8e3fb5db2beb4421f0cb5677751ae6fa0dcdb628"}
Sep 16 18:17:55.353914 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:55.353599    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jf5sk" event={"ID":"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4","Type":"ContainerStarted","Data":"7de44a05a82a64b1a1f3a74ffa785ac7efc422806acb5d664293f2d86860f3d9"}
Sep 16 18:17:57.361442 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:57.361403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jf5sk" event={"ID":"11cc9377-86f2-4ff3-a9d6-aae718ecc1b4","Type":"ContainerStarted","Data":"22ce51ae8f0a495bdb9a5344e33bd086c8677b8ec828b13f19c2c122696d77d5"}
Sep 16 18:17:57.382599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:17:57.382544    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jf5sk" podStartSLOduration=33.314266519 podStartE2EDuration="35.38252993s" totalImagesPullingTime="2.068263411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:17:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:57.381459164 +0000 UTC m=+96.024485204" watchObservedRunningTime="2026-09-16 18:17:57.38252993 +0000 UTC m=+96.025555968"
Sep 16 18:18:02.310459 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.310422    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2wcgm"]
Sep 16 18:18:02.337982 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.337954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.341246 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.341220    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 18:18:02.341419 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.341241    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-975dg\""
Sep 16 18:18:02.341682 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.341662    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 18:18:02.341801 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.341666    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 18:18:02.341995 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.341980    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 18:18:02.417917 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.417880    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53144d48-3087-4763-9131-b11019278016-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.418113 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.417934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53144d48-3087-4763-9131-b11019278016-metrics-client-ca\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.418113 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.417961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53144d48-3087-4763-9131-b11019278016-root\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.418113 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.417990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53144d48-3087-4763-9131-b11019278016-node-exporter-tls\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.418113 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.418073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53144d48-3087-4763-9131-b11019278016-node-exporter-wtmp\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.418319 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.418150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrr9\" (UniqueName: \"kubernetes.io/projected/53144d48-3087-4763-9131-b11019278016-kube-api-access-psrr9\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.418319 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.418200    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53144d48-3087-4763-9131-b11019278016-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.418319 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.418225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53144d48-3087-4763-9131-b11019278016-sys\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.418319 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.418242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53144d48-3087-4763-9131-b11019278016-node-exporter-textfile\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.518820 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.518785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53144d48-3087-4763-9131-b11019278016-metrics-client-ca\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519004 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.518827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53144d48-3087-4763-9131-b11019278016-root\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519004 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.518855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53144d48-3087-4763-9131-b11019278016-node-exporter-tls\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519004 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.518912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53144d48-3087-4763-9131-b11019278016-node-exporter-wtmp\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519004 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.518940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psrr9\" (UniqueName: \"kubernetes.io/projected/53144d48-3087-4763-9131-b11019278016-kube-api-access-psrr9\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519004 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.518977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53144d48-3087-4763-9131-b11019278016-root\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.518986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53144d48-3087-4763-9131-b11019278016-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.519063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53144d48-3087-4763-9131-b11019278016-sys\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.519106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53144d48-3087-4763-9131-b11019278016-node-exporter-textfile\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.519159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53144d48-3087-4763-9131-b11019278016-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519511 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.519449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53144d48-3087-4763-9131-b11019278016-sys\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519511 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.519475    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53144d48-3087-4763-9131-b11019278016-node-exporter-wtmp\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519650 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:18:02.519622    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 16 18:18:02.519704 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.519691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53144d48-3087-4763-9131-b11019278016-node-exporter-textfile\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.519757 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:18:02.519706    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53144d48-3087-4763-9131-b11019278016-node-exporter-tls podName:53144d48-3087-4763-9131-b11019278016 nodeName:}" failed. No retries permitted until 2026-09-16 18:18:03.019669713 +0000 UTC m=+101.662695746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/53144d48-3087-4763-9131-b11019278016-node-exporter-tls") pod "node-exporter-2wcgm" (UID: "53144d48-3087-4763-9131-b11019278016") : secret "node-exporter-tls" not found
Sep 16 18:18:02.519757 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.519747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53144d48-3087-4763-9131-b11019278016-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.520201 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.520161    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53144d48-3087-4763-9131-b11019278016-metrics-client-ca\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.522033 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.522011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53144d48-3087-4763-9131-b11019278016-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:02.528579 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:02.528554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrr9\" (UniqueName: \"kubernetes.io/projected/53144d48-3087-4763-9131-b11019278016-kube-api-access-psrr9\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:03.023459 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:03.023355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53144d48-3087-4763-9131-b11019278016-node-exporter-tls\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:03.025692 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:03.025667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53144d48-3087-4763-9131-b11019278016-node-exporter-tls\") pod \"node-exporter-2wcgm\" (UID: \"53144d48-3087-4763-9131-b11019278016\") " pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:03.124708 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:03.124673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:18:03.126965 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:03.126945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/596d0e8d-6220-4472-be11-369dd730bb6f-metrics-tls\") pod \"dns-default-xbx5k\" (UID: \"596d0e8d-6220-4472-be11-369dd730bb6f\") " pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:18:03.129756 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:03.129739    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f8sdc\""
Sep 16 18:18:03.137747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:03.137720    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:18:03.248227 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:03.248192    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2wcgm"
Sep 16 18:18:03.277222 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:18:03.277192    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53144d48_3087_4763_9131_b11019278016.slice/crio-bc532fc525a6df62f5ba43bd6b50d1b9c5b2199ef25fae83a94d6014082798c2 WatchSource:0}: Error finding container bc532fc525a6df62f5ba43bd6b50d1b9c5b2199ef25fae83a94d6014082798c2: Status 404 returned error can't find the container with id bc532fc525a6df62f5ba43bd6b50d1b9c5b2199ef25fae83a94d6014082798c2
Sep 16 18:18:03.382445 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:03.382409    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wcgm" event={"ID":"53144d48-3087-4763-9131-b11019278016","Type":"ContainerStarted","Data":"bc532fc525a6df62f5ba43bd6b50d1b9c5b2199ef25fae83a94d6014082798c2"}
Sep 16 18:18:03.438056 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:03.438024    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xbx5k"]
Sep 16 18:18:03.441943 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:18:03.441921    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod596d0e8d_6220_4472_be11_369dd730bb6f.slice/crio-a8f19575b6c97a53d79bc0f6ad7634d5a9f23cbea89037922916930a0647eb57 WatchSource:0}: Error finding container a8f19575b6c97a53d79bc0f6ad7634d5a9f23cbea89037922916930a0647eb57: Status 404 returned error can't find the container with id a8f19575b6c97a53d79bc0f6ad7634d5a9f23cbea89037922916930a0647eb57
Sep 16 18:18:04.271977 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:04.271944    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kd9hb"
Sep 16 18:18:04.386560 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:04.386530    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xbx5k" event={"ID":"596d0e8d-6220-4472-be11-369dd730bb6f","Type":"ContainerStarted","Data":"a8f19575b6c97a53d79bc0f6ad7634d5a9f23cbea89037922916930a0647eb57"}
Sep 16 18:18:05.391926 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:05.391891    2580 generic.go:356] "Generic (PLEG): container finished" podID="53144d48-3087-4763-9131-b11019278016" containerID="38a3a458e6fa5eb1820003aeb7f3c8ae49c9f60192960eda3ebf6aea25b5c028" exitCode=0
Sep 16 18:18:05.392415 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:05.391999    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wcgm" event={"ID":"53144d48-3087-4763-9131-b11019278016","Type":"ContainerDied","Data":"38a3a458e6fa5eb1820003aeb7f3c8ae49c9f60192960eda3ebf6aea25b5c028"}
Sep 16 18:18:06.397669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.397625    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wcgm" event={"ID":"53144d48-3087-4763-9131-b11019278016","Type":"ContainerStarted","Data":"e56dc7d8ac09bac910813fa7ec5e3bee107b52025d069717ebe445d048de4f8f"}
Sep 16 18:18:06.398110 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.397692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wcgm" event={"ID":"53144d48-3087-4763-9131-b11019278016","Type":"ContainerStarted","Data":"57bd1b7e3c83af8f304059e59552c6bd194aa2551de86d3fdd415f82d992b54f"}
Sep 16 18:18:06.399352 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.399326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xbx5k" event={"ID":"596d0e8d-6220-4472-be11-369dd730bb6f","Type":"ContainerStarted","Data":"a11969eadaf1deef18958295327177502749da601c26fa373fd82423fc7788ae"}
Sep 16 18:18:06.399464 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.399382    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xbx5k" event={"ID":"596d0e8d-6220-4472-be11-369dd730bb6f","Type":"ContainerStarted","Data":"b9f43707eeb79593f08059e0bdc7ecb77de978a6c50080789ce512731f0aa5c3"}
Sep 16 18:18:06.399464 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.399412    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:18:06.443317 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.443272    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2wcgm" podStartSLOduration=3.1333799940000002 podStartE2EDuration="4.443257541s" totalImagesPullingTime="1.23966752s" totalInitContainerRuntime="70.210027ms" isStatefulPod=true podCreationTimestamp="2026-09-16 18:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:18:06.419796294 +0000 UTC m=+105.062822334" watchObservedRunningTime="2026-09-16 18:18:06.443257541 +0000 UTC m=+105.086283580"
Sep 16 18:18:06.444189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.444156    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xbx5k" podStartSLOduration=65.245257438 podStartE2EDuration="1m7.444146418s" totalImagesPullingTime="2.19888898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:18:06.442923047 +0000 UTC m=+105.085949087" watchObservedRunningTime="2026-09-16 18:18:06.444146418 +0000 UTC m=+105.087172448"
Sep 16 18:18:06.606497 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.606460    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"]
Sep 16 18:18:06.608573 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.608552    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.611739 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.611719    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 16 18:18:06.611945 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.611930    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 16 18:18:06.612307 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.612289    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 16 18:18:06.612414 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.612323    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5sq2x\""
Sep 16 18:18:06.612705 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.612682    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 16 18:18:06.612778 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.612689    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-39qe43lce2i7h\""
Sep 16 18:18:06.621030 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.621004    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"]
Sep 16 18:18:06.758418 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.758316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a54b8156-5685-43bc-bc33-968f815208f0-secret-metrics-server-client-certs\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.758418 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.758388    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86wz6\" (UniqueName: \"kubernetes.io/projected/a54b8156-5685-43bc-bc33-968f815208f0-kube-api-access-86wz6\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.758607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.758453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a54b8156-5685-43bc-bc33-968f815208f0-client-ca-bundle\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.758607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.758501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a54b8156-5685-43bc-bc33-968f815208f0-metrics-server-audit-profiles\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.758607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.758530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a54b8156-5685-43bc-bc33-968f815208f0-audit-log\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.758607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.758576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54b8156-5685-43bc-bc33-968f815208f0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.758607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.758594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a54b8156-5685-43bc-bc33-968f815208f0-secret-metrics-server-tls\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.859453 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.859422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a54b8156-5685-43bc-bc33-968f815208f0-secret-metrics-server-client-certs\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.859625 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.859473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86wz6\" (UniqueName: \"kubernetes.io/projected/a54b8156-5685-43bc-bc33-968f815208f0-kube-api-access-86wz6\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.859625 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.859497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a54b8156-5685-43bc-bc33-968f815208f0-client-ca-bundle\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.859625 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.859528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a54b8156-5685-43bc-bc33-968f815208f0-metrics-server-audit-profiles\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.859625 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.859548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a54b8156-5685-43bc-bc33-968f815208f0-audit-log\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.859625 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.859573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54b8156-5685-43bc-bc33-968f815208f0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.859625 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.859597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a54b8156-5685-43bc-bc33-968f815208f0-secret-metrics-server-tls\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.859992 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.859965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a54b8156-5685-43bc-bc33-968f815208f0-audit-log\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.860357 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.860328    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54b8156-5685-43bc-bc33-968f815208f0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.860581 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.860563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a54b8156-5685-43bc-bc33-968f815208f0-metrics-server-audit-profiles\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.861869 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.861841    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a54b8156-5685-43bc-bc33-968f815208f0-secret-metrics-server-tls\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.861958 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.861907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a54b8156-5685-43bc-bc33-968f815208f0-secret-metrics-server-client-certs\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.861958 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.861951    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a54b8156-5685-43bc-bc33-968f815208f0-client-ca-bundle\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.869897 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.869879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86wz6\" (UniqueName: \"kubernetes.io/projected/a54b8156-5685-43bc-bc33-968f815208f0-kube-api-access-86wz6\") pod \"metrics-server-5c486fd4cc-nqwqp\" (UID: \"a54b8156-5685-43bc-bc33-968f815208f0\") " pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:06.917652 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:06.917612    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:07.065040 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.064970    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"]
Sep 16 18:18:07.067658 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.067643    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"
Sep 16 18:18:07.070582 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.070559    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-49cn7\""
Sep 16 18:18:07.070781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.070763    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 16 18:18:07.088466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.088440    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"]
Sep 16 18:18:07.162360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.162325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djbxp\" (UniqueName: \"kubernetes.io/projected/0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23-kube-api-access-djbxp\") pod \"monitoring-plugin-5d85778b9d-9tfkc\" (UID: \"0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"
Sep 16 18:18:07.162547 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.162407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-9tfkc\" (UID: \"0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"
Sep 16 18:18:07.187223 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:18:07.187194    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54b8156_5685_43bc_bc33_968f815208f0.slice/crio-7397ce95427458ddb730d27be4a31c05b566d847e47d849ab68ee6841b4d51fa WatchSource:0}: Error finding container 7397ce95427458ddb730d27be4a31c05b566d847e47d849ab68ee6841b4d51fa: Status 404 returned error can't find the container with id 7397ce95427458ddb730d27be4a31c05b566d847e47d849ab68ee6841b4d51fa
Sep 16 18:18:07.189095 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.189076    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"]
Sep 16 18:18:07.263072 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.263040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-9tfkc\" (UID: \"0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"
Sep 16 18:18:07.263228 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:18:07.263196    2580 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 16 18:18:07.263228 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.263210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djbxp\" (UniqueName: \"kubernetes.io/projected/0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23-kube-api-access-djbxp\") pod \"monitoring-plugin-5d85778b9d-9tfkc\" (UID: \"0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"
Sep 16 18:18:07.263331 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:18:07.263250    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23-monitoring-plugin-cert podName:0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23 nodeName:}" failed. No retries permitted until 2026-09-16 18:18:07.763235705 +0000 UTC m=+106.406261741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-9tfkc" (UID: "0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23") : secret "monitoring-plugin-cert" not found
Sep 16 18:18:07.274576 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.274554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djbxp\" (UniqueName: \"kubernetes.io/projected/0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23-kube-api-access-djbxp\") pod \"monitoring-plugin-5d85778b9d-9tfkc\" (UID: \"0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"
Sep 16 18:18:07.403852 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.403821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp" event={"ID":"a54b8156-5685-43bc-bc33-968f815208f0","Type":"ContainerStarted","Data":"7397ce95427458ddb730d27be4a31c05b566d847e47d849ab68ee6841b4d51fa"}
Sep 16 18:18:07.768011 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.767932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-9tfkc\" (UID: \"0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"
Sep 16 18:18:07.770725 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.770698    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-9tfkc\" (UID: \"0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"
Sep 16 18:18:07.976572 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:07.976538    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"
Sep 16 18:18:08.250926 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:08.250891    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"]
Sep 16 18:18:08.358205 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:18:08.358176    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bfbc0d2_8c69_4ea1_ba25_08fcfd89fe23.slice/crio-b18b9c44713eb30148d5bbeaa7c3574592b1970a4bceb8e85a2865bf1147611e WatchSource:0}: Error finding container b18b9c44713eb30148d5bbeaa7c3574592b1970a4bceb8e85a2865bf1147611e: Status 404 returned error can't find the container with id b18b9c44713eb30148d5bbeaa7c3574592b1970a4bceb8e85a2865bf1147611e
Sep 16 18:18:08.407916 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:08.407888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc" event={"ID":"0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23","Type":"ContainerStarted","Data":"b18b9c44713eb30148d5bbeaa7c3574592b1970a4bceb8e85a2865bf1147611e"}
Sep 16 18:18:09.413070 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:09.413034    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp" event={"ID":"a54b8156-5685-43bc-bc33-968f815208f0","Type":"ContainerStarted","Data":"4075544a62ff8ee5ed28cc0b3922984e8559fbb5a1e112d9909805108acbc890"}
Sep 16 18:18:09.434572 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:09.434530    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp" podStartSLOduration=2.240389561 podStartE2EDuration="3.434514932s" totalImagesPullingTime="1.194125371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:18:09.433229068 +0000 UTC m=+108.076255100" watchObservedRunningTime="2026-09-16 18:18:09.434514932 +0000 UTC m=+108.077540966"
Sep 16 18:18:10.418654 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:10.418624    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc" event={"ID":"0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23","Type":"ContainerStarted","Data":"ade3c11aa6912b4f84cdc13a0a28487aee15d0484a094875d41482cc227e2522"}
Sep 16 18:18:10.419024 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:10.418900    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"
Sep 16 18:18:10.423641 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:10.423622    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc"
Sep 16 18:18:10.443077 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:10.443034    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-9tfkc" podStartSLOduration=1.940594006 podStartE2EDuration="3.443019172s" totalImagesPullingTime="1.502425166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:18:10.44228894 +0000 UTC m=+109.085314981" watchObservedRunningTime="2026-09-16 18:18:10.443019172 +0000 UTC m=+109.086045246"
Sep 16 18:18:16.405938 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:16.405910    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xbx5k"
Sep 16 18:18:26.917984 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:26.917944    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:26.918349 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:26.918008    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:30.729293 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:30.729256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:18:30.731489 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:30.731465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e6a401a-b5b2-4ae6-a2d0-965b2658777b-metrics-certs\") pod \"network-metrics-daemon-qdft4\" (UID: \"4e6a401a-b5b2-4ae6-a2d0-965b2658777b\") " pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:18:30.881848 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:30.881820    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5rgdl\""
Sep 16 18:18:30.889816 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:30.889785    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdft4"
Sep 16 18:18:31.161093 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:31.161067    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qdft4"]
Sep 16 18:18:31.164320 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:18:31.164288    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6a401a_b5b2_4ae6_a2d0_965b2658777b.slice/crio-b6279a7db794b3942aa4e7852e6816c4529cb7cb26a0da8a806c08e4254b0be5 WatchSource:0}: Error finding container b6279a7db794b3942aa4e7852e6816c4529cb7cb26a0da8a806c08e4254b0be5: Status 404 returned error can't find the container with id b6279a7db794b3942aa4e7852e6816c4529cb7cb26a0da8a806c08e4254b0be5
Sep 16 18:18:31.494290 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:31.494204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qdft4" event={"ID":"4e6a401a-b5b2-4ae6-a2d0-965b2658777b","Type":"ContainerStarted","Data":"b6279a7db794b3942aa4e7852e6816c4529cb7cb26a0da8a806c08e4254b0be5"}
Sep 16 18:18:32.499744 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:32.499711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qdft4" event={"ID":"4e6a401a-b5b2-4ae6-a2d0-965b2658777b","Type":"ContainerStarted","Data":"f6ce8f92379367bdff4c7e5b005e4c1fa0f7c9f51a10d9842023babf064792b2"}
Sep 16 18:18:32.500117 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:32.499761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qdft4" event={"ID":"4e6a401a-b5b2-4ae6-a2d0-965b2658777b","Type":"ContainerStarted","Data":"a5ac9835e3b6c4a2b8530ba4df18021aa91ce99de196d4e3869394459b5068ea"}
Sep 16 18:18:32.518068 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:32.518017    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qdft4" podStartSLOduration=129.686822559 podStartE2EDuration="2m10.518004021s" totalImagesPullingTime="831.181462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:18:32.515877154 +0000 UTC m=+131.158903195" watchObservedRunningTime="2026-09-16 18:18:32.518004021 +0000 UTC m=+131.161030062"
Sep 16 18:18:46.923309 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:46.923281    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:18:46.928228 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:18:46.928203    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5c486fd4cc-nqwqp"
Sep 16 18:21:21.759036 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:21.759007    2580 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 18:21:55.202139 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.202108    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"]
Sep 16 18:21:55.205244 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.205229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:21:55.207889 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.207870    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8h2ct\""
Sep 16 18:21:55.208751 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.208732    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 18:21:55.208820 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.208738    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 18:21:55.237356 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.237331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t\" (UID: \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:21:55.237469 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.237410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t\" (UID: \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:21:55.237469 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.237454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dswjw\" (UniqueName: \"kubernetes.io/projected/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-kube-api-access-dswjw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t\" (UID: \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:21:55.237567 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.237481    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"]
Sep 16 18:21:55.338266 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.338229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t\" (UID: \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:21:55.338446 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.338282    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t\" (UID: \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:21:55.338446 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.338312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dswjw\" (UniqueName: \"kubernetes.io/projected/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-kube-api-access-dswjw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t\" (UID: \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:21:55.338714 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.338694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t\" (UID: \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:21:55.338756 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.338703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t\" (UID: \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:21:55.347238 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.347215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dswjw\" (UniqueName: \"kubernetes.io/projected/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-kube-api-access-dswjw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t\" (UID: \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:21:55.513430 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.513338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:21:55.786801 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.786724    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"]
Sep 16 18:21:55.789722 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:21:55.789691    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9be5d8d_bdb2_4bd8_83fe_a57b71038ecb.slice/crio-896e4842cb529b7e069088b645faf3e9d8f060f9efe9817f452da8d13e35fa67 WatchSource:0}: Error finding container 896e4842cb529b7e069088b645faf3e9d8f060f9efe9817f452da8d13e35fa67: Status 404 returned error can't find the container with id 896e4842cb529b7e069088b645faf3e9d8f060f9efe9817f452da8d13e35fa67
Sep 16 18:21:55.791655 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:55.791637    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:21:56.199585 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:21:56.199551    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t" event={"ID":"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb","Type":"ContainerStarted","Data":"896e4842cb529b7e069088b645faf3e9d8f060f9efe9817f452da8d13e35fa67"}
Sep 16 18:22:02.223876 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:02.223793    2580 generic.go:356] "Generic (PLEG): container finished" podID="d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" containerID="c3ae1098aab8f30c5f890bef95f2076d7d98042216d6991f492aa4f4574a1faf" exitCode=0
Sep 16 18:22:02.224239 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:02.223878    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t" event={"ID":"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb","Type":"ContainerDied","Data":"c3ae1098aab8f30c5f890bef95f2076d7d98042216d6991f492aa4f4574a1faf"}
Sep 16 18:22:06.239737 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:06.239701    2580 generic.go:356] "Generic (PLEG): container finished" podID="d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" containerID="e95de4131e0ddf7373d84f432ec94cfc72a0080e1e190ddf7f9d541a41cfb77b" exitCode=0
Sep 16 18:22:06.240105 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:06.239792    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t" event={"ID":"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb","Type":"ContainerDied","Data":"e95de4131e0ddf7373d84f432ec94cfc72a0080e1e190ddf7f9d541a41cfb77b"}
Sep 16 18:22:13.268476 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:13.268438    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t" event={"ID":"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb","Type":"ContainerStarted","Data":"947719c247e9d66fb5572842c221fbe2179b581620697eed8aca30d219d58a95"}
Sep 16 18:22:13.298544 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:13.298484    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t" podStartSLOduration=1.9401421399999998 podStartE2EDuration="18.298466598s" totalImagesPullingTime="16.358324458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:21:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:22:13.297381376 +0000 UTC m=+351.940407416" watchObservedRunningTime="2026-09-16 18:22:13.298466598 +0000 UTC m=+351.941492638"
Sep 16 18:22:14.274152 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:14.274071    2580 generic.go:356] "Generic (PLEG): container finished" podID="d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" containerID="947719c247e9d66fb5572842c221fbe2179b581620697eed8aca30d219d58a95" exitCode=0
Sep 16 18:22:14.274152 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:14.274122    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t" event={"ID":"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb","Type":"ContainerDied","Data":"947719c247e9d66fb5572842c221fbe2179b581620697eed8aca30d219d58a95"}
Sep 16 18:22:15.395837 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:15.395815    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:22:15.497671 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:15.497639    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-bundle\") pod \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\" (UID: \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\") "
Sep 16 18:22:15.497821 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:15.497681    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dswjw\" (UniqueName: \"kubernetes.io/projected/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-kube-api-access-dswjw\") pod \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\" (UID: \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\") "
Sep 16 18:22:15.497821 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:15.497739    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-util\") pod \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\" (UID: \"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb\") "
Sep 16 18:22:15.498493 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:15.498462    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-bundle" (OuterVolumeSpecName: "bundle") pod "d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" (UID: "d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:22:15.499848 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:15.499825    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-kube-api-access-dswjw" (OuterVolumeSpecName: "kube-api-access-dswjw") pod "d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" (UID: "d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb"). InnerVolumeSpecName "kube-api-access-dswjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:22:15.501880 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:15.501860    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-util" (OuterVolumeSpecName: "util") pod "d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" (UID: "d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:22:15.598202 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:15.598175    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-util\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:22:15.598202 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:15.598196    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-bundle\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:22:15.598202 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:15.598205    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dswjw\" (UniqueName: \"kubernetes.io/projected/d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb-kube-api-access-dswjw\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:22:16.281913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:16.281834    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t" event={"ID":"d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb","Type":"ContainerDied","Data":"896e4842cb529b7e069088b645faf3e9d8f060f9efe9817f452da8d13e35fa67"}
Sep 16 18:22:16.281913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:16.281880    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h9z8t"
Sep 16 18:22:16.281913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:16.281889    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="896e4842cb529b7e069088b645faf3e9d8f060f9efe9817f452da8d13e35fa67"
Sep 16 18:22:23.996970 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:23.996937    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh"]
Sep 16 18:22:23.997480 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:23.997167    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" containerName="extract"
Sep 16 18:22:23.997480 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:23.997177    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" containerName="extract"
Sep 16 18:22:23.997480 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:23.997186    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" containerName="pull"
Sep 16 18:22:23.997480 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:23.997193    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" containerName="pull"
Sep 16 18:22:23.997480 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:23.997211    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" containerName="util"
Sep 16 18:22:23.997480 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:23.997217    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" containerName="util"
Sep 16 18:22:23.997480 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:23.997252    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9be5d8d-bdb2-4bd8-83fe-a57b71038ecb" containerName="extract"
Sep 16 18:22:24.000327 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.000309    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh"
Sep 16 18:22:24.006092 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.005899    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 16 18:22:24.006092 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.005966    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 16 18:22:24.006398 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.006381    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vx2t4\""
Sep 16 18:22:24.021115 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.021091    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh"]
Sep 16 18:22:24.057719 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.057692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-td2gh\" (UID: \"3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh"
Sep 16 18:22:24.057816 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.057744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj4zh\" (UniqueName: \"kubernetes.io/projected/3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7-kube-api-access-wj4zh\") pod \"cert-manager-operator-controller-manager-55c444bf86-td2gh\" (UID: \"3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh"
Sep 16 18:22:24.158539 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.158506    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj4zh\" (UniqueName: \"kubernetes.io/projected/3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7-kube-api-access-wj4zh\") pod \"cert-manager-operator-controller-manager-55c444bf86-td2gh\" (UID: \"3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh"
Sep 16 18:22:24.158631 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.158555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-td2gh\" (UID: \"3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh"
Sep 16 18:22:24.158919 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.158898    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-td2gh\" (UID: \"3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh"
Sep 16 18:22:24.171470 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.171445    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj4zh\" (UniqueName: \"kubernetes.io/projected/3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7-kube-api-access-wj4zh\") pod \"cert-manager-operator-controller-manager-55c444bf86-td2gh\" (UID: \"3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh"
Sep 16 18:22:24.308423 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.308338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh"
Sep 16 18:22:24.590514 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:24.590483    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh"]
Sep 16 18:22:24.594168 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:22:24.594143    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a52ffb0_34a6_42e5_bdc2_377ec6f84dd7.slice/crio-053dff783b2ea09146c1e16ae1eb1c78c50dbd2159de2e5e69b1a02296bf05a4 WatchSource:0}: Error finding container 053dff783b2ea09146c1e16ae1eb1c78c50dbd2159de2e5e69b1a02296bf05a4: Status 404 returned error can't find the container with id 053dff783b2ea09146c1e16ae1eb1c78c50dbd2159de2e5e69b1a02296bf05a4
Sep 16 18:22:25.313985 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:25.313951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh" event={"ID":"3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7","Type":"ContainerStarted","Data":"053dff783b2ea09146c1e16ae1eb1c78c50dbd2159de2e5e69b1a02296bf05a4"}
Sep 16 18:22:27.323638 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:27.323601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh" event={"ID":"3a52ffb0-34a6-42e5-bdc2-377ec6f84dd7","Type":"ContainerStarted","Data":"f29fddecda9b986ebe9d054a2ea73684fec92d1df0b4ab41d9a95788a78c3f64"}
Sep 16 18:22:27.559483 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:27.559425    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-td2gh" podStartSLOduration=2.638468537 podStartE2EDuration="4.559406549s" totalImagesPullingTime="1.920938012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:22:27.559207293 +0000 UTC m=+366.202233358" watchObservedRunningTime="2026-09-16 18:22:27.559406549 +0000 UTC m=+366.202432589"
Sep 16 18:22:28.430623 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.430591    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"]
Sep 16 18:22:28.434047 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.434016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:28.447765 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.447744    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 18:22:28.449012 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.448995    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 18:22:28.449571 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.449558    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8h2ct\""
Sep 16 18:22:28.507940 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.507910    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"]
Sep 16 18:22:28.595312 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.595280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jvgj\" (UniqueName: \"kubernetes.io/projected/39439f2b-fa43-4ac0-aba4-028b17fd8c39-kube-api-access-9jvgj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9\" (UID: \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:28.595516 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.595328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39439f2b-fa43-4ac0-aba4-028b17fd8c39-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9\" (UID: \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:28.595516 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.595438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39439f2b-fa43-4ac0-aba4-028b17fd8c39-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9\" (UID: \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:28.696706 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.696618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39439f2b-fa43-4ac0-aba4-028b17fd8c39-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9\" (UID: \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:28.696706 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.696688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39439f2b-fa43-4ac0-aba4-028b17fd8c39-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9\" (UID: \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:28.696910 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.696723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jvgj\" (UniqueName: \"kubernetes.io/projected/39439f2b-fa43-4ac0-aba4-028b17fd8c39-kube-api-access-9jvgj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9\" (UID: \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:28.697062 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.697041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39439f2b-fa43-4ac0-aba4-028b17fd8c39-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9\" (UID: \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:28.697122 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.697061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39439f2b-fa43-4ac0-aba4-028b17fd8c39-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9\" (UID: \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:28.727246 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.727214    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jvgj\" (UniqueName: \"kubernetes.io/projected/39439f2b-fa43-4ac0-aba4-028b17fd8c39-kube-api-access-9jvgj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9\" (UID: \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:28.744039 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:28.744016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:29.031075 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:29.031001    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"]
Sep 16 18:22:29.033944 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:22:29.033917    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39439f2b_fa43_4ac0_aba4_028b17fd8c39.slice/crio-6777f0eca124309d2d4c56b24d8cc543152c133189e525e65adb1f8f43071653 WatchSource:0}: Error finding container 6777f0eca124309d2d4c56b24d8cc543152c133189e525e65adb1f8f43071653: Status 404 returned error can't find the container with id 6777f0eca124309d2d4c56b24d8cc543152c133189e525e65adb1f8f43071653
Sep 16 18:22:29.332418 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:29.332386    2580 generic.go:356] "Generic (PLEG): container finished" podID="39439f2b-fa43-4ac0-aba4-028b17fd8c39" containerID="fd44f2b9240df1d34a205d6987677802c141aaca3b6abc22555231c8b6339c10" exitCode=0
Sep 16 18:22:29.332548 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:29.332457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9" event={"ID":"39439f2b-fa43-4ac0-aba4-028b17fd8c39","Type":"ContainerDied","Data":"fd44f2b9240df1d34a205d6987677802c141aaca3b6abc22555231c8b6339c10"}
Sep 16 18:22:29.332548 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:29.332507    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9" event={"ID":"39439f2b-fa43-4ac0-aba4-028b17fd8c39","Type":"ContainerStarted","Data":"6777f0eca124309d2d4c56b24d8cc543152c133189e525e65adb1f8f43071653"}
Sep 16 18:22:30.936751 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:30.936716    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pczk5"]
Sep 16 18:22:30.943655 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:30.943630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pczk5"
Sep 16 18:22:30.948314 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:30.948290    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 16 18:22:30.949230 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:30.949210    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 16 18:22:30.949338 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:30.949214    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4cstg\""
Sep 16 18:22:30.960572 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:30.960550    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pczk5"]
Sep 16 18:22:31.014013 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:31.013934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zlrr\" (UniqueName: \"kubernetes.io/projected/0e7a764c-b3e9-44c6-80bd-93a7901f1a6f-kube-api-access-6zlrr\") pod \"cert-manager-cainjector-559cdd8c87-pczk5\" (UID: \"0e7a764c-b3e9-44c6-80bd-93a7901f1a6f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pczk5"
Sep 16 18:22:31.014013 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:31.013974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e7a764c-b3e9-44c6-80bd-93a7901f1a6f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pczk5\" (UID: \"0e7a764c-b3e9-44c6-80bd-93a7901f1a6f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pczk5"
Sep 16 18:22:31.114682 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:31.114651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e7a764c-b3e9-44c6-80bd-93a7901f1a6f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pczk5\" (UID: \"0e7a764c-b3e9-44c6-80bd-93a7901f1a6f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pczk5"
Sep 16 18:22:31.114843 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:31.114770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zlrr\" (UniqueName: \"kubernetes.io/projected/0e7a764c-b3e9-44c6-80bd-93a7901f1a6f-kube-api-access-6zlrr\") pod \"cert-manager-cainjector-559cdd8c87-pczk5\" (UID: \"0e7a764c-b3e9-44c6-80bd-93a7901f1a6f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pczk5"
Sep 16 18:22:31.134932 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:31.134906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zlrr\" (UniqueName: \"kubernetes.io/projected/0e7a764c-b3e9-44c6-80bd-93a7901f1a6f-kube-api-access-6zlrr\") pod \"cert-manager-cainjector-559cdd8c87-pczk5\" (UID: \"0e7a764c-b3e9-44c6-80bd-93a7901f1a6f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pczk5"
Sep 16 18:22:31.142923 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:31.142896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e7a764c-b3e9-44c6-80bd-93a7901f1a6f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pczk5\" (UID: \"0e7a764c-b3e9-44c6-80bd-93a7901f1a6f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pczk5"
Sep 16 18:22:31.251941 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:31.251872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pczk5"
Sep 16 18:22:31.342050 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:31.342015    2580 generic.go:356] "Generic (PLEG): container finished" podID="39439f2b-fa43-4ac0-aba4-028b17fd8c39" containerID="d86317acc3af18af7af806c77fbaf9eba0b626ba79ebcd20d5c33ad03129e79e" exitCode=0
Sep 16 18:22:31.342194 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:31.342080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9" event={"ID":"39439f2b-fa43-4ac0-aba4-028b17fd8c39","Type":"ContainerDied","Data":"d86317acc3af18af7af806c77fbaf9eba0b626ba79ebcd20d5c33ad03129e79e"}
Sep 16 18:22:31.539653 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:31.539486    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pczk5"]
Sep 16 18:22:31.554204 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:22:31.554178    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e7a764c_b3e9_44c6_80bd_93a7901f1a6f.slice/crio-44dbea71a725cdb67c39cfcc5b264543829560edb86daf61ea3c71b6ee6fd8b1 WatchSource:0}: Error finding container 44dbea71a725cdb67c39cfcc5b264543829560edb86daf61ea3c71b6ee6fd8b1: Status 404 returned error can't find the container with id 44dbea71a725cdb67c39cfcc5b264543829560edb86daf61ea3c71b6ee6fd8b1
Sep 16 18:22:32.348352 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:32.348311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pczk5" event={"ID":"0e7a764c-b3e9-44c6-80bd-93a7901f1a6f","Type":"ContainerStarted","Data":"44dbea71a725cdb67c39cfcc5b264543829560edb86daf61ea3c71b6ee6fd8b1"}
Sep 16 18:22:32.350929 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:32.350854    2580 generic.go:356] "Generic (PLEG): container finished" podID="39439f2b-fa43-4ac0-aba4-028b17fd8c39" containerID="0296010098fd2f7435e931995ec436cc7b14d0320024d6b5e9b1144f3cc5ab77" exitCode=0
Sep 16 18:22:32.351074 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:32.350931    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9" event={"ID":"39439f2b-fa43-4ac0-aba4-028b17fd8c39","Type":"ContainerDied","Data":"0296010098fd2f7435e931995ec436cc7b14d0320024d6b5e9b1144f3cc5ab77"}
Sep 16 18:22:33.949815 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:33.948677    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:34.040305 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.040274    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39439f2b-fa43-4ac0-aba4-028b17fd8c39-util\") pod \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\" (UID: \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\") "
Sep 16 18:22:34.040438 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.040390    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jvgj\" (UniqueName: \"kubernetes.io/projected/39439f2b-fa43-4ac0-aba4-028b17fd8c39-kube-api-access-9jvgj\") pod \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\" (UID: \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\") "
Sep 16 18:22:34.040516 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.040436    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39439f2b-fa43-4ac0-aba4-028b17fd8c39-bundle\") pod \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\" (UID: \"39439f2b-fa43-4ac0-aba4-028b17fd8c39\") "
Sep 16 18:22:34.040883 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.040853    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39439f2b-fa43-4ac0-aba4-028b17fd8c39-bundle" (OuterVolumeSpecName: "bundle") pod "39439f2b-fa43-4ac0-aba4-028b17fd8c39" (UID: "39439f2b-fa43-4ac0-aba4-028b17fd8c39"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:22:34.042466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.042437    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39439f2b-fa43-4ac0-aba4-028b17fd8c39-kube-api-access-9jvgj" (OuterVolumeSpecName: "kube-api-access-9jvgj") pod "39439f2b-fa43-4ac0-aba4-028b17fd8c39" (UID: "39439f2b-fa43-4ac0-aba4-028b17fd8c39"). InnerVolumeSpecName "kube-api-access-9jvgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:22:34.045488 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.045459    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39439f2b-fa43-4ac0-aba4-028b17fd8c39-util" (OuterVolumeSpecName: "util") pod "39439f2b-fa43-4ac0-aba4-028b17fd8c39" (UID: "39439f2b-fa43-4ac0-aba4-028b17fd8c39"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:22:34.141172 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.141125    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jvgj\" (UniqueName: \"kubernetes.io/projected/39439f2b-fa43-4ac0-aba4-028b17fd8c39-kube-api-access-9jvgj\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:22:34.141172 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.141166    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39439f2b-fa43-4ac0-aba4-028b17fd8c39-bundle\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:22:34.141172 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.141177    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39439f2b-fa43-4ac0-aba4-028b17fd8c39-util\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:22:34.360545 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.360505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pczk5" event={"ID":"0e7a764c-b3e9-44c6-80bd-93a7901f1a6f","Type":"ContainerStarted","Data":"01e34d77510c62da4e97203511a6bfd81b7d1365380c07208ce52984910f5f10"}
Sep 16 18:22:34.362381 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.362341    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9"
Sep 16 18:22:34.362535 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.362341    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpnxh9" event={"ID":"39439f2b-fa43-4ac0-aba4-028b17fd8c39","Type":"ContainerDied","Data":"6777f0eca124309d2d4c56b24d8cc543152c133189e525e65adb1f8f43071653"}
Sep 16 18:22:34.362535 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.362456    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6777f0eca124309d2d4c56b24d8cc543152c133189e525e65adb1f8f43071653"
Sep 16 18:22:34.392430 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:34.392387    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pczk5" podStartSLOduration=1.978274356 podStartE2EDuration="4.392355248s" totalImagesPullingTime="2.414080892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:22:34.39140765 +0000 UTC m=+373.034433689" watchObservedRunningTime="2026-09-16 18:22:34.392355248 +0000 UTC m=+373.035381287"
Sep 16 18:22:39.444533 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.444484    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2bfst"]
Sep 16 18:22:39.444948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.444782    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39439f2b-fa43-4ac0-aba4-028b17fd8c39" containerName="util"
Sep 16 18:22:39.444948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.444795    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="39439f2b-fa43-4ac0-aba4-028b17fd8c39" containerName="util"
Sep 16 18:22:39.444948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.444804    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39439f2b-fa43-4ac0-aba4-028b17fd8c39" containerName="pull"
Sep 16 18:22:39.444948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.444809    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="39439f2b-fa43-4ac0-aba4-028b17fd8c39" containerName="pull"
Sep 16 18:22:39.444948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.444815    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39439f2b-fa43-4ac0-aba4-028b17fd8c39" containerName="extract"
Sep 16 18:22:39.444948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.444820    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="39439f2b-fa43-4ac0-aba4-028b17fd8c39" containerName="extract"
Sep 16 18:22:39.444948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.444867    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="39439f2b-fa43-4ac0-aba4-028b17fd8c39" containerName="extract"
Sep 16 18:22:39.446841 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.446823    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2bfst"
Sep 16 18:22:39.449794 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.449776    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9h48z\""
Sep 16 18:22:39.479636 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.479609    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2bfst"]
Sep 16 18:22:39.583259 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.583231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a6ff90d-1f91-438b-83a0-50a5e00406a5-bound-sa-token\") pod \"cert-manager-55b4d954d5-2bfst\" (UID: \"6a6ff90d-1f91-438b-83a0-50a5e00406a5\") " pod="cert-manager/cert-manager-55b4d954d5-2bfst"
Sep 16 18:22:39.583450 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.583272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qws54\" (UniqueName: \"kubernetes.io/projected/6a6ff90d-1f91-438b-83a0-50a5e00406a5-kube-api-access-qws54\") pod \"cert-manager-55b4d954d5-2bfst\" (UID: \"6a6ff90d-1f91-438b-83a0-50a5e00406a5\") " pod="cert-manager/cert-manager-55b4d954d5-2bfst"
Sep 16 18:22:39.683747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.683710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a6ff90d-1f91-438b-83a0-50a5e00406a5-bound-sa-token\") pod \"cert-manager-55b4d954d5-2bfst\" (UID: \"6a6ff90d-1f91-438b-83a0-50a5e00406a5\") " pod="cert-manager/cert-manager-55b4d954d5-2bfst"
Sep 16 18:22:39.683885 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.683755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qws54\" (UniqueName: \"kubernetes.io/projected/6a6ff90d-1f91-438b-83a0-50a5e00406a5-kube-api-access-qws54\") pod \"cert-manager-55b4d954d5-2bfst\" (UID: \"6a6ff90d-1f91-438b-83a0-50a5e00406a5\") " pod="cert-manager/cert-manager-55b4d954d5-2bfst"
Sep 16 18:22:39.695457 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.695396    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qws54\" (UniqueName: \"kubernetes.io/projected/6a6ff90d-1f91-438b-83a0-50a5e00406a5-kube-api-access-qws54\") pod \"cert-manager-55b4d954d5-2bfst\" (UID: \"6a6ff90d-1f91-438b-83a0-50a5e00406a5\") " pod="cert-manager/cert-manager-55b4d954d5-2bfst"
Sep 16 18:22:39.695457 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.695428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a6ff90d-1f91-438b-83a0-50a5e00406a5-bound-sa-token\") pod \"cert-manager-55b4d954d5-2bfst\" (UID: \"6a6ff90d-1f91-438b-83a0-50a5e00406a5\") " pod="cert-manager/cert-manager-55b4d954d5-2bfst"
Sep 16 18:22:39.755595 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:39.755574    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2bfst"
Sep 16 18:22:40.026550 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:40.026464    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2bfst"]
Sep 16 18:22:40.029294 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:22:40.029271    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a6ff90d_1f91_438b_83a0_50a5e00406a5.slice/crio-43746bf5febb75cca8a04d514ae6487498a60928abec2c225a872ad741bd998f WatchSource:0}: Error finding container 43746bf5febb75cca8a04d514ae6487498a60928abec2c225a872ad741bd998f: Status 404 returned error can't find the container with id 43746bf5febb75cca8a04d514ae6487498a60928abec2c225a872ad741bd998f
Sep 16 18:22:40.386286 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:40.386249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2bfst" event={"ID":"6a6ff90d-1f91-438b-83a0-50a5e00406a5","Type":"ContainerStarted","Data":"70435a9b80c54c36a5c0cc7d853c06c005f89308ac4be65fbde03ce7a73fee3e"}
Sep 16 18:22:40.386466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:40.386295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2bfst" event={"ID":"6a6ff90d-1f91-438b-83a0-50a5e00406a5","Type":"ContainerStarted","Data":"43746bf5febb75cca8a04d514ae6487498a60928abec2c225a872ad741bd998f"}
Sep 16 18:22:40.407235 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:40.407189    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-2bfst" podStartSLOduration=1.407175827 podStartE2EDuration="1.407175827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:22:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:22:40.406164606 +0000 UTC m=+379.049190646" watchObservedRunningTime="2026-09-16 18:22:40.407175827 +0000 UTC m=+379.050201867"
Sep 16 18:22:47.049659 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.049625    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"]
Sep 16 18:22:47.065810 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.065786    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:47.066413 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.066390    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"]
Sep 16 18:22:47.069013 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.068991    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 18:22:47.069107 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.068993    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8h2ct\""
Sep 16 18:22:47.069607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.069591    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 18:22:47.242197 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.242165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkf4v\" (UniqueName: \"kubernetes.io/projected/64049a60-dff0-44b6-ad28-b93bdb3dfde8-kube-api-access-tkf4v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q\" (UID: \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:47.242403 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.242201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64049a60-dff0-44b6-ad28-b93bdb3dfde8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q\" (UID: \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:47.242403 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.242345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64049a60-dff0-44b6-ad28-b93bdb3dfde8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q\" (UID: \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:47.342963 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.342935    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkf4v\" (UniqueName: \"kubernetes.io/projected/64049a60-dff0-44b6-ad28-b93bdb3dfde8-kube-api-access-tkf4v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q\" (UID: \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:47.343098 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.342967    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64049a60-dff0-44b6-ad28-b93bdb3dfde8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q\" (UID: \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:47.343098 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.343013    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64049a60-dff0-44b6-ad28-b93bdb3dfde8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q\" (UID: \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:47.343410 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.343383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64049a60-dff0-44b6-ad28-b93bdb3dfde8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q\" (UID: \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:47.343479 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.343408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64049a60-dff0-44b6-ad28-b93bdb3dfde8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q\" (UID: \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:47.352407 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.352386    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkf4v\" (UniqueName: \"kubernetes.io/projected/64049a60-dff0-44b6-ad28-b93bdb3dfde8-kube-api-access-tkf4v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q\" (UID: \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:47.375357 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.375339    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:47.672465 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:47.672395    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"]
Sep 16 18:22:47.675668 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:22:47.675637    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64049a60_dff0_44b6_ad28_b93bdb3dfde8.slice/crio-59b3608c128d9cf42dce4ee2ecec44f40564f0d1d8a0d027d6ebfeacb13068e9 WatchSource:0}: Error finding container 59b3608c128d9cf42dce4ee2ecec44f40564f0d1d8a0d027d6ebfeacb13068e9: Status 404 returned error can't find the container with id 59b3608c128d9cf42dce4ee2ecec44f40564f0d1d8a0d027d6ebfeacb13068e9
Sep 16 18:22:48.422609 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:48.422572    2580 generic.go:356] "Generic (PLEG): container finished" podID="64049a60-dff0-44b6-ad28-b93bdb3dfde8" containerID="ee27e374e016e247446df9e774803ed15cc0a1d02a978b83c1a4587c272e211d" exitCode=0
Sep 16 18:22:48.422949 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:48.422654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q" event={"ID":"64049a60-dff0-44b6-ad28-b93bdb3dfde8","Type":"ContainerDied","Data":"ee27e374e016e247446df9e774803ed15cc0a1d02a978b83c1a4587c272e211d"}
Sep 16 18:22:48.422949 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:48.422704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q" event={"ID":"64049a60-dff0-44b6-ad28-b93bdb3dfde8","Type":"ContainerStarted","Data":"59b3608c128d9cf42dce4ee2ecec44f40564f0d1d8a0d027d6ebfeacb13068e9"}
Sep 16 18:22:49.427870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:49.427838    2580 generic.go:356] "Generic (PLEG): container finished" podID="64049a60-dff0-44b6-ad28-b93bdb3dfde8" containerID="0483f08bcf3810292686d95e2ba140d198038b672a80d07ceb5476ec131a974c" exitCode=0
Sep 16 18:22:49.428311 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:49.427918    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q" event={"ID":"64049a60-dff0-44b6-ad28-b93bdb3dfde8","Type":"ContainerDied","Data":"0483f08bcf3810292686d95e2ba140d198038b672a80d07ceb5476ec131a974c"}
Sep 16 18:22:50.433886 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:50.433852    2580 generic.go:356] "Generic (PLEG): container finished" podID="64049a60-dff0-44b6-ad28-b93bdb3dfde8" containerID="552329dac10d02592621c39ef7554bff7f2e6ede6cf00364b455f98308528520" exitCode=0
Sep 16 18:22:50.434328 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:50.433892    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q" event={"ID":"64049a60-dff0-44b6-ad28-b93bdb3dfde8","Type":"ContainerDied","Data":"552329dac10d02592621c39ef7554bff7f2e6ede6cf00364b455f98308528520"}
Sep 16 18:22:51.555985 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:51.555959    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:51.676063 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:51.676025    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkf4v\" (UniqueName: \"kubernetes.io/projected/64049a60-dff0-44b6-ad28-b93bdb3dfde8-kube-api-access-tkf4v\") pod \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\" (UID: \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\") "
Sep 16 18:22:51.676230 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:51.676084    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64049a60-dff0-44b6-ad28-b93bdb3dfde8-bundle\") pod \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\" (UID: \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\") "
Sep 16 18:22:51.676230 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:51.676131    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64049a60-dff0-44b6-ad28-b93bdb3dfde8-util\") pod \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\" (UID: \"64049a60-dff0-44b6-ad28-b93bdb3dfde8\") "
Sep 16 18:22:51.676832 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:51.676800    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64049a60-dff0-44b6-ad28-b93bdb3dfde8-bundle" (OuterVolumeSpecName: "bundle") pod "64049a60-dff0-44b6-ad28-b93bdb3dfde8" (UID: "64049a60-dff0-44b6-ad28-b93bdb3dfde8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:22:51.678077 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:51.678055    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64049a60-dff0-44b6-ad28-b93bdb3dfde8-kube-api-access-tkf4v" (OuterVolumeSpecName: "kube-api-access-tkf4v") pod "64049a60-dff0-44b6-ad28-b93bdb3dfde8" (UID: "64049a60-dff0-44b6-ad28-b93bdb3dfde8"). InnerVolumeSpecName "kube-api-access-tkf4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:22:51.681484 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:51.681447    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64049a60-dff0-44b6-ad28-b93bdb3dfde8-util" (OuterVolumeSpecName: "util") pod "64049a60-dff0-44b6-ad28-b93bdb3dfde8" (UID: "64049a60-dff0-44b6-ad28-b93bdb3dfde8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:22:51.777529 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:51.777449    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64049a60-dff0-44b6-ad28-b93bdb3dfde8-util\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:22:51.777529 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:51.777478    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkf4v\" (UniqueName: \"kubernetes.io/projected/64049a60-dff0-44b6-ad28-b93bdb3dfde8-kube-api-access-tkf4v\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:22:51.777529 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:51.777489    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64049a60-dff0-44b6-ad28-b93bdb3dfde8-bundle\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:22:52.443757 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:52.443720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q" event={"ID":"64049a60-dff0-44b6-ad28-b93bdb3dfde8","Type":"ContainerDied","Data":"59b3608c128d9cf42dce4ee2ecec44f40564f0d1d8a0d027d6ebfeacb13068e9"}
Sep 16 18:22:52.443757 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:52.443743    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk8x9q"
Sep 16 18:22:52.443953 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:22:52.443765    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59b3608c128d9cf42dce4ee2ecec44f40564f0d1d8a0d027d6ebfeacb13068e9"
Sep 16 18:23:04.185782 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.185743    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"]
Sep 16 18:23:04.186402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.186101    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64049a60-dff0-44b6-ad28-b93bdb3dfde8" containerName="pull"
Sep 16 18:23:04.186402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.186117    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="64049a60-dff0-44b6-ad28-b93bdb3dfde8" containerName="pull"
Sep 16 18:23:04.186402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.186130    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64049a60-dff0-44b6-ad28-b93bdb3dfde8" containerName="util"
Sep 16 18:23:04.186402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.186139    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="64049a60-dff0-44b6-ad28-b93bdb3dfde8" containerName="util"
Sep 16 18:23:04.186402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.186149    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64049a60-dff0-44b6-ad28-b93bdb3dfde8" containerName="extract"
Sep 16 18:23:04.186402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.186156    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="64049a60-dff0-44b6-ad28-b93bdb3dfde8" containerName="extract"
Sep 16 18:23:04.186402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.186230    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="64049a60-dff0-44b6-ad28-b93bdb3dfde8" containerName="extract"
Sep 16 18:23:04.189031 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.189011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:04.192923 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.192902    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 18:23:04.193752 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.193737    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 18:23:04.193808 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.193737    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8h2ct\""
Sep 16 18:23:04.226593 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.226571    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"]
Sep 16 18:23:04.266840 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.266813    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/670d0200-2d93-4a2c-99b0-3686f190f431-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth\" (UID: \"670d0200-2d93-4a2c-99b0-3686f190f431\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:04.266981 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.266857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc9vf\" (UniqueName: \"kubernetes.io/projected/670d0200-2d93-4a2c-99b0-3686f190f431-kube-api-access-tc9vf\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth\" (UID: \"670d0200-2d93-4a2c-99b0-3686f190f431\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:04.266981 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.266894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/670d0200-2d93-4a2c-99b0-3686f190f431-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth\" (UID: \"670d0200-2d93-4a2c-99b0-3686f190f431\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:04.367636 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.367606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/670d0200-2d93-4a2c-99b0-3686f190f431-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth\" (UID: \"670d0200-2d93-4a2c-99b0-3686f190f431\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:04.367804 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.367648    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/670d0200-2d93-4a2c-99b0-3686f190f431-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth\" (UID: \"670d0200-2d93-4a2c-99b0-3686f190f431\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:04.367804 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.367678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc9vf\" (UniqueName: \"kubernetes.io/projected/670d0200-2d93-4a2c-99b0-3686f190f431-kube-api-access-tc9vf\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth\" (UID: \"670d0200-2d93-4a2c-99b0-3686f190f431\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:04.368027 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.368006    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/670d0200-2d93-4a2c-99b0-3686f190f431-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth\" (UID: \"670d0200-2d93-4a2c-99b0-3686f190f431\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:04.368093 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.368046    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/670d0200-2d93-4a2c-99b0-3686f190f431-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth\" (UID: \"670d0200-2d93-4a2c-99b0-3686f190f431\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:04.377573 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.377551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc9vf\" (UniqueName: \"kubernetes.io/projected/670d0200-2d93-4a2c-99b0-3686f190f431-kube-api-access-tc9vf\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth\" (UID: \"670d0200-2d93-4a2c-99b0-3686f190f431\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:04.497324 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.497254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:04.777978 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.777897    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"]
Sep 16 18:23:04.780660 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:23:04.780624    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670d0200_2d93_4a2c_99b0_3686f190f431.slice/crio-aa674d94f91c7fe316408e62404ea6f8260c4647a7d94c4e900aa4454ea79d5e WatchSource:0}: Error finding container aa674d94f91c7fe316408e62404ea6f8260c4647a7d94c4e900aa4454ea79d5e: Status 404 returned error can't find the container with id aa674d94f91c7fe316408e62404ea6f8260c4647a7d94c4e900aa4454ea79d5e
Sep 16 18:23:04.814219 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.814193    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"]
Sep 16 18:23:04.816666 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.816641    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.821123 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.821100    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 18:23:04.821123 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.821116    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 18:23:04.821501 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.821471    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 18:23:04.821598 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.821477    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 18:23:04.821754 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.821736    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5ghg2\""
Sep 16 18:23:04.837668 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.837643    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"]
Sep 16 18:23:04.872176 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.872147    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.872306 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.872181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-manifests\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.872306 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.872205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9qn6\" (UniqueName: \"kubernetes.io/projected/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-kube-api-access-n9qn6\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.872306 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.872264    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.872456 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.872358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-tmp\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.972660 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.972625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-manifests\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.972814 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.972665    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9qn6\" (UniqueName: \"kubernetes.io/projected/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-kube-api-access-n9qn6\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.972814 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.972684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.972814 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.972721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-tmp\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.972814 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.972760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.973064 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.973044    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-manifests\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.974897 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.974875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-tmp\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.975091 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.975068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.975129 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.975081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:04.988091 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:04.988073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9qn6\" (UniqueName: \"kubernetes.io/projected/cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914-kube-api-access-n9qn6\") pod \"opendatahub-operator-controller-manager-86bdbbf975-sf28v\" (UID: \"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914\") " pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:05.125899 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:05.125879    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:05.419617 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:05.419535    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"]
Sep 16 18:23:05.421693 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:23:05.421673    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2d8e74_4fd8_4904_9aa9_8e77ed6dc914.slice/crio-f79a8031d508cbf62a0017b6eb8da35d13164821363be2ede7d39c48cd29af85 WatchSource:0}: Error finding container f79a8031d508cbf62a0017b6eb8da35d13164821363be2ede7d39c48cd29af85: Status 404 returned error can't find the container with id f79a8031d508cbf62a0017b6eb8da35d13164821363be2ede7d39c48cd29af85
Sep 16 18:23:05.497243 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:05.497217    2580 generic.go:356] "Generic (PLEG): container finished" podID="670d0200-2d93-4a2c-99b0-3686f190f431" containerID="c9a97111214d30d0dc994a2e171e868e19003f1689c29dcfb46ff60179908fd3" exitCode=0
Sep 16 18:23:05.497359 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:05.497294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth" event={"ID":"670d0200-2d93-4a2c-99b0-3686f190f431","Type":"ContainerDied","Data":"c9a97111214d30d0dc994a2e171e868e19003f1689c29dcfb46ff60179908fd3"}
Sep 16 18:23:05.497359 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:05.497340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth" event={"ID":"670d0200-2d93-4a2c-99b0-3686f190f431","Type":"ContainerStarted","Data":"aa674d94f91c7fe316408e62404ea6f8260c4647a7d94c4e900aa4454ea79d5e"}
Sep 16 18:23:05.498713 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:05.498691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v" event={"ID":"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914","Type":"ContainerStarted","Data":"f79a8031d508cbf62a0017b6eb8da35d13164821363be2ede7d39c48cd29af85"}
Sep 16 18:23:06.506950 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:06.506894    2580 generic.go:356] "Generic (PLEG): container finished" podID="670d0200-2d93-4a2c-99b0-3686f190f431" containerID="54044008dec417d48e3cc1fcce24feec9ba1a398b274614d48b427152341d279" exitCode=0
Sep 16 18:23:06.507362 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:06.507020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth" event={"ID":"670d0200-2d93-4a2c-99b0-3686f190f431","Type":"ContainerDied","Data":"54044008dec417d48e3cc1fcce24feec9ba1a398b274614d48b427152341d279"}
Sep 16 18:23:07.514669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:07.514633    2580 generic.go:356] "Generic (PLEG): container finished" podID="670d0200-2d93-4a2c-99b0-3686f190f431" containerID="6942c369b896661f0855138dfe58badf528f6615145ad89c91aa11e7206aa584" exitCode=0
Sep 16 18:23:07.515074 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:07.514727    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth" event={"ID":"670d0200-2d93-4a2c-99b0-3686f190f431","Type":"ContainerDied","Data":"6942c369b896661f0855138dfe58badf528f6615145ad89c91aa11e7206aa584"}
Sep 16 18:23:08.520239 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:08.520206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v" event={"ID":"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914","Type":"ContainerStarted","Data":"97faeea2542991255a9aa3b0e27149268cd8efda939fc91bf486dbd3e2e421a9"}
Sep 16 18:23:08.643090 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:08.643067    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:08.701243 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:08.701217    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/670d0200-2d93-4a2c-99b0-3686f190f431-bundle\") pod \"670d0200-2d93-4a2c-99b0-3686f190f431\" (UID: \"670d0200-2d93-4a2c-99b0-3686f190f431\") "
Sep 16 18:23:08.701390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:08.701248    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/670d0200-2d93-4a2c-99b0-3686f190f431-util\") pod \"670d0200-2d93-4a2c-99b0-3686f190f431\" (UID: \"670d0200-2d93-4a2c-99b0-3686f190f431\") "
Sep 16 18:23:08.701390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:08.701286    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc9vf\" (UniqueName: \"kubernetes.io/projected/670d0200-2d93-4a2c-99b0-3686f190f431-kube-api-access-tc9vf\") pod \"670d0200-2d93-4a2c-99b0-3686f190f431\" (UID: \"670d0200-2d93-4a2c-99b0-3686f190f431\") "
Sep 16 18:23:08.701932 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:08.701898    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/670d0200-2d93-4a2c-99b0-3686f190f431-bundle" (OuterVolumeSpecName: "bundle") pod "670d0200-2d93-4a2c-99b0-3686f190f431" (UID: "670d0200-2d93-4a2c-99b0-3686f190f431"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:23:08.703268 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:08.703237    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/670d0200-2d93-4a2c-99b0-3686f190f431-kube-api-access-tc9vf" (OuterVolumeSpecName: "kube-api-access-tc9vf") pod "670d0200-2d93-4a2c-99b0-3686f190f431" (UID: "670d0200-2d93-4a2c-99b0-3686f190f431"). InnerVolumeSpecName "kube-api-access-tc9vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:23:08.707079 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:08.707057    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/670d0200-2d93-4a2c-99b0-3686f190f431-util" (OuterVolumeSpecName: "util") pod "670d0200-2d93-4a2c-99b0-3686f190f431" (UID: "670d0200-2d93-4a2c-99b0-3686f190f431"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:23:08.802103 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:08.802073    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc9vf\" (UniqueName: \"kubernetes.io/projected/670d0200-2d93-4a2c-99b0-3686f190f431-kube-api-access-tc9vf\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:23:08.802103 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:08.802095    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/670d0200-2d93-4a2c-99b0-3686f190f431-bundle\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:23:08.802103 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:08.802103    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/670d0200-2d93-4a2c-99b0-3686f190f431-util\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:23:09.526834 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:09.526812    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth"
Sep 16 18:23:09.527197 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:09.526826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0djvth" event={"ID":"670d0200-2d93-4a2c-99b0-3686f190f431","Type":"ContainerDied","Data":"aa674d94f91c7fe316408e62404ea6f8260c4647a7d94c4e900aa4454ea79d5e"}
Sep 16 18:23:09.527197 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:09.526880    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa674d94f91c7fe316408e62404ea6f8260c4647a7d94c4e900aa4454ea79d5e"
Sep 16 18:23:09.528463 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:09.528439    2580 generic.go:356] "Generic (PLEG): container finished" podID="cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914" containerID="97faeea2542991255a9aa3b0e27149268cd8efda939fc91bf486dbd3e2e421a9" exitCode=0
Sep 16 18:23:09.528596 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:09.528486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v" event={"ID":"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914","Type":"ContainerDied","Data":"97faeea2542991255a9aa3b0e27149268cd8efda939fc91bf486dbd3e2e421a9"}
Sep 16 18:23:10.535344 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:10.535297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v" event={"ID":"cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914","Type":"ContainerStarted","Data":"7128e54fc1de8145ae99d90b046ba06565cd561a7514a3148dd63596097906ac"}
Sep 16 18:23:10.535787 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:10.535404    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:10.561253 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:10.561206    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v" podStartSLOduration=2.303996743 podStartE2EDuration="6.561183964s" totalImagesPullingTime="3.253760063s" totalInitContainerRuntime="1.003427158s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:23:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:23:10.558420789 +0000 UTC m=+409.201446828" watchObservedRunningTime="2026-09-16 18:23:10.561183964 +0000 UTC m=+409.204210007"
Sep 16 18:23:21.542285 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:21.542251    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86bdbbf975-sf28v"
Sep 16 18:23:32.916235 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.916195    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"]
Sep 16 18:23:32.916854 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.916479    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="670d0200-2d93-4a2c-99b0-3686f190f431" containerName="pull"
Sep 16 18:23:32.916854 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.916491    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="670d0200-2d93-4a2c-99b0-3686f190f431" containerName="pull"
Sep 16 18:23:32.916854 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.916518    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="670d0200-2d93-4a2c-99b0-3686f190f431" containerName="util"
Sep 16 18:23:32.916854 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.916524    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="670d0200-2d93-4a2c-99b0-3686f190f431" containerName="util"
Sep 16 18:23:32.916854 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.916530    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="670d0200-2d93-4a2c-99b0-3686f190f431" containerName="extract"
Sep 16 18:23:32.916854 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.916535    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="670d0200-2d93-4a2c-99b0-3686f190f431" containerName="extract"
Sep 16 18:23:32.916854 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.916581    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="670d0200-2d93-4a2c-99b0-3686f190f431" containerName="extract"
Sep 16 18:23:32.923032 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.921223    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"
Sep 16 18:23:32.924157 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.924133    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 16 18:23:32.924486 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.924463    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 16 18:23:32.930627 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.930610    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 18:23:32.931016 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.931002    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wfr2t\""
Sep 16 18:23:32.934341 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.934322    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 18:23:32.935353 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.935335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"]
Sep 16 18:23:32.973985 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.973962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b228b11-1b24-4cb5-ac9c-e692a7987194-tls-certs\") pod \"kube-auth-proxy-7d9c67857d-2d8t2\" (UID: \"2b228b11-1b24-4cb5-ac9c-e692a7987194\") " pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"
Sep 16 18:23:32.974102 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.974035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7d84\" (UniqueName: \"kubernetes.io/projected/2b228b11-1b24-4cb5-ac9c-e692a7987194-kube-api-access-w7d84\") pod \"kube-auth-proxy-7d9c67857d-2d8t2\" (UID: \"2b228b11-1b24-4cb5-ac9c-e692a7987194\") " pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"
Sep 16 18:23:32.974172 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:32.974094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b228b11-1b24-4cb5-ac9c-e692a7987194-tmp\") pod \"kube-auth-proxy-7d9c67857d-2d8t2\" (UID: \"2b228b11-1b24-4cb5-ac9c-e692a7987194\") " pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"
Sep 16 18:23:33.075081 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:33.075052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7d84\" (UniqueName: \"kubernetes.io/projected/2b228b11-1b24-4cb5-ac9c-e692a7987194-kube-api-access-w7d84\") pod \"kube-auth-proxy-7d9c67857d-2d8t2\" (UID: \"2b228b11-1b24-4cb5-ac9c-e692a7987194\") " pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"
Sep 16 18:23:33.075081 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:33.075086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b228b11-1b24-4cb5-ac9c-e692a7987194-tmp\") pod \"kube-auth-proxy-7d9c67857d-2d8t2\" (UID: \"2b228b11-1b24-4cb5-ac9c-e692a7987194\") " pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"
Sep 16 18:23:33.075242 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:33.075123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b228b11-1b24-4cb5-ac9c-e692a7987194-tls-certs\") pod \"kube-auth-proxy-7d9c67857d-2d8t2\" (UID: \"2b228b11-1b24-4cb5-ac9c-e692a7987194\") " pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"
Sep 16 18:23:33.075242 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:23:33.075224    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 16 18:23:33.075304 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:23:33.075291    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b228b11-1b24-4cb5-ac9c-e692a7987194-tls-certs podName:2b228b11-1b24-4cb5-ac9c-e692a7987194 nodeName:}" failed. No retries permitted until 2026-09-16 18:23:33.57527259 +0000 UTC m=+432.218298625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2b228b11-1b24-4cb5-ac9c-e692a7987194-tls-certs") pod "kube-auth-proxy-7d9c67857d-2d8t2" (UID: "2b228b11-1b24-4cb5-ac9c-e692a7987194") : secret "kube-auth-proxy-tls" not found
Sep 16 18:23:33.077244 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:33.077219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b228b11-1b24-4cb5-ac9c-e692a7987194-tmp\") pod \"kube-auth-proxy-7d9c67857d-2d8t2\" (UID: \"2b228b11-1b24-4cb5-ac9c-e692a7987194\") " pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"
Sep 16 18:23:33.086125 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:33.086099    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7d84\" (UniqueName: \"kubernetes.io/projected/2b228b11-1b24-4cb5-ac9c-e692a7987194-kube-api-access-w7d84\") pod \"kube-auth-proxy-7d9c67857d-2d8t2\" (UID: \"2b228b11-1b24-4cb5-ac9c-e692a7987194\") " pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"
Sep 16 18:23:33.578425 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:33.578392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b228b11-1b24-4cb5-ac9c-e692a7987194-tls-certs\") pod \"kube-auth-proxy-7d9c67857d-2d8t2\" (UID: \"2b228b11-1b24-4cb5-ac9c-e692a7987194\") " pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"
Sep 16 18:23:33.580773 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:33.580748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b228b11-1b24-4cb5-ac9c-e692a7987194-tls-certs\") pod \"kube-auth-proxy-7d9c67857d-2d8t2\" (UID: \"2b228b11-1b24-4cb5-ac9c-e692a7987194\") " pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"
Sep 16 18:23:33.831966 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:33.831938    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"
Sep 16 18:23:34.128397 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:34.128348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2"]
Sep 16 18:23:34.130195 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:23:34.130173    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b228b11_1b24_4cb5_ac9c_e692a7987194.slice/crio-c494e8ba2066acfaa2ff78b8c21db5fd9374e02a4f9403c9a1fea3e16c71ad9c WatchSource:0}: Error finding container c494e8ba2066acfaa2ff78b8c21db5fd9374e02a4f9403c9a1fea3e16c71ad9c: Status 404 returned error can't find the container with id c494e8ba2066acfaa2ff78b8c21db5fd9374e02a4f9403c9a1fea3e16c71ad9c
Sep 16 18:23:34.638618 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:34.638584    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2" event={"ID":"2b228b11-1b24-4cb5-ac9c-e692a7987194","Type":"ContainerStarted","Data":"c494e8ba2066acfaa2ff78b8c21db5fd9374e02a4f9403c9a1fea3e16c71ad9c"}
Sep 16 18:23:37.656819 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:37.656785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2" event={"ID":"2b228b11-1b24-4cb5-ac9c-e692a7987194","Type":"ContainerStarted","Data":"ed793ba020e3da46969f7b59e27053214c343fbf56a4cce9fe2cd2aa850454bf"}
Sep 16 18:23:37.674818 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:37.674772    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d9c67857d-2d8t2" podStartSLOduration=2.9924443590000003 podStartE2EDuration="5.674758163s" totalImagesPullingTime="2.682313804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:23:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:23:37.672937061 +0000 UTC m=+436.315963100" watchObservedRunningTime="2026-09-16 18:23:37.674758163 +0000 UTC m=+436.317784203"
Sep 16 18:23:41.193600 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.193566    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"]
Sep 16 18:23:41.200820 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.200794    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.203412 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.203382    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 18:23:41.203611 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.203393    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kbv6x\""
Sep 16 18:23:41.212415 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.212391    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"]
Sep 16 18:23:41.241322 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.241298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.241460 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.241327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.241460 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.241345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.241460 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.241375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.241621 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.241502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdz72\" (UniqueName: \"kubernetes.io/projected/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-kube-api-access-xdz72\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.241621 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.241593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.241724 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.241665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.241724 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.241692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.241724 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.241717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.342763 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.342715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.342763 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.342767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.342996 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.342795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.342996 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.342827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.342996 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.342873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdz72\" (UniqueName: \"kubernetes.io/projected/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-kube-api-access-xdz72\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.342996 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.342922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.342996 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.342985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.343220 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.343016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.343220 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.343042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.343319 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.343298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.343899 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.343553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.343899 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.343714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.343899 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.343808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.344445 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.344421    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.345395 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.345342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.345871 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.345853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.351832 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.351804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.352183 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.352163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdz72\" (UniqueName: \"kubernetes.io/projected/e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb-kube-api-access-xdz72\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5\" (UID: \"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.515940 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.515850    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:41.793881 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:41.793807    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"]
Sep 16 18:23:41.797140 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:23:41.797108    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e90f69_edff_4bbd_8d5a_8237a5a3f9cb.slice/crio-e7effacc44ee25ead38c3276c5b649ca22f78596e25a95d2ed39b0101ec41a0f WatchSource:0}: Error finding container e7effacc44ee25ead38c3276c5b649ca22f78596e25a95d2ed39b0101ec41a0f: Status 404 returned error can't find the container with id e7effacc44ee25ead38c3276c5b649ca22f78596e25a95d2ed39b0101ec41a0f
Sep 16 18:23:42.679876 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:42.679840    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5" event={"ID":"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb","Type":"ContainerStarted","Data":"e7effacc44ee25ead38c3276c5b649ca22f78596e25a95d2ed39b0101ec41a0f"}
Sep 16 18:23:44.644833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:44.644789    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:23:44.645198 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:44.644865    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:23:44.645198 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:44.644894    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:23:45.482253 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.482222    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"]
Sep 16 18:23:45.484496 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.484470    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.489236 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.489213    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 18:23:45.489387 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.489213    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 18:23:45.489387 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.489217    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 18:23:45.489717 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.489690    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7g9l9\""
Sep 16 18:23:45.512786 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.512762    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"]
Sep 16 18:23:45.579835 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.579797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99c71921-fe9c-44ca-bf07-019ffffc863d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.579835 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.579849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99c71921-fe9c-44ca-bf07-019ffffc863d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.580121 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.579883    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99c71921-fe9c-44ca-bf07-019ffffc863d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.580121 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.579951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99c71921-fe9c-44ca-bf07-019ffffc863d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.580121 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.579975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99c71921-fe9c-44ca-bf07-019ffffc863d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.580121 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.580009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69c77\" (UniqueName: \"kubernetes.io/projected/99c71921-fe9c-44ca-bf07-019ffffc863d-kube-api-access-69c77\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.580121 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.580035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99c71921-fe9c-44ca-bf07-019ffffc863d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.680620 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.680591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99c71921-fe9c-44ca-bf07-019ffffc863d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.681045 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.680625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99c71921-fe9c-44ca-bf07-019ffffc863d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.681045 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.680647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69c77\" (UniqueName: \"kubernetes.io/projected/99c71921-fe9c-44ca-bf07-019ffffc863d-kube-api-access-69c77\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.681045 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.680675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99c71921-fe9c-44ca-bf07-019ffffc863d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.681045 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.680734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99c71921-fe9c-44ca-bf07-019ffffc863d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.681045 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.680761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99c71921-fe9c-44ca-bf07-019ffffc863d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.681045 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.680792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99c71921-fe9c-44ca-bf07-019ffffc863d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.681483 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.681412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99c71921-fe9c-44ca-bf07-019ffffc863d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.683080 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.683051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99c71921-fe9c-44ca-bf07-019ffffc863d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.683266 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.683053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99c71921-fe9c-44ca-bf07-019ffffc863d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.683388 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.683353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99c71921-fe9c-44ca-bf07-019ffffc863d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.683388 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.683359    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99c71921-fe9c-44ca-bf07-019ffffc863d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.691640 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.691617    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99c71921-fe9c-44ca-bf07-019ffffc863d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.691970 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.691952    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69c77\" (UniqueName: \"kubernetes.io/projected/99c71921-fe9c-44ca-bf07-019ffffc863d-kube-api-access-69c77\") pod \"istiod-openshift-gateway-5677ccb49b-q7rrf\" (UID: \"99c71921-fe9c-44ca-bf07-019ffffc863d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:45.695784 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.695761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5" event={"ID":"e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb","Type":"ContainerStarted","Data":"43928e2d3ee6ab0a3c911b12e1c4ae2e6b5ae49f9461ca4fc089f7f41041c58d"}
Sep 16 18:23:45.722966 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.722925    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5" podStartSLOduration=1.8778786410000001 podStartE2EDuration="4.722913186s" totalImagesPullingTime="2.845034545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:23:45.721036348 +0000 UTC m=+444.364062388" watchObservedRunningTime="2026-09-16 18:23:45.722913186 +0000 UTC m=+444.365939217"
Sep 16 18:23:45.793149 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:45.793076    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:46.108605 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:46.108583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"]
Sep 16 18:23:46.109835 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:23:46.109807    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c71921_fe9c_44ca_bf07_019ffffc863d.slice/crio-1e5f58775c98db52ad1225844297d62793494dd4348c513190ece8a4a2d8edd2 WatchSource:0}: Error finding container 1e5f58775c98db52ad1225844297d62793494dd4348c513190ece8a4a2d8edd2: Status 404 returned error can't find the container with id 1e5f58775c98db52ad1225844297d62793494dd4348c513190ece8a4a2d8edd2
Sep 16 18:23:46.517664 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:46.517578    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:46.528859 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:46.528835    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:46.701623 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:46.701595    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf" event={"ID":"99c71921-fe9c-44ca-bf07-019ffffc863d","Type":"ContainerStarted","Data":"1e5f58775c98db52ad1225844297d62793494dd4348c513190ece8a4a2d8edd2"}
Sep 16 18:23:46.701955 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:46.701845    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:46.703121 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:46.703104    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5"
Sep 16 18:23:48.583589 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:48.583549    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:23:48.583883 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:48.583619    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:23:48.712252 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:48.712204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf" event={"ID":"99c71921-fe9c-44ca-bf07-019ffffc863d","Type":"ContainerStarted","Data":"cb450d6b4d97c70f67da8a0b09c35ca42318cdc9580a24a4b3e8ea874d3025b0"}
Sep 16 18:23:48.712476 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:48.712441    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:23:48.790635 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:48.790578    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf" podStartSLOduration=1.319534311 podStartE2EDuration="3.79056025s" totalImagesPullingTime="2.471025939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:23:48.786274832 +0000 UTC m=+447.429300872" watchObservedRunningTime="2026-09-16 18:23:48.79056025 +0000 UTC m=+447.433586289"
Sep 16 18:23:49.719574 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:49.719522    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-q7rrf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 18:23:49.719990 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:49.719612    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf" podUID="99c71921-fe9c-44ca-bf07-019ffffc863d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 18:23:52.719003 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:23:52.718972    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q7rrf"
Sep 16 18:24:44.309084 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.309052    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"]
Sep 16 18:24:44.317202 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.317183    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:44.319997 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.319964    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8h2ct\""
Sep 16 18:24:44.319997 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.319983    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 18:24:44.320166 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.320013    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 18:24:44.320941 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.320916    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"]
Sep 16 18:24:44.407683 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.407653    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"]
Sep 16 18:24:44.410201 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.410185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:44.419335 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.419316    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"]
Sep 16 18:24:44.426084 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.426063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e29149a-67b0-4513-ae6e-6b215602c7af-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88\" (UID: \"1e29149a-67b0-4513-ae6e-6b215602c7af\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:44.426187 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.426111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpwmh\" (UniqueName: \"kubernetes.io/projected/1e29149a-67b0-4513-ae6e-6b215602c7af-kube-api-access-gpwmh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88\" (UID: \"1e29149a-67b0-4513-ae6e-6b215602c7af\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:44.426187 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.426170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e29149a-67b0-4513-ae6e-6b215602c7af-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88\" (UID: \"1e29149a-67b0-4513-ae6e-6b215602c7af\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:44.515709 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.515682    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"]
Sep 16 18:24:44.517967 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.517950    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:44.527258 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.527236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpwmh\" (UniqueName: \"kubernetes.io/projected/1e29149a-67b0-4513-ae6e-6b215602c7af-kube-api-access-gpwmh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88\" (UID: \"1e29149a-67b0-4513-ae6e-6b215602c7af\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:44.527382 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.527273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr2z7\" (UniqueName: \"kubernetes.io/projected/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-kube-api-access-lr2z7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb\" (UID: \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:44.527382 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.527301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb\" (UID: \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:44.527519 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.527403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e29149a-67b0-4513-ae6e-6b215602c7af-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88\" (UID: \"1e29149a-67b0-4513-ae6e-6b215602c7af\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:44.527519 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.527453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb\" (UID: \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:44.527519 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.527509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e29149a-67b0-4513-ae6e-6b215602c7af-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88\" (UID: \"1e29149a-67b0-4513-ae6e-6b215602c7af\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:44.527824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.527806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e29149a-67b0-4513-ae6e-6b215602c7af-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88\" (UID: \"1e29149a-67b0-4513-ae6e-6b215602c7af\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:44.527892 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.527829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e29149a-67b0-4513-ae6e-6b215602c7af-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88\" (UID: \"1e29149a-67b0-4513-ae6e-6b215602c7af\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:44.528459 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.528442    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"]
Sep 16 18:24:44.536001 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.535978    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpwmh\" (UniqueName: \"kubernetes.io/projected/1e29149a-67b0-4513-ae6e-6b215602c7af-kube-api-access-gpwmh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88\" (UID: \"1e29149a-67b0-4513-ae6e-6b215602c7af\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:44.610953 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.610926    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"]
Sep 16 18:24:44.613401 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.613385    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:24:44.622657 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.622635    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"]
Sep 16 18:24:44.628179 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.628160    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:44.628414 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.628396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn\" (UID: \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:44.628465 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.628430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzlvk\" (UniqueName: \"kubernetes.io/projected/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-kube-api-access-zzlvk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn\" (UID: \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:44.628511 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.628497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr2z7\" (UniqueName: \"kubernetes.io/projected/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-kube-api-access-lr2z7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb\" (UID: \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:44.628573 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.628561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb\" (UID: \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:44.628610 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.628596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn\" (UID: \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:44.628656 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.628620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb\" (UID: \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:44.628995 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.628975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb\" (UID: \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:44.629032 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.628965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb\" (UID: \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:44.635935 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.635916    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr2z7\" (UniqueName: \"kubernetes.io/projected/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-kube-api-access-lr2z7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb\" (UID: \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:44.718790 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.718759    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:44.729636 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.729607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn\" (UID: \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:44.729746 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.729657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzlvk\" (UniqueName: \"kubernetes.io/projected/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-kube-api-access-zzlvk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn\" (UID: \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:44.729746 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.729713    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfrks\" (UniqueName: \"kubernetes.io/projected/daf88019-8682-4446-a2ec-2fae83a76cc9-kube-api-access-nfrks\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss\" (UID: \"daf88019-8682-4446-a2ec-2fae83a76cc9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:24:44.729828 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.729762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daf88019-8682-4446-a2ec-2fae83a76cc9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss\" (UID: \"daf88019-8682-4446-a2ec-2fae83a76cc9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:24:44.729828 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.729793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daf88019-8682-4446-a2ec-2fae83a76cc9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss\" (UID: \"daf88019-8682-4446-a2ec-2fae83a76cc9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:24:44.729920 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.729827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn\" (UID: \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:44.730068 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.730045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn\" (UID: \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:44.730104 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.730077    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn\" (UID: \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:44.738008 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.737984    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzlvk\" (UniqueName: \"kubernetes.io/projected/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-kube-api-access-zzlvk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn\" (UID: \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:44.826838 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.826811    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:44.830661 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.830643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfrks\" (UniqueName: \"kubernetes.io/projected/daf88019-8682-4446-a2ec-2fae83a76cc9-kube-api-access-nfrks\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss\" (UID: \"daf88019-8682-4446-a2ec-2fae83a76cc9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:24:44.830719 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.830691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daf88019-8682-4446-a2ec-2fae83a76cc9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss\" (UID: \"daf88019-8682-4446-a2ec-2fae83a76cc9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:24:44.830752 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.830722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daf88019-8682-4446-a2ec-2fae83a76cc9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss\" (UID: \"daf88019-8682-4446-a2ec-2fae83a76cc9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:24:44.831158 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.831131    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daf88019-8682-4446-a2ec-2fae83a76cc9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss\" (UID: \"daf88019-8682-4446-a2ec-2fae83a76cc9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:24:44.831241 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.831139    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daf88019-8682-4446-a2ec-2fae83a76cc9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss\" (UID: \"daf88019-8682-4446-a2ec-2fae83a76cc9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:24:44.838662 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.838634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfrks\" (UniqueName: \"kubernetes.io/projected/daf88019-8682-4446-a2ec-2fae83a76cc9-kube-api-access-nfrks\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss\" (UID: \"daf88019-8682-4446-a2ec-2fae83a76cc9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:24:44.901821 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.901798    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"]
Sep 16 18:24:44.903740 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:24:44.903715    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e29149a_67b0_4513_ae6e_6b215602c7af.slice/crio-20cbde62784403588333c71f5b34603eb013703eda85c471f9a85a10b0e110af WatchSource:0}: Error finding container 20cbde62784403588333c71f5b34603eb013703eda85c471f9a85a10b0e110af: Status 404 returned error can't find the container with id 20cbde62784403588333c71f5b34603eb013703eda85c471f9a85a10b0e110af
Sep 16 18:24:44.923097 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.923077    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:24:44.955170 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.955143    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88" event={"ID":"1e29149a-67b0-4513-ae6e-6b215602c7af","Type":"ContainerStarted","Data":"20cbde62784403588333c71f5b34603eb013703eda85c471f9a85a10b0e110af"}
Sep 16 18:24:44.998840 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:44.998784    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"]
Sep 16 18:24:45.001600 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:24:45.001574    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4879f09a_cfb5_4a3e_9910_0f9d5db3f778.slice/crio-91f290f91e2c8f437df52043e0b5ec896f02b8794590f3dfe5fd81360aca7052 WatchSource:0}: Error finding container 91f290f91e2c8f437df52043e0b5ec896f02b8794590f3dfe5fd81360aca7052: Status 404 returned error can't find the container with id 91f290f91e2c8f437df52043e0b5ec896f02b8794590f3dfe5fd81360aca7052
Sep 16 18:24:45.095839 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.095812    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"]
Sep 16 18:24:45.096662 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:24:45.096632    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc3b6bd_5167_4bc1_8cd7_cb505efaae7d.slice/crio-77e377e104454a69dde1e5691be82e8254709074b9e1f1a236fed4ad8b13daea WatchSource:0}: Error finding container 77e377e104454a69dde1e5691be82e8254709074b9e1f1a236fed4ad8b13daea: Status 404 returned error can't find the container with id 77e377e104454a69dde1e5691be82e8254709074b9e1f1a236fed4ad8b13daea
Sep 16 18:24:45.199613 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.199586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"]
Sep 16 18:24:45.262331 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:24:45.262298    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf88019_8682_4446_a2ec_2fae83a76cc9.slice/crio-3b16a27b53a90b97238e42a87b65fb976f24aba53d9753ee9ca8113e8fcb9873 WatchSource:0}: Error finding container 3b16a27b53a90b97238e42a87b65fb976f24aba53d9753ee9ca8113e8fcb9873: Status 404 returned error can't find the container with id 3b16a27b53a90b97238e42a87b65fb976f24aba53d9753ee9ca8113e8fcb9873
Sep 16 18:24:45.960492 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.960461    2580 generic.go:356] "Generic (PLEG): container finished" podID="1e29149a-67b0-4513-ae6e-6b215602c7af" containerID="5ce11256673a152c768bf1acbb7c0f26397ce3a145d113315e6a72feb1f22bb7" exitCode=0
Sep 16 18:24:45.960932 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.960530    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88" event={"ID":"1e29149a-67b0-4513-ae6e-6b215602c7af","Type":"ContainerDied","Data":"5ce11256673a152c768bf1acbb7c0f26397ce3a145d113315e6a72feb1f22bb7"}
Sep 16 18:24:45.962108 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.962088    2580 generic.go:356] "Generic (PLEG): container finished" podID="daf88019-8682-4446-a2ec-2fae83a76cc9" containerID="3b8a8c14493fded12629fc919546f129e13dcce502a4c83661260ae897f8afe1" exitCode=0
Sep 16 18:24:45.962185 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.962157    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss" event={"ID":"daf88019-8682-4446-a2ec-2fae83a76cc9","Type":"ContainerDied","Data":"3b8a8c14493fded12629fc919546f129e13dcce502a4c83661260ae897f8afe1"}
Sep 16 18:24:45.962236 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.962192    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss" event={"ID":"daf88019-8682-4446-a2ec-2fae83a76cc9","Type":"ContainerStarted","Data":"3b16a27b53a90b97238e42a87b65fb976f24aba53d9753ee9ca8113e8fcb9873"}
Sep 16 18:24:45.963664 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.963638    2580 generic.go:356] "Generic (PLEG): container finished" podID="4879f09a-cfb5-4a3e-9910-0f9d5db3f778" containerID="9b493fd95f3160c528c30458a797cfa5166965b8fc9c87a43f141595231c14b8" exitCode=0
Sep 16 18:24:45.963747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.963674    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb" event={"ID":"4879f09a-cfb5-4a3e-9910-0f9d5db3f778","Type":"ContainerDied","Data":"9b493fd95f3160c528c30458a797cfa5166965b8fc9c87a43f141595231c14b8"}
Sep 16 18:24:45.963747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.963718    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb" event={"ID":"4879f09a-cfb5-4a3e-9910-0f9d5db3f778","Type":"ContainerStarted","Data":"91f290f91e2c8f437df52043e0b5ec896f02b8794590f3dfe5fd81360aca7052"}
Sep 16 18:24:45.965452 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.965434    2580 generic.go:356] "Generic (PLEG): container finished" podID="0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" containerID="975223b41a0738f2aaf06046a6ce8ae9d4a146dc5e53d0e6d8da9663a9f07399" exitCode=0
Sep 16 18:24:45.965559 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.965518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn" event={"ID":"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d","Type":"ContainerDied","Data":"975223b41a0738f2aaf06046a6ce8ae9d4a146dc5e53d0e6d8da9663a9f07399"}
Sep 16 18:24:45.965633 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:45.965565    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn" event={"ID":"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d","Type":"ContainerStarted","Data":"77e377e104454a69dde1e5691be82e8254709074b9e1f1a236fed4ad8b13daea"}
Sep 16 18:24:46.972138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:46.972073    2580 generic.go:356] "Generic (PLEG): container finished" podID="1e29149a-67b0-4513-ae6e-6b215602c7af" containerID="02ad9760969c92482eddf64e6a8fad2e785311e707ba5b8b564579fa2adfab07" exitCode=0
Sep 16 18:24:46.972486 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:46.972143    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88" event={"ID":"1e29149a-67b0-4513-ae6e-6b215602c7af","Type":"ContainerDied","Data":"02ad9760969c92482eddf64e6a8fad2e785311e707ba5b8b564579fa2adfab07"}
Sep 16 18:24:46.974076 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:46.974053    2580 generic.go:356] "Generic (PLEG): container finished" podID="4879f09a-cfb5-4a3e-9910-0f9d5db3f778" containerID="04c8b8926495ca213ab29bede4fd65a9e583d70bde68e9efe376001fbb2c0e21" exitCode=0
Sep 16 18:24:46.974185 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:46.974169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb" event={"ID":"4879f09a-cfb5-4a3e-9910-0f9d5db3f778","Type":"ContainerDied","Data":"04c8b8926495ca213ab29bede4fd65a9e583d70bde68e9efe376001fbb2c0e21"}
Sep 16 18:24:47.980579 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:47.980498    2580 generic.go:356] "Generic (PLEG): container finished" podID="1e29149a-67b0-4513-ae6e-6b215602c7af" containerID="fd78e073e65d2c65754facb741b2a7feb81486d5e6a49c7e4cb3311d1f9d3ff1" exitCode=0
Sep 16 18:24:47.980579 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:47.980567    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88" event={"ID":"1e29149a-67b0-4513-ae6e-6b215602c7af","Type":"ContainerDied","Data":"fd78e073e65d2c65754facb741b2a7feb81486d5e6a49c7e4cb3311d1f9d3ff1"}
Sep 16 18:24:47.982583 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:47.982559    2580 generic.go:356] "Generic (PLEG): container finished" podID="4879f09a-cfb5-4a3e-9910-0f9d5db3f778" containerID="b7c59e3d92eef02dd0f6e0eeafb6f3a5ea26b25778f583ecf4696ddef7ee7008" exitCode=0
Sep 16 18:24:47.982677 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:47.982634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb" event={"ID":"4879f09a-cfb5-4a3e-9910-0f9d5db3f778","Type":"ContainerDied","Data":"b7c59e3d92eef02dd0f6e0eeafb6f3a5ea26b25778f583ecf4696ddef7ee7008"}
Sep 16 18:24:47.984464 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:47.984443    2580 generic.go:356] "Generic (PLEG): container finished" podID="0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" containerID="0f7d7e5bccbcde84a2ff0b825aedf0eabaa96d9a7c85b3ac78b311211ae1df5a" exitCode=0
Sep 16 18:24:47.984543 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:47.984475    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn" event={"ID":"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d","Type":"ContainerDied","Data":"0f7d7e5bccbcde84a2ff0b825aedf0eabaa96d9a7c85b3ac78b311211ae1df5a"}
Sep 16 18:24:48.991237 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:48.991205    2580 generic.go:356] "Generic (PLEG): container finished" podID="0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" containerID="e24d71b247f8059aae5fbbef6269785e92e22b82d70bda707bad3a2d59f50473" exitCode=0
Sep 16 18:24:48.991681 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:48.991299    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn" event={"ID":"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d","Type":"ContainerDied","Data":"e24d71b247f8059aae5fbbef6269785e92e22b82d70bda707bad3a2d59f50473"}
Sep 16 18:24:49.113123 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.113100    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:49.143274 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.143252    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:49.163016 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.162994    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e29149a-67b0-4513-ae6e-6b215602c7af-util\") pod \"1e29149a-67b0-4513-ae6e-6b215602c7af\" (UID: \"1e29149a-67b0-4513-ae6e-6b215602c7af\") "
Sep 16 18:24:49.163194 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.163084    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpwmh\" (UniqueName: \"kubernetes.io/projected/1e29149a-67b0-4513-ae6e-6b215602c7af-kube-api-access-gpwmh\") pod \"1e29149a-67b0-4513-ae6e-6b215602c7af\" (UID: \"1e29149a-67b0-4513-ae6e-6b215602c7af\") "
Sep 16 18:24:49.163194 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.163137    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e29149a-67b0-4513-ae6e-6b215602c7af-bundle\") pod \"1e29149a-67b0-4513-ae6e-6b215602c7af\" (UID: \"1e29149a-67b0-4513-ae6e-6b215602c7af\") "
Sep 16 18:24:49.163618 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.163595    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e29149a-67b0-4513-ae6e-6b215602c7af-bundle" (OuterVolumeSpecName: "bundle") pod "1e29149a-67b0-4513-ae6e-6b215602c7af" (UID: "1e29149a-67b0-4513-ae6e-6b215602c7af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:24:49.165244 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.165219    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e29149a-67b0-4513-ae6e-6b215602c7af-kube-api-access-gpwmh" (OuterVolumeSpecName: "kube-api-access-gpwmh") pod "1e29149a-67b0-4513-ae6e-6b215602c7af" (UID: "1e29149a-67b0-4513-ae6e-6b215602c7af"). InnerVolumeSpecName "kube-api-access-gpwmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:24:49.168090 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.168072    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e29149a-67b0-4513-ae6e-6b215602c7af-util" (OuterVolumeSpecName: "util") pod "1e29149a-67b0-4513-ae6e-6b215602c7af" (UID: "1e29149a-67b0-4513-ae6e-6b215602c7af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:24:49.264258 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.264185    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-util\") pod \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\" (UID: \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\") "
Sep 16 18:24:49.264258 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.264243    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-bundle\") pod \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\" (UID: \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\") "
Sep 16 18:24:49.264476 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.264270    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr2z7\" (UniqueName: \"kubernetes.io/projected/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-kube-api-access-lr2z7\") pod \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\" (UID: \"4879f09a-cfb5-4a3e-9910-0f9d5db3f778\") "
Sep 16 18:24:49.264545 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.264504    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e29149a-67b0-4513-ae6e-6b215602c7af-util\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:24:49.264545 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.264523    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpwmh\" (UniqueName: \"kubernetes.io/projected/1e29149a-67b0-4513-ae6e-6b215602c7af-kube-api-access-gpwmh\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:24:49.264545 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.264535    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e29149a-67b0-4513-ae6e-6b215602c7af-bundle\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:24:49.264700 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.264677    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-bundle" (OuterVolumeSpecName: "bundle") pod "4879f09a-cfb5-4a3e-9910-0f9d5db3f778" (UID: "4879f09a-cfb5-4a3e-9910-0f9d5db3f778"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:24:49.266314 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.266294    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-kube-api-access-lr2z7" (OuterVolumeSpecName: "kube-api-access-lr2z7") pod "4879f09a-cfb5-4a3e-9910-0f9d5db3f778" (UID: "4879f09a-cfb5-4a3e-9910-0f9d5db3f778"). InnerVolumeSpecName "kube-api-access-lr2z7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:24:49.269635 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.269610    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-util" (OuterVolumeSpecName: "util") pod "4879f09a-cfb5-4a3e-9910-0f9d5db3f778" (UID: "4879f09a-cfb5-4a3e-9910-0f9d5db3f778"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:24:49.365399 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.365354    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-bundle\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:24:49.365504 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.365407    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr2z7\" (UniqueName: \"kubernetes.io/projected/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-kube-api-access-lr2z7\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:24:49.365504 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.365434    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4879f09a-cfb5-4a3e-9910-0f9d5db3f778-util\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:24:49.997691 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.997667    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88"
Sep 16 18:24:49.998124 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.997668    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wtm88" event={"ID":"1e29149a-67b0-4513-ae6e-6b215602c7af","Type":"ContainerDied","Data":"20cbde62784403588333c71f5b34603eb013703eda85c471f9a85a10b0e110af"}
Sep 16 18:24:49.998124 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.997805    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20cbde62784403588333c71f5b34603eb013703eda85c471f9a85a10b0e110af"
Sep 16 18:24:49.999866 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.999847    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb"
Sep 16 18:24:49.999990 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.999877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6djhdb" event={"ID":"4879f09a-cfb5-4a3e-9910-0f9d5db3f778","Type":"ContainerDied","Data":"91f290f91e2c8f437df52043e0b5ec896f02b8794590f3dfe5fd81360aca7052"}
Sep 16 18:24:49.999990 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:49.999914    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91f290f91e2c8f437df52043e0b5ec896f02b8794590f3dfe5fd81360aca7052"
Sep 16 18:24:50.119463 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:50.119440    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:50.171621 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:50.171557    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-bundle\") pod \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\" (UID: \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\") "
Sep 16 18:24:50.171621 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:50.171590    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-util\") pod \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\" (UID: \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\") "
Sep 16 18:24:50.171797 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:50.171687    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzlvk\" (UniqueName: \"kubernetes.io/projected/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-kube-api-access-zzlvk\") pod \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\" (UID: \"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d\") "
Sep 16 18:24:50.172215 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:50.172189    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-bundle" (OuterVolumeSpecName: "bundle") pod "0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" (UID: "0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:24:50.173658 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:50.173635    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-kube-api-access-zzlvk" (OuterVolumeSpecName: "kube-api-access-zzlvk") pod "0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" (UID: "0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d"). InnerVolumeSpecName "kube-api-access-zzlvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:24:50.176451 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:50.176417    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-util" (OuterVolumeSpecName: "util") pod "0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" (UID: "0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:24:50.272881 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:50.272849    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-bundle\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:24:50.272881 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:50.272876    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-util\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:24:50.272881 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:50.272885    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzlvk\" (UniqueName: \"kubernetes.io/projected/0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d-kube-api-access-zzlvk\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:24:51.006155 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:51.006130    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn"
Sep 16 18:24:51.006155 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:51.006148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agw7bn" event={"ID":"0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d","Type":"ContainerDied","Data":"77e377e104454a69dde1e5691be82e8254709074b9e1f1a236fed4ad8b13daea"}
Sep 16 18:24:51.006574 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:51.006191    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77e377e104454a69dde1e5691be82e8254709074b9e1f1a236fed4ad8b13daea"
Sep 16 18:24:54.020804 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:54.020717    2580 generic.go:356] "Generic (PLEG): container finished" podID="daf88019-8682-4446-a2ec-2fae83a76cc9" containerID="6e5884707304d13aa6c4c09891917c86a25a9c454862a93a3e1410faf56cc7af" exitCode=0
Sep 16 18:24:54.021154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:54.020799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss" event={"ID":"daf88019-8682-4446-a2ec-2fae83a76cc9","Type":"ContainerDied","Data":"6e5884707304d13aa6c4c09891917c86a25a9c454862a93a3e1410faf56cc7af"}
Sep 16 18:24:55.027175 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:55.027142    2580 generic.go:356] "Generic (PLEG): container finished" podID="daf88019-8682-4446-a2ec-2fae83a76cc9" containerID="6362654034c1653394962de8f7310a03d7cae2f29560f96c78162273244d4e45" exitCode=0
Sep 16 18:24:55.027609 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:55.027261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss" event={"ID":"daf88019-8682-4446-a2ec-2fae83a76cc9","Type":"ContainerDied","Data":"6362654034c1653394962de8f7310a03d7cae2f29560f96c78162273244d4e45"}
Sep 16 18:24:56.156443 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:56.156420    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:24:56.216052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:56.216023    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfrks\" (UniqueName: \"kubernetes.io/projected/daf88019-8682-4446-a2ec-2fae83a76cc9-kube-api-access-nfrks\") pod \"daf88019-8682-4446-a2ec-2fae83a76cc9\" (UID: \"daf88019-8682-4446-a2ec-2fae83a76cc9\") "
Sep 16 18:24:56.216222 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:56.216095    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daf88019-8682-4446-a2ec-2fae83a76cc9-util\") pod \"daf88019-8682-4446-a2ec-2fae83a76cc9\" (UID: \"daf88019-8682-4446-a2ec-2fae83a76cc9\") "
Sep 16 18:24:56.216222 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:56.216195    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daf88019-8682-4446-a2ec-2fae83a76cc9-bundle\") pod \"daf88019-8682-4446-a2ec-2fae83a76cc9\" (UID: \"daf88019-8682-4446-a2ec-2fae83a76cc9\") "
Sep 16 18:24:56.216718 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:56.216683    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daf88019-8682-4446-a2ec-2fae83a76cc9-bundle" (OuterVolumeSpecName: "bundle") pod "daf88019-8682-4446-a2ec-2fae83a76cc9" (UID: "daf88019-8682-4446-a2ec-2fae83a76cc9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:24:56.218131 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:56.218107    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daf88019-8682-4446-a2ec-2fae83a76cc9-kube-api-access-nfrks" (OuterVolumeSpecName: "kube-api-access-nfrks") pod "daf88019-8682-4446-a2ec-2fae83a76cc9" (UID: "daf88019-8682-4446-a2ec-2fae83a76cc9"). InnerVolumeSpecName "kube-api-access-nfrks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:24:56.220657 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:56.220613    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daf88019-8682-4446-a2ec-2fae83a76cc9-util" (OuterVolumeSpecName: "util") pod "daf88019-8682-4446-a2ec-2fae83a76cc9" (UID: "daf88019-8682-4446-a2ec-2fae83a76cc9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:24:56.317783 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:56.317707    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daf88019-8682-4446-a2ec-2fae83a76cc9-util\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:24:56.317783 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:56.317731    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daf88019-8682-4446-a2ec-2fae83a76cc9-bundle\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:24:56.317783 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:56.317742    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfrks\" (UniqueName: \"kubernetes.io/projected/daf88019-8682-4446-a2ec-2fae83a76cc9-kube-api-access-nfrks\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:24:57.037471 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:57.037440    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss" event={"ID":"daf88019-8682-4446-a2ec-2fae83a76cc9","Type":"ContainerDied","Data":"3b16a27b53a90b97238e42a87b65fb976f24aba53d9753ee9ca8113e8fcb9873"}
Sep 16 18:24:57.037609 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:57.037484    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b16a27b53a90b97238e42a87b65fb976f24aba53d9753ee9ca8113e8fcb9873"
Sep 16 18:24:57.037609 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:24:57.037489    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crzfss"
Sep 16 18:25:03.396434 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396398    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-sldz6"]
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396670    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4879f09a-cfb5-4a3e-9910-0f9d5db3f778" containerName="extract"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396682    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4879f09a-cfb5-4a3e-9910-0f9d5db3f778" containerName="extract"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396691    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" containerName="util"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396696    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" containerName="util"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396703    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e29149a-67b0-4513-ae6e-6b215602c7af" containerName="util"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396708    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e29149a-67b0-4513-ae6e-6b215602c7af" containerName="util"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396717    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e29149a-67b0-4513-ae6e-6b215602c7af" containerName="extract"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396723    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e29149a-67b0-4513-ae6e-6b215602c7af" containerName="extract"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396729    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" containerName="extract"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396734    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" containerName="extract"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396740    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daf88019-8682-4446-a2ec-2fae83a76cc9" containerName="pull"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396745    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="daf88019-8682-4446-a2ec-2fae83a76cc9" containerName="pull"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396759    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" containerName="pull"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396764    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" containerName="pull"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396787    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daf88019-8682-4446-a2ec-2fae83a76cc9" containerName="util"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396792    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="daf88019-8682-4446-a2ec-2fae83a76cc9" containerName="util"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396799    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4879f09a-cfb5-4a3e-9910-0f9d5db3f778" containerName="util"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396805    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4879f09a-cfb5-4a3e-9910-0f9d5db3f778" containerName="util"
Sep 16 18:25:03.396800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396810    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e29149a-67b0-4513-ae6e-6b215602c7af" containerName="pull"
Sep 16 18:25:03.397360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396815    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e29149a-67b0-4513-ae6e-6b215602c7af" containerName="pull"
Sep 16 18:25:03.397360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396821    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daf88019-8682-4446-a2ec-2fae83a76cc9" containerName="extract"
Sep 16 18:25:03.397360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396826    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="daf88019-8682-4446-a2ec-2fae83a76cc9" containerName="extract"
Sep 16 18:25:03.397360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396832    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4879f09a-cfb5-4a3e-9910-0f9d5db3f778" containerName="pull"
Sep 16 18:25:03.397360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396837    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4879f09a-cfb5-4a3e-9910-0f9d5db3f778" containerName="pull"
Sep 16 18:25:03.397360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396882    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="daf88019-8682-4446-a2ec-2fae83a76cc9" containerName="extract"
Sep 16 18:25:03.397360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396889    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e29149a-67b0-4513-ae6e-6b215602c7af" containerName="extract"
Sep 16 18:25:03.397360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396894    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fc3b6bd-5167-4bc1-8cd7-cb505efaae7d" containerName="extract"
Sep 16 18:25:03.397360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.396900    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4879f09a-cfb5-4a3e-9910-0f9d5db3f778" containerName="extract"
Sep 16 18:25:03.400500 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.400485    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-sldz6"
Sep 16 18:25:03.403029 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.403006    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 18:25:03.403138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.403040    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 18:25:03.403138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.403050    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-sxnjz\""
Sep 16 18:25:03.410614 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.410596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-sldz6"]
Sep 16 18:25:03.473137 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.473107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kr9d\" (UniqueName: \"kubernetes.io/projected/f86ca5fc-24df-473e-a5e7-05b4333477ed-kube-api-access-4kr9d\") pod \"authorino-operator-76b478bd78-sldz6\" (UID: \"f86ca5fc-24df-473e-a5e7-05b4333477ed\") " pod="kuadrant-system/authorino-operator-76b478bd78-sldz6"
Sep 16 18:25:03.574218 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.574182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kr9d\" (UniqueName: \"kubernetes.io/projected/f86ca5fc-24df-473e-a5e7-05b4333477ed-kube-api-access-4kr9d\") pod \"authorino-operator-76b478bd78-sldz6\" (UID: \"f86ca5fc-24df-473e-a5e7-05b4333477ed\") " pod="kuadrant-system/authorino-operator-76b478bd78-sldz6"
Sep 16 18:25:03.586419 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.586361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kr9d\" (UniqueName: \"kubernetes.io/projected/f86ca5fc-24df-473e-a5e7-05b4333477ed-kube-api-access-4kr9d\") pod \"authorino-operator-76b478bd78-sldz6\" (UID: \"f86ca5fc-24df-473e-a5e7-05b4333477ed\") " pod="kuadrant-system/authorino-operator-76b478bd78-sldz6"
Sep 16 18:25:03.710141 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.710055    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-sldz6"
Sep 16 18:25:03.994183 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:03.994108    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-sldz6"]
Sep 16 18:25:03.997277 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:25:03.997078    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf86ca5fc_24df_473e_a5e7_05b4333477ed.slice/crio-ecb40451fb924fe39593f62381bc6c9f54f7b2105c940b2264b58d60da24efc3 WatchSource:0}: Error finding container ecb40451fb924fe39593f62381bc6c9f54f7b2105c940b2264b58d60da24efc3: Status 404 returned error can't find the container with id ecb40451fb924fe39593f62381bc6c9f54f7b2105c940b2264b58d60da24efc3
Sep 16 18:25:04.068737 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:04.068707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-sldz6" event={"ID":"f86ca5fc-24df-473e-a5e7-05b4333477ed","Type":"ContainerStarted","Data":"ecb40451fb924fe39593f62381bc6c9f54f7b2105c940b2264b58d60da24efc3"}
Sep 16 18:25:07.086338 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:07.086294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-sldz6" event={"ID":"f86ca5fc-24df-473e-a5e7-05b4333477ed","Type":"ContainerStarted","Data":"ca0d035eda8e862a3955c6832f9f8e7ef08b35a1b87f1c186a812f00df4159d3"}
Sep 16 18:25:07.086704 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:07.086363    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-sldz6"
Sep 16 18:25:07.106399 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:07.106343    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-sldz6" podStartSLOduration=1.778914592 podStartE2EDuration="4.106328853s" totalImagesPullingTime="2.327414261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:25:07.104343546 +0000 UTC m=+525.747369598" watchObservedRunningTime="2026-09-16 18:25:07.106328853 +0000 UTC m=+525.749354892"
Sep 16 18:25:09.904996 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:09.904960    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"]
Sep 16 18:25:09.908158 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:09.908141    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:09.910964 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:09.910947    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-htwhb\""
Sep 16 18:25:09.921052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:09.921027    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"]
Sep 16 18:25:10.027026 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:10.026998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5lfj\" (UniqueName: \"kubernetes.io/projected/e2a0a4aa-084f-438e-a6fa-9c3233212eef-kube-api-access-h5lfj\") pod \"limitador-operator-controller-manager-74495c69f8-ssvns\" (UID: \"e2a0a4aa-084f-438e-a6fa-9c3233212eef\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:10.127360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:10.127326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5lfj\" (UniqueName: \"kubernetes.io/projected/e2a0a4aa-084f-438e-a6fa-9c3233212eef-kube-api-access-h5lfj\") pod \"limitador-operator-controller-manager-74495c69f8-ssvns\" (UID: \"e2a0a4aa-084f-438e-a6fa-9c3233212eef\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:10.140756 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:10.140729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5lfj\" (UniqueName: \"kubernetes.io/projected/e2a0a4aa-084f-438e-a6fa-9c3233212eef-kube-api-access-h5lfj\") pod \"limitador-operator-controller-manager-74495c69f8-ssvns\" (UID: \"e2a0a4aa-084f-438e-a6fa-9c3233212eef\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:10.217905 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:10.217845    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:10.494702 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:10.494680    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"]
Sep 16 18:25:10.496543 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:25:10.496515    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a0a4aa_084f_438e_a6fa_9c3233212eef.slice/crio-6774c24e24be251ef588231c71e19e9dac864ff040d4b89c43c88a09c18a73b4 WatchSource:0}: Error finding container 6774c24e24be251ef588231c71e19e9dac864ff040d4b89c43c88a09c18a73b4: Status 404 returned error can't find the container with id 6774c24e24be251ef588231c71e19e9dac864ff040d4b89c43c88a09c18a73b4
Sep 16 18:25:11.108095 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:11.108060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns" event={"ID":"e2a0a4aa-084f-438e-a6fa-9c3233212eef","Type":"ContainerStarted","Data":"6774c24e24be251ef588231c71e19e9dac864ff040d4b89c43c88a09c18a73b4"}
Sep 16 18:25:13.120383 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:13.120335    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns" event={"ID":"e2a0a4aa-084f-438e-a6fa-9c3233212eef","Type":"ContainerStarted","Data":"61a2816246e25163545d55bd000f6e3647aca81db6acc342b397130591deb427"}
Sep 16 18:25:13.120821 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:13.120471    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:13.143913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:13.143863    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns" podStartSLOduration=2.187776568 podStartE2EDuration="4.143849161s" totalImagesPullingTime="1.956072593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:25:13.142035178 +0000 UTC m=+531.785061218" watchObservedRunningTime="2026-09-16 18:25:13.143849161 +0000 UTC m=+531.786875200"
Sep 16 18:25:18.093944 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:18.093867    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-sldz6"
Sep 16 18:25:24.127857 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:24.127827    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:31.505284 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:31.505252    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"]
Sep 16 18:25:31.509951 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:31.509930    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:31.512216 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:31.512200    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6bv26\""
Sep 16 18:25:31.523141 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:31.523115    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"]
Sep 16 18:25:31.597797 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:31.597763    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77fe8c9c-504e-4438-b5b3-647ab734622a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-2r6mt\" (UID: \"77fe8c9c-504e-4438-b5b3-647ab734622a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:31.597946 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:31.597833    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g9vp\" (UniqueName: \"kubernetes.io/projected/77fe8c9c-504e-4438-b5b3-647ab734622a-kube-api-access-5g9vp\") pod \"kuadrant-operator-controller-manager-5f685c496f-2r6mt\" (UID: \"77fe8c9c-504e-4438-b5b3-647ab734622a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:31.698579 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:31.698550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g9vp\" (UniqueName: \"kubernetes.io/projected/77fe8c9c-504e-4438-b5b3-647ab734622a-kube-api-access-5g9vp\") pod \"kuadrant-operator-controller-manager-5f685c496f-2r6mt\" (UID: \"77fe8c9c-504e-4438-b5b3-647ab734622a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:31.698686 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:31.698606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77fe8c9c-504e-4438-b5b3-647ab734622a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-2r6mt\" (UID: \"77fe8c9c-504e-4438-b5b3-647ab734622a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:31.698949 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:31.698931    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77fe8c9c-504e-4438-b5b3-647ab734622a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-2r6mt\" (UID: \"77fe8c9c-504e-4438-b5b3-647ab734622a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:31.716205 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:31.716183    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g9vp\" (UniqueName: \"kubernetes.io/projected/77fe8c9c-504e-4438-b5b3-647ab734622a-kube-api-access-5g9vp\") pod \"kuadrant-operator-controller-manager-5f685c496f-2r6mt\" (UID: \"77fe8c9c-504e-4438-b5b3-647ab734622a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:31.819016 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:31.818934    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:32.096161 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.095996    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"]
Sep 16 18:25:32.098436 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:25:32.098412    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77fe8c9c_504e_4438_b5b3_647ab734622a.slice/crio-80e63f2952c48d02e13c9069585067ae672e09ce8cf70cd3773f35117543e49f WatchSource:0}: Error finding container 80e63f2952c48d02e13c9069585067ae672e09ce8cf70cd3773f35117543e49f: Status 404 returned error can't find the container with id 80e63f2952c48d02e13c9069585067ae672e09ce8cf70cd3773f35117543e49f
Sep 16 18:25:32.209435 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.209407    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt" event={"ID":"77fe8c9c-504e-4438-b5b3-647ab734622a","Type":"ContainerStarted","Data":"80e63f2952c48d02e13c9069585067ae672e09ce8cf70cd3773f35117543e49f"}
Sep 16 18:25:32.300314 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.300274    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"]
Sep 16 18:25:32.303250 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.303224    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"]
Sep 16 18:25:32.325821 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.325798    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"]
Sep 16 18:25:32.330278 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.330259    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"
Sep 16 18:25:32.344690 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.344668    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"]
Sep 16 18:25:32.377212 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.377141    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"]
Sep 16 18:25:32.377417 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.377390    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns" podUID="e2a0a4aa-084f-438e-a6fa-9c3233212eef" containerName="manager" containerID="cri-o://61a2816246e25163545d55bd000f6e3647aca81db6acc342b397130591deb427" gracePeriod=2
Sep 16 18:25:32.389565 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.388353    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"]
Sep 16 18:25:32.408994 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.408969    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4"]
Sep 16 18:25:32.409276 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.409264    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2a0a4aa-084f-438e-a6fa-9c3233212eef" containerName="manager"
Sep 16 18:25:32.409320 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.409277    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a0a4aa-084f-438e-a6fa-9c3233212eef" containerName="manager"
Sep 16 18:25:32.409359 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.409330    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2a0a4aa-084f-438e-a6fa-9c3233212eef" containerName="manager"
Sep 16 18:25:32.412251 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.412235    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4"
Sep 16 18:25:32.414831 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:25:32.414801    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ssvns\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="e2a0a4aa-084f-438e-a6fa-9c3233212eef" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:32.430445 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.430424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4"]
Sep 16 18:25:32.505682 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.505652    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c91f3c79-7df3-4bff-8b8c-6f19ae34da67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-bj6zr\" (UID: \"c91f3c79-7df3-4bff-8b8c-6f19ae34da67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"
Sep 16 18:25:32.506007 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.505716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9fkt\" (UniqueName: \"kubernetes.io/projected/c91f3c79-7df3-4bff-8b8c-6f19ae34da67-kube-api-access-d9fkt\") pod \"kuadrant-operator-controller-manager-5f685c496f-bj6zr\" (UID: \"c91f3c79-7df3-4bff-8b8c-6f19ae34da67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"
Sep 16 18:25:32.506007 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.505762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5ssn\" (UniqueName: \"kubernetes.io/projected/55fe1f9f-d650-4d58-88e2-dfcd09b50818-kube-api-access-m5ssn\") pod \"limitador-operator-controller-manager-74495c69f8-529z4\" (UID: \"55fe1f9f-d650-4d58-88e2-dfcd09b50818\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4"
Sep 16 18:25:32.606504 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.606462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5ssn\" (UniqueName: \"kubernetes.io/projected/55fe1f9f-d650-4d58-88e2-dfcd09b50818-kube-api-access-m5ssn\") pod \"limitador-operator-controller-manager-74495c69f8-529z4\" (UID: \"55fe1f9f-d650-4d58-88e2-dfcd09b50818\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4"
Sep 16 18:25:32.606652 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.606557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c91f3c79-7df3-4bff-8b8c-6f19ae34da67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-bj6zr\" (UID: \"c91f3c79-7df3-4bff-8b8c-6f19ae34da67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"
Sep 16 18:25:32.606652 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.606596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9fkt\" (UniqueName: \"kubernetes.io/projected/c91f3c79-7df3-4bff-8b8c-6f19ae34da67-kube-api-access-d9fkt\") pod \"kuadrant-operator-controller-manager-5f685c496f-bj6zr\" (UID: \"c91f3c79-7df3-4bff-8b8c-6f19ae34da67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"
Sep 16 18:25:32.607148 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.607125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c91f3c79-7df3-4bff-8b8c-6f19ae34da67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-bj6zr\" (UID: \"c91f3c79-7df3-4bff-8b8c-6f19ae34da67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"
Sep 16 18:25:32.612581 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.612558    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:32.614769 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:25:32.614719    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ssvns\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="e2a0a4aa-084f-438e-a6fa-9c3233212eef" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:32.615931 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.615913    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5ssn\" (UniqueName: \"kubernetes.io/projected/55fe1f9f-d650-4d58-88e2-dfcd09b50818-kube-api-access-m5ssn\") pod \"limitador-operator-controller-manager-74495c69f8-529z4\" (UID: \"55fe1f9f-d650-4d58-88e2-dfcd09b50818\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4"
Sep 16 18:25:32.616818 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.616795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9fkt\" (UniqueName: \"kubernetes.io/projected/c91f3c79-7df3-4bff-8b8c-6f19ae34da67-kube-api-access-d9fkt\") pod \"kuadrant-operator-controller-manager-5f685c496f-bj6zr\" (UID: \"c91f3c79-7df3-4bff-8b8c-6f19ae34da67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"
Sep 16 18:25:32.640576 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.640520    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"
Sep 16 18:25:32.707966 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.707935    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5lfj\" (UniqueName: \"kubernetes.io/projected/e2a0a4aa-084f-438e-a6fa-9c3233212eef-kube-api-access-h5lfj\") pod \"e2a0a4aa-084f-438e-a6fa-9c3233212eef\" (UID: \"e2a0a4aa-084f-438e-a6fa-9c3233212eef\") "
Sep 16 18:25:32.711853 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.711823    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2a0a4aa-084f-438e-a6fa-9c3233212eef-kube-api-access-h5lfj" (OuterVolumeSpecName: "kube-api-access-h5lfj") pod "e2a0a4aa-084f-438e-a6fa-9c3233212eef" (UID: "e2a0a4aa-084f-438e-a6fa-9c3233212eef"). InnerVolumeSpecName "kube-api-access-h5lfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:25:32.758447 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.758422    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4"
Sep 16 18:25:32.808879 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.808840    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5lfj\" (UniqueName: \"kubernetes.io/projected/e2a0a4aa-084f-438e-a6fa-9c3233212eef-kube-api-access-h5lfj\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:25:32.927282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:32.927253    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"]
Sep 16 18:25:32.928850 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:25:32.928825    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91f3c79_7df3_4bff_8b8c_6f19ae34da67.slice/crio-03fcce23b0d703b000c576a8e61ad0da84472ea354a6bfd188aabf4dbf6b4af3 WatchSource:0}: Error finding container 03fcce23b0d703b000c576a8e61ad0da84472ea354a6bfd188aabf4dbf6b4af3: Status 404 returned error can't find the container with id 03fcce23b0d703b000c576a8e61ad0da84472ea354a6bfd188aabf4dbf6b4af3
Sep 16 18:25:33.049130 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:33.049089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4"]
Sep 16 18:25:33.052223 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:25:33.052190    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55fe1f9f_d650_4d58_88e2_dfcd09b50818.slice/crio-594f2d09d9d105bba4f51e3db11ecffbffc65d890fdeb0028a52b9ca53125737 WatchSource:0}: Error finding container 594f2d09d9d105bba4f51e3db11ecffbffc65d890fdeb0028a52b9ca53125737: Status 404 returned error can't find the container with id 594f2d09d9d105bba4f51e3db11ecffbffc65d890fdeb0028a52b9ca53125737
Sep 16 18:25:33.218029 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:33.217939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr" event={"ID":"c91f3c79-7df3-4bff-8b8c-6f19ae34da67","Type":"ContainerStarted","Data":"03fcce23b0d703b000c576a8e61ad0da84472ea354a6bfd188aabf4dbf6b4af3"}
Sep 16 18:25:33.219599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:33.219569    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2a0a4aa-084f-438e-a6fa-9c3233212eef" containerID="61a2816246e25163545d55bd000f6e3647aca81db6acc342b397130591deb427" exitCode=0
Sep 16 18:25:33.219752 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:33.219620    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:33.219752 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:33.219673    2580 scope.go:117] "RemoveContainer" containerID="61a2816246e25163545d55bd000f6e3647aca81db6acc342b397130591deb427"
Sep 16 18:25:33.222084 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:33.221993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4" event={"ID":"55fe1f9f-d650-4d58-88e2-dfcd09b50818","Type":"ContainerStarted","Data":"3105acc22b7b247730a335096cfa458cdf8192024ac5ce059da2fa9899659997"}
Sep 16 18:25:33.222084 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:33.222049    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4" event={"ID":"55fe1f9f-d650-4d58-88e2-dfcd09b50818","Type":"ContainerStarted","Data":"594f2d09d9d105bba4f51e3db11ecffbffc65d890fdeb0028a52b9ca53125737"}
Sep 16 18:25:33.222257 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:33.222130    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4"
Sep 16 18:25:33.222464 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:25:33.222435    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ssvns\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="e2a0a4aa-084f-438e-a6fa-9c3233212eef" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:33.224581 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:25:33.224554    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ssvns\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="e2a0a4aa-084f-438e-a6fa-9c3233212eef" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:33.234895 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:33.234876    2580 scope.go:117] "RemoveContainer" containerID="61a2816246e25163545d55bd000f6e3647aca81db6acc342b397130591deb427"
Sep 16 18:25:33.235226 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:25:33.235201    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61a2816246e25163545d55bd000f6e3647aca81db6acc342b397130591deb427\": container with ID starting with 61a2816246e25163545d55bd000f6e3647aca81db6acc342b397130591deb427 not found: ID does not exist" containerID="61a2816246e25163545d55bd000f6e3647aca81db6acc342b397130591deb427"
Sep 16 18:25:33.235305 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:33.235240    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a2816246e25163545d55bd000f6e3647aca81db6acc342b397130591deb427"} err="failed to get container status \"61a2816246e25163545d55bd000f6e3647aca81db6acc342b397130591deb427\": rpc error: code = NotFound desc = could not find container \"61a2816246e25163545d55bd000f6e3647aca81db6acc342b397130591deb427\": container with ID starting with 61a2816246e25163545d55bd000f6e3647aca81db6acc342b397130591deb427 not found: ID does not exist"
Sep 16 18:25:33.249753 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:33.249667    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4" podStartSLOduration=1.249650029 podStartE2EDuration="1.249650029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:25:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:25:33.249193892 +0000 UTC m=+551.892219934" watchObservedRunningTime="2026-09-16 18:25:33.249650029 +0000 UTC m=+551.892676070"
Sep 16 18:25:33.251171 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:25:33.251145    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ssvns\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="e2a0a4aa-084f-438e-a6fa-9c3233212eef" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssvns"
Sep 16 18:25:33.870215 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:33.870178    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2a0a4aa-084f-438e-a6fa-9c3233212eef" path="/var/lib/kubelet/pods/e2a0a4aa-084f-438e-a6fa-9c3233212eef/volumes"
Sep 16 18:25:36.246745 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:36.246713    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr" event={"ID":"c91f3c79-7df3-4bff-8b8c-6f19ae34da67","Type":"ContainerStarted","Data":"8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454"}
Sep 16 18:25:36.247165 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:36.246779    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"
Sep 16 18:25:36.248340 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:36.248316    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt" podUID="77fe8c9c-504e-4438-b5b3-647ab734622a" containerName="manager" containerID="cri-o://7f41a8abfee0b028ebdd0b4aaf16682991468c7169e79e6778e62ea8ec4a50b2" gracePeriod=2
Sep 16 18:25:36.280966 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:36.280926    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr" podStartSLOduration=1.414319037 podStartE2EDuration="4.2809113s" totalImagesPullingTime="2.866592263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:25:36.279439576 +0000 UTC m=+554.922465615" watchObservedRunningTime="2026-09-16 18:25:36.2809113 +0000 UTC m=+554.923937340"
Sep 16 18:25:36.482044 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:36.482016    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:36.484134 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:25:36.484108    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-2r6mt\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="77fe8c9c-504e-4438-b5b3-647ab734622a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:36.645356 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:36.645320    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77fe8c9c-504e-4438-b5b3-647ab734622a-extensions-socket-volume\") pod \"77fe8c9c-504e-4438-b5b3-647ab734622a\" (UID: \"77fe8c9c-504e-4438-b5b3-647ab734622a\") "
Sep 16 18:25:36.645356 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:36.645356    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g9vp\" (UniqueName: \"kubernetes.io/projected/77fe8c9c-504e-4438-b5b3-647ab734622a-kube-api-access-5g9vp\") pod \"77fe8c9c-504e-4438-b5b3-647ab734622a\" (UID: \"77fe8c9c-504e-4438-b5b3-647ab734622a\") "
Sep 16 18:25:36.645675 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:36.645619    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77fe8c9c-504e-4438-b5b3-647ab734622a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "77fe8c9c-504e-4438-b5b3-647ab734622a" (UID: "77fe8c9c-504e-4438-b5b3-647ab734622a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:25:36.647423 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:36.647405    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77fe8c9c-504e-4438-b5b3-647ab734622a-kube-api-access-5g9vp" (OuterVolumeSpecName: "kube-api-access-5g9vp") pod "77fe8c9c-504e-4438-b5b3-647ab734622a" (UID: "77fe8c9c-504e-4438-b5b3-647ab734622a"). InnerVolumeSpecName "kube-api-access-5g9vp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:25:36.746059 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:36.746026    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77fe8c9c-504e-4438-b5b3-647ab734622a-extensions-socket-volume\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:25:36.746059 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:36.746052    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g9vp\" (UniqueName: \"kubernetes.io/projected/77fe8c9c-504e-4438-b5b3-647ab734622a-kube-api-access-5g9vp\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:25:37.254554 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:37.254522    2580 generic.go:356] "Generic (PLEG): container finished" podID="77fe8c9c-504e-4438-b5b3-647ab734622a" containerID="7f41a8abfee0b028ebdd0b4aaf16682991468c7169e79e6778e62ea8ec4a50b2" exitCode=2
Sep 16 18:25:37.254934 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:37.254574    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:37.254934 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:37.254620    2580 scope.go:117] "RemoveContainer" containerID="7f41a8abfee0b028ebdd0b4aaf16682991468c7169e79e6778e62ea8ec4a50b2"
Sep 16 18:25:37.256969 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:25:37.256943    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-2r6mt\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="77fe8c9c-504e-4438-b5b3-647ab734622a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:37.263065 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:37.263048    2580 scope.go:117] "RemoveContainer" containerID="7f41a8abfee0b028ebdd0b4aaf16682991468c7169e79e6778e62ea8ec4a50b2"
Sep 16 18:25:37.263317 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:25:37.263300    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f41a8abfee0b028ebdd0b4aaf16682991468c7169e79e6778e62ea8ec4a50b2\": container with ID starting with 7f41a8abfee0b028ebdd0b4aaf16682991468c7169e79e6778e62ea8ec4a50b2 not found: ID does not exist" containerID="7f41a8abfee0b028ebdd0b4aaf16682991468c7169e79e6778e62ea8ec4a50b2"
Sep 16 18:25:37.263384 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:37.263324    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f41a8abfee0b028ebdd0b4aaf16682991468c7169e79e6778e62ea8ec4a50b2"} err="failed to get container status \"7f41a8abfee0b028ebdd0b4aaf16682991468c7169e79e6778e62ea8ec4a50b2\": rpc error: code = NotFound desc = could not find container \"7f41a8abfee0b028ebdd0b4aaf16682991468c7169e79e6778e62ea8ec4a50b2\": container with ID starting with 7f41a8abfee0b028ebdd0b4aaf16682991468c7169e79e6778e62ea8ec4a50b2 not found: ID does not exist"
Sep 16 18:25:37.264083 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:25:37.264065    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-2r6mt\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="77fe8c9c-504e-4438-b5b3-647ab734622a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2r6mt"
Sep 16 18:25:37.865904 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:37.865872    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77fe8c9c-504e-4438-b5b3-647ab734622a" path="/var/lib/kubelet/pods/77fe8c9c-504e-4438-b5b3-647ab734622a/volumes"
Sep 16 18:25:44.234914 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:44.234880    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-529z4"
Sep 16 18:25:47.257096 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:47.257066    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"
Sep 16 18:25:59.423230 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:59.423196    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"]
Sep 16 18:25:59.423720 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:59.423458    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr" podUID="c91f3c79-7df3-4bff-8b8c-6f19ae34da67" containerName="manager" containerID="cri-o://8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454" gracePeriod=10
Sep 16 18:25:59.665765 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:59.665744    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"
Sep 16 18:25:59.719354 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:59.719296    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9fkt\" (UniqueName: \"kubernetes.io/projected/c91f3c79-7df3-4bff-8b8c-6f19ae34da67-kube-api-access-d9fkt\") pod \"c91f3c79-7df3-4bff-8b8c-6f19ae34da67\" (UID: \"c91f3c79-7df3-4bff-8b8c-6f19ae34da67\") "
Sep 16 18:25:59.719354 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:59.719345    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c91f3c79-7df3-4bff-8b8c-6f19ae34da67-extensions-socket-volume\") pod \"c91f3c79-7df3-4bff-8b8c-6f19ae34da67\" (UID: \"c91f3c79-7df3-4bff-8b8c-6f19ae34da67\") "
Sep 16 18:25:59.719844 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:59.719815    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c91f3c79-7df3-4bff-8b8c-6f19ae34da67-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c91f3c79-7df3-4bff-8b8c-6f19ae34da67" (UID: "c91f3c79-7df3-4bff-8b8c-6f19ae34da67"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:25:59.721241 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:59.721217    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c91f3c79-7df3-4bff-8b8c-6f19ae34da67-kube-api-access-d9fkt" (OuterVolumeSpecName: "kube-api-access-d9fkt") pod "c91f3c79-7df3-4bff-8b8c-6f19ae34da67" (UID: "c91f3c79-7df3-4bff-8b8c-6f19ae34da67"). InnerVolumeSpecName "kube-api-access-d9fkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:25:59.820486 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:59.820457    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c91f3c79-7df3-4bff-8b8c-6f19ae34da67-extensions-socket-volume\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:25:59.820486 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:25:59.820488    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9fkt\" (UniqueName: \"kubernetes.io/projected/c91f3c79-7df3-4bff-8b8c-6f19ae34da67-kube-api-access-d9fkt\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:26:00.376483 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:00.376450    2580 generic.go:356] "Generic (PLEG): container finished" podID="c91f3c79-7df3-4bff-8b8c-6f19ae34da67" containerID="8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454" exitCode=0
Sep 16 18:26:00.376673 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:00.376491    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"
Sep 16 18:26:00.376673 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:00.376500    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr" event={"ID":"c91f3c79-7df3-4bff-8b8c-6f19ae34da67","Type":"ContainerDied","Data":"8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454"}
Sep 16 18:26:00.376673 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:00.376547    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr" event={"ID":"c91f3c79-7df3-4bff-8b8c-6f19ae34da67","Type":"ContainerDied","Data":"03fcce23b0d703b000c576a8e61ad0da84472ea354a6bfd188aabf4dbf6b4af3"}
Sep 16 18:26:00.376673 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:00.376569    2580 scope.go:117] "RemoveContainer" containerID="8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454"
Sep 16 18:26:00.387113 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:00.387093    2580 scope.go:117] "RemoveContainer" containerID="8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454"
Sep 16 18:26:00.387414 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:26:00.387349    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454\": container with ID starting with 8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454 not found: ID does not exist" containerID="8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454"
Sep 16 18:26:00.387502 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:00.387477    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454"} err="failed to get container status \"8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454\": rpc error: code = NotFound desc = could not find container \"8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454\": container with ID starting with 8cf5f939aefc2dc8704077ac021f4d4ef65a7cfd74f7d2b947d474d535704454 not found: ID does not exist"
Sep 16 18:26:00.396393 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:00.396356    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"]
Sep 16 18:26:00.403266 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:00.403246    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bj6zr"]
Sep 16 18:26:01.866530 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:01.866492    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c91f3c79-7df3-4bff-8b8c-6f19ae34da67" path="/var/lib/kubelet/pods/c91f3c79-7df3-4bff-8b8c-6f19ae34da67/volumes"
Sep 16 18:26:03.641901 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.641868    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"]
Sep 16 18:26:03.642299 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.642187    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c91f3c79-7df3-4bff-8b8c-6f19ae34da67" containerName="manager"
Sep 16 18:26:03.642299 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.642199    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c91f3c79-7df3-4bff-8b8c-6f19ae34da67" containerName="manager"
Sep 16 18:26:03.642299 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.642208    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77fe8c9c-504e-4438-b5b3-647ab734622a" containerName="manager"
Sep 16 18:26:03.642299 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.642213    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="77fe8c9c-504e-4438-b5b3-647ab734622a" containerName="manager"
Sep 16 18:26:03.642299 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.642268    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="77fe8c9c-504e-4438-b5b3-647ab734622a" containerName="manager"
Sep 16 18:26:03.642299 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.642276    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c91f3c79-7df3-4bff-8b8c-6f19ae34da67" containerName="manager"
Sep 16 18:26:03.647091 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.647071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.650134 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.650117    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-t77vk\""
Sep 16 18:26:03.657358 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.657338    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"]
Sep 16 18:26:03.749348 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.749312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.749348 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.749352    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.749593 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.749453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.749593 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.749485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm7fl\" (UniqueName: \"kubernetes.io/projected/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-kube-api-access-sm7fl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.749593 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.749502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.749593 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.749519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.749593 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.749571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.749593 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.749593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.749878 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.749654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.850410 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.850361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.850599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.850426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.850599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.850451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm7fl\" (UniqueName: \"kubernetes.io/projected/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-kube-api-access-sm7fl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.850599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.850474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.850599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.850495    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.850599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.850556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.850599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.850588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.850900 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.850832    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.851012 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.850985    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.851143 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.850993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.851143 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.851110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.851250 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.851234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.851303 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.851280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.851399 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.851360    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.852782 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.852765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.853046 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.853025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.859430 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.859408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.859585 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.859565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm7fl\" (UniqueName: \"kubernetes.io/projected/8efaa52c-c1c3-4735-8106-c2f98a95b1a3-kube-api-access-sm7fl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l8h2n\" (UID: \"8efaa52c-c1c3-4735-8106-c2f98a95b1a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:03.957346 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:03.957275    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:04.234213 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:04.234189    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"]
Sep 16 18:26:04.235876 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:26:04.235839    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efaa52c_c1c3_4735_8106_c2f98a95b1a3.slice/crio-621d94ea083270c62b67ba14260398266d82553c28acf02849d1cb6e015fd783 WatchSource:0}: Error finding container 621d94ea083270c62b67ba14260398266d82553c28acf02849d1cb6e015fd783: Status 404 returned error can't find the container with id 621d94ea083270c62b67ba14260398266d82553c28acf02849d1cb6e015fd783
Sep 16 18:26:04.238038 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:04.238002    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:26:04.238098 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:04.238073    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:26:04.238132 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:04.238121    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:26:04.400425 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:04.400389    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n" event={"ID":"8efaa52c-c1c3-4735-8106-c2f98a95b1a3","Type":"ContainerStarted","Data":"b8349d6f64fbd149dcde3a83a346de7bfd72139ec28f89036f6f1ddf7cb2f8fc"}
Sep 16 18:26:04.400612 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:04.400451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n" event={"ID":"8efaa52c-c1c3-4735-8106-c2f98a95b1a3","Type":"ContainerStarted","Data":"621d94ea083270c62b67ba14260398266d82553c28acf02849d1cb6e015fd783"}
Sep 16 18:26:04.421864 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:04.421804    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n" podStartSLOduration=1.421786378 podStartE2EDuration="1.421786378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:26:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:26:04.419332772 +0000 UTC m=+583.062358834" watchObservedRunningTime="2026-09-16 18:26:04.421786378 +0000 UTC m=+583.064812417"
Sep 16 18:26:04.957608 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:04.957558    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:05.962232 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:05.962200    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:06.410652 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:06.410626    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:06.411648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:06.411626    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:26:59.569763 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.569728    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-qr7tb"]
Sep 16 18:26:59.572541 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.572523    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:26:59.575017 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.574989    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 18:26:59.575943 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.575919    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 18:26:59.576062 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.575953    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qfs4j\""
Sep 16 18:26:59.576062 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.575961    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 18:26:59.582944 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.582924    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-qr7tb"]
Sep 16 18:26:59.601446 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.601422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-webhook-cert\") pod \"maas-controller-5f8c84ff76-qr7tb\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") " pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:26:59.601570 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.601454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-metrics-certs\") pod \"maas-controller-5f8c84ff76-qr7tb\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") " pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:26:59.601638 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.601585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxhmm\" (UniqueName: \"kubernetes.io/projected/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-kube-api-access-jxhmm\") pod \"maas-controller-5f8c84ff76-qr7tb\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") " pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:26:59.702765 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.702729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxhmm\" (UniqueName: \"kubernetes.io/projected/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-kube-api-access-jxhmm\") pod \"maas-controller-5f8c84ff76-qr7tb\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") " pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:26:59.702931 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.702785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-webhook-cert\") pod \"maas-controller-5f8c84ff76-qr7tb\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") " pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:26:59.702931 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.702805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-metrics-certs\") pod \"maas-controller-5f8c84ff76-qr7tb\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") " pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:26:59.702931 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:26:59.702902    2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 16 18:26:59.703033 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:26:59.702970    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-metrics-certs podName:10d01e5b-dc13-4a6e-a0dc-9093f6c7212f nodeName:}" failed. No retries permitted until 2026-09-16 18:27:00.202952708 +0000 UTC m=+638.845978730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-metrics-certs") pod "maas-controller-5f8c84ff76-qr7tb" (UID: "10d01e5b-dc13-4a6e-a0dc-9093f6c7212f") : secret "maas-controller-metrics-tls" not found
Sep 16 18:26:59.705205 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.705180    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-webhook-cert\") pod \"maas-controller-5f8c84ff76-qr7tb\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") " pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:26:59.712016 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:26:59.711991    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxhmm\" (UniqueName: \"kubernetes.io/projected/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-kube-api-access-jxhmm\") pod \"maas-controller-5f8c84ff76-qr7tb\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") " pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:27:00.207204 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:00.207172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-metrics-certs\") pod \"maas-controller-5f8c84ff76-qr7tb\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") " pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:27:00.207394 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:27:00.207324    2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 16 18:27:00.207454 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:27:00.207418    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-metrics-certs podName:10d01e5b-dc13-4a6e-a0dc-9093f6c7212f nodeName:}" failed. No retries permitted until 2026-09-16 18:27:01.207398002 +0000 UTC m=+639.850424043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-metrics-certs") pod "maas-controller-5f8c84ff76-qr7tb" (UID: "10d01e5b-dc13-4a6e-a0dc-9093f6c7212f") : secret "maas-controller-metrics-tls" not found
Sep 16 18:27:01.214172 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:01.214132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-metrics-certs\") pod \"maas-controller-5f8c84ff76-qr7tb\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") " pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:27:01.216182 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:01.216162    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-metrics-certs\") pod \"maas-controller-5f8c84ff76-qr7tb\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") " pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:27:01.384108 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:01.384076    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:27:01.655538 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:01.655511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-qr7tb"]
Sep 16 18:27:01.657561 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:27:01.657534    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d01e5b_dc13_4a6e_a0dc_9093f6c7212f.slice/crio-bf947fa02aae0543dab8693e2e926b4d4d64a1bb62d724e1a670e0c2ecb63de2 WatchSource:0}: Error finding container bf947fa02aae0543dab8693e2e926b4d4d64a1bb62d724e1a670e0c2ecb63de2: Status 404 returned error can't find the container with id bf947fa02aae0543dab8693e2e926b4d4d64a1bb62d724e1a670e0c2ecb63de2
Sep 16 18:27:01.658861 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:01.658841    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:27:01.691915 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:01.691891    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f8c84ff76-qr7tb" event={"ID":"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f","Type":"ContainerStarted","Data":"bf947fa02aae0543dab8693e2e926b4d4d64a1bb62d724e1a670e0c2ecb63de2"}
Sep 16 18:27:04.711299 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:04.711261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f8c84ff76-qr7tb" event={"ID":"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f","Type":"ContainerStarted","Data":"a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a"}
Sep 16 18:27:04.711699 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:04.711518    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:27:04.730266 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:04.730218    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f8c84ff76-qr7tb" podStartSLOduration=3.470707238 podStartE2EDuration="5.730203786s" totalImagesPullingTime="2.259496548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:27:04.727702863 +0000 UTC m=+643.370728896" watchObservedRunningTime="2026-09-16 18:27:04.730203786 +0000 UTC m=+643.373229826"
Sep 16 18:27:15.719129 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:15.719094    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:27:37.118719 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.118676    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"]
Sep 16 18:27:37.121986 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.121968    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.124224 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.124195    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 16 18:27:37.124334 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.124265    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 18:27:37.125068 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.125048    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 18:27:37.125184 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.125069    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 18:27:37.125184 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.125051    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7l879\""
Sep 16 18:27:37.133770 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.133747    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"]
Sep 16 18:27:37.226873 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.226839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/207c9e1e-531d-45a9-adb3-5b1de58bb261-maas-api-tls\") pod \"maas-api-b66c78b8-l6wz5\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") " pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.227051 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.226893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/207c9e1e-531d-45a9-adb3-5b1de58bb261-openshift-service-ca\") pod \"maas-api-b66c78b8-l6wz5\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") " pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.227051 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.226988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w75tm\" (UniqueName: \"kubernetes.io/projected/207c9e1e-531d-45a9-adb3-5b1de58bb261-kube-api-access-w75tm\") pod \"maas-api-b66c78b8-l6wz5\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") " pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.227051 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.227044    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/207c9e1e-531d-45a9-adb3-5b1de58bb261-metrics-certs\") pod \"maas-api-b66c78b8-l6wz5\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") " pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.327829 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.327800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/207c9e1e-531d-45a9-adb3-5b1de58bb261-maas-api-tls\") pod \"maas-api-b66c78b8-l6wz5\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") " pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.328013 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.327838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/207c9e1e-531d-45a9-adb3-5b1de58bb261-openshift-service-ca\") pod \"maas-api-b66c78b8-l6wz5\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") " pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.328013 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.327866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w75tm\" (UniqueName: \"kubernetes.io/projected/207c9e1e-531d-45a9-adb3-5b1de58bb261-kube-api-access-w75tm\") pod \"maas-api-b66c78b8-l6wz5\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") " pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.328013 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.327910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/207c9e1e-531d-45a9-adb3-5b1de58bb261-metrics-certs\") pod \"maas-api-b66c78b8-l6wz5\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") " pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.328634 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.328604    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/207c9e1e-531d-45a9-adb3-5b1de58bb261-openshift-service-ca\") pod \"maas-api-b66c78b8-l6wz5\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") " pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.330504 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.330480    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/207c9e1e-531d-45a9-adb3-5b1de58bb261-maas-api-tls\") pod \"maas-api-b66c78b8-l6wz5\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") " pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.330604 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.330526    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/207c9e1e-531d-45a9-adb3-5b1de58bb261-metrics-certs\") pod \"maas-api-b66c78b8-l6wz5\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") " pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.335611 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.335589    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w75tm\" (UniqueName: \"kubernetes.io/projected/207c9e1e-531d-45a9-adb3-5b1de58bb261-kube-api-access-w75tm\") pod \"maas-api-b66c78b8-l6wz5\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") " pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.432378 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.432297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:37.719380 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.719268    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"]
Sep 16 18:27:37.722773 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:27:37.722723    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207c9e1e_531d_45a9_adb3_5b1de58bb261.slice/crio-8ba32d7c379cd0a40eb117b5fe31d7de748a868cdc6e7e131f5e1893067ac1a7 WatchSource:0}: Error finding container 8ba32d7c379cd0a40eb117b5fe31d7de748a868cdc6e7e131f5e1893067ac1a7: Status 404 returned error can't find the container with id 8ba32d7c379cd0a40eb117b5fe31d7de748a868cdc6e7e131f5e1893067ac1a7
Sep 16 18:27:37.876066 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:37.876033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5" event={"ID":"207c9e1e-531d-45a9-adb3-5b1de58bb261","Type":"ContainerStarted","Data":"8ba32d7c379cd0a40eb117b5fe31d7de748a868cdc6e7e131f5e1893067ac1a7"}
Sep 16 18:27:39.887791 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:39.887755    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5" event={"ID":"207c9e1e-531d-45a9-adb3-5b1de58bb261","Type":"ContainerStarted","Data":"90d5f5edabf26f9bcd44e0bc718bf5c2ebb351d9501502b399c1850447037e9c"}
Sep 16 18:27:39.888163 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:39.887903    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:45.898911 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:45.898878    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:27:45.919926 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:45.919866    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5" podStartSLOduration=6.913881505 podStartE2EDuration="8.919844912s" totalImagesPullingTime="2.005963407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:27:39.907610781 +0000 UTC m=+678.550636822" watchObservedRunningTime="2026-09-16 18:27:45.919844912 +0000 UTC m=+684.562870952"
Sep 16 18:27:46.934531 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:46.934498    2580 generic.go:356] "Generic (PLEG): container finished" podID="8efaa52c-c1c3-4735-8106-c2f98a95b1a3" containerID="b8349d6f64fbd149dcde3a83a346de7bfd72139ec28f89036f6f1ddf7cb2f8fc" exitCode=0
Sep 16 18:27:46.935043 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:46.934574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n" event={"ID":"8efaa52c-c1c3-4735-8106-c2f98a95b1a3","Type":"ContainerDied","Data":"b8349d6f64fbd149dcde3a83a346de7bfd72139ec28f89036f6f1ddf7cb2f8fc"}
Sep 16 18:27:46.935043 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:46.934985    2580 scope.go:117] "RemoveContainer" containerID="b8349d6f64fbd149dcde3a83a346de7bfd72139ec28f89036f6f1ddf7cb2f8fc"
Sep 16 18:27:46.935942 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:46.935918    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:27:46.935996 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:46.935980    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:27:46.936036 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:46.936009    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:27:47.941932 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:47.941894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n" event={"ID":"8efaa52c-c1c3-4735-8106-c2f98a95b1a3","Type":"ContainerStarted","Data":"703a4bdf45e2f4a99d54ad8ad54a3ff773914eb66d22125dda439ccc05f867f3"}
Sep 16 18:27:47.958043 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:47.958011    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:27:48.958873 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:48.958844    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-l8h2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 18:27:48.959237 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:48.958890    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n" podUID="8efaa52c-c1c3-4735-8106-c2f98a95b1a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 18:27:49.958081 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:49.958048    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-l8h2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 18:27:49.958265 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:49.958098    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n" podUID="8efaa52c-c1c3-4735-8106-c2f98a95b1a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 18:27:50.961963 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:50.961898    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-l8h2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 18:27:50.962342 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:50.962128    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n" podUID="8efaa52c-c1c3-4735-8106-c2f98a95b1a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 18:27:51.410937 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:51.410891    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:27:51.958505 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:51.958475    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-l8h2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 18:27:51.958688 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:51.958538    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n" podUID="8efaa52c-c1c3-4735-8106-c2f98a95b1a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 18:27:52.957971 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:52.957937    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-l8h2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 18:27:52.958359 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:52.957991    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n" podUID="8efaa52c-c1c3-4735-8106-c2f98a95b1a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 18:27:53.961904 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:53.961875    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:27:53.962885 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:27:53.962865    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l8h2n"
Sep 16 18:28:01.304665 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.304636    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"]
Sep 16 18:28:01.307751 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.307736    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.311052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.311020    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9ct5h\""
Sep 16 18:28:01.311190 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.311060    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 16 18:28:01.311190 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.311079    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 18:28:01.311190 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.311092    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 18:28:01.318754 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.318734    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"]
Sep 16 18:28:01.428043 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.428010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhqfc\" (UniqueName: \"kubernetes.io/projected/e55edd0d-41e3-4f7f-8550-058b0b981415-kube-api-access-lhqfc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.428198 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.428049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55edd0d-41e3-4f7f-8550-058b0b981415-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.428198 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.428080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55edd0d-41e3-4f7f-8550-058b0b981415-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.428198 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.428141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55edd0d-41e3-4f7f-8550-058b0b981415-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.428295 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.428201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55edd0d-41e3-4f7f-8550-058b0b981415-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.428295 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.428227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55edd0d-41e3-4f7f-8550-058b0b981415-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.529478 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.529442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55edd0d-41e3-4f7f-8550-058b0b981415-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.529646 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.529534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55edd0d-41e3-4f7f-8550-058b0b981415-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.529646 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.529610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhqfc\" (UniqueName: \"kubernetes.io/projected/e55edd0d-41e3-4f7f-8550-058b0b981415-kube-api-access-lhqfc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.529646 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.529639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55edd0d-41e3-4f7f-8550-058b0b981415-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.529798 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.529669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55edd0d-41e3-4f7f-8550-058b0b981415-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.529798 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.529696    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55edd0d-41e3-4f7f-8550-058b0b981415-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.530041 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.529999    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e55edd0d-41e3-4f7f-8550-058b0b981415-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.530141 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.530046    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e55edd0d-41e3-4f7f-8550-058b0b981415-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.530141 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.530068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e55edd0d-41e3-4f7f-8550-058b0b981415-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.531743 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.531728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e55edd0d-41e3-4f7f-8550-058b0b981415-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.532020 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.532004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e55edd0d-41e3-4f7f-8550-058b0b981415-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.537321 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.537301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhqfc\" (UniqueName: \"kubernetes.io/projected/e55edd0d-41e3-4f7f-8550-058b0b981415-kube-api-access-lhqfc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hzrt4\" (UID: \"e55edd0d-41e3-4f7f-8550-058b0b981415\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.618017 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.617982    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:01.891161 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:01.891133    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"]
Sep 16 18:28:01.892554 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:28:01.892526    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode55edd0d_41e3_4f7f_8550_058b0b981415.slice/crio-58ea0f333c38dc725af528a054bd8de054088506140e41f7bc85589a0bc65878 WatchSource:0}: Error finding container 58ea0f333c38dc725af528a054bd8de054088506140e41f7bc85589a0bc65878: Status 404 returned error can't find the container with id 58ea0f333c38dc725af528a054bd8de054088506140e41f7bc85589a0bc65878
Sep 16 18:28:02.010154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:02.010119    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4" event={"ID":"e55edd0d-41e3-4f7f-8550-058b0b981415","Type":"ContainerStarted","Data":"58ea0f333c38dc725af528a054bd8de054088506140e41f7bc85589a0bc65878"}
Sep 16 18:28:03.016466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:03.016427    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4" event={"ID":"e55edd0d-41e3-4f7f-8550-058b0b981415","Type":"ContainerStarted","Data":"43b76dc7adbd05a608181f07aca43d6e39e80008dd98375c2f5c804e92270b90"}
Sep 16 18:28:03.036805 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:03.036751    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4" podStartSLOduration=1.046482514 podStartE2EDuration="2.036733783s" totalImagesPullingTime="990.251269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:28:03.035038358 +0000 UTC m=+701.678064410" watchObservedRunningTime="2026-09-16 18:28:03.036733783 +0000 UTC m=+701.679759821"
Sep 16 18:28:11.618632 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:11.618597    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:11.619030 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:11.618658    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:11.630697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:11.630667    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:12.074742 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:12.074665    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hzrt4"
Sep 16 18:28:36.008673 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.008588    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"]
Sep 16 18:28:36.011441 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.011421    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.014147 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.014129    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 16 18:28:36.023870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.023846    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"]
Sep 16 18:28:36.024218 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.024195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fded7cab-f312-440a-9613-b66df666d506-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.024282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.024257    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fded7cab-f312-440a-9613-b66df666d506-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.024321 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.024292    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgtc2\" (UniqueName: \"kubernetes.io/projected/fded7cab-f312-440a-9613-b66df666d506-kube-api-access-tgtc2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.024376 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.024338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fded7cab-f312-440a-9613-b66df666d506-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.024471 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.024450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fded7cab-f312-440a-9613-b66df666d506-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.024540 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.024483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fded7cab-f312-440a-9613-b66df666d506-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.125785 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.125752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fded7cab-f312-440a-9613-b66df666d506-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.125967 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.125794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fded7cab-f312-440a-9613-b66df666d506-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.125967 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.125815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgtc2\" (UniqueName: \"kubernetes.io/projected/fded7cab-f312-440a-9613-b66df666d506-kube-api-access-tgtc2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.125967 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.125845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fded7cab-f312-440a-9613-b66df666d506-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.125967 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.125908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fded7cab-f312-440a-9613-b66df666d506-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.125967 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.125933    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fded7cab-f312-440a-9613-b66df666d506-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.126279 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.126258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fded7cab-f312-440a-9613-b66df666d506-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.126341 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.126275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fded7cab-f312-440a-9613-b66df666d506-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.126341 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.126295    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fded7cab-f312-440a-9613-b66df666d506-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.127963 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.127944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fded7cab-f312-440a-9613-b66df666d506-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.128231 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.128215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fded7cab-f312-440a-9613-b66df666d506-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.134030 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.134008    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgtc2\" (UniqueName: \"kubernetes.io/projected/fded7cab-f312-440a-9613-b66df666d506-kube-api-access-tgtc2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf\" (UID: \"fded7cab-f312-440a-9613-b66df666d506\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.323615 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.323531    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:36.596227 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:36.596193    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"]
Sep 16 18:28:36.597642 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:28:36.597618    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfded7cab_f312_440a_9613_b66df666d506.slice/crio-85993c0adce526be7d3da1671d769dcf0830ccb2b6f9c5bff36e59c106e6f3fa WatchSource:0}: Error finding container 85993c0adce526be7d3da1671d769dcf0830ccb2b6f9c5bff36e59c106e6f3fa: Status 404 returned error can't find the container with id 85993c0adce526be7d3da1671d769dcf0830ccb2b6f9c5bff36e59c106e6f3fa
Sep 16 18:28:37.196927 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:37.196888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf" event={"ID":"fded7cab-f312-440a-9613-b66df666d506","Type":"ContainerStarted","Data":"27ceced1b05cc492e93384f467c7652ebbd5125d1bec37256ca84db997d190bb"}
Sep 16 18:28:37.197353 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:37.196946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf" event={"ID":"fded7cab-f312-440a-9613-b66df666d506","Type":"ContainerStarted","Data":"85993c0adce526be7d3da1671d769dcf0830ccb2b6f9c5bff36e59c106e6f3fa"}
Sep 16 18:28:37.216956 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:37.216908    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf" podStartSLOduration=2.043720554 podStartE2EDuration="2.216891869s" totalImagesPullingTime="173.171315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:28:37.215553722 +0000 UTC m=+735.858579764" watchObservedRunningTime="2026-09-16 18:28:37.216891869 +0000 UTC m=+735.859917909"
Sep 16 18:28:46.324438 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:46.324399    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:46.324902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:46.324456    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:46.336856 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:46.336826    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:28:47.259074 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:28:47.259044    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf"
Sep 16 18:30:28.880061 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.880021    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"]
Sep 16 18:30:28.883599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.883580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:28.886316 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.886294    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-0197e4-openshift-default-dockercfg-mnq5v\""
Sep 16 18:30:28.914834 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.912321    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"]
Sep 16 18:30:28.947880 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.947844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-workload-certs\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:28.948053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.947895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-token\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:28.948053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.947958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-workload-socket\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:28.948179 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.948057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-envoy\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:28.948179 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.948082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djc54\" (UniqueName: \"kubernetes.io/projected/faa15103-bbd5-444b-a1c4-88e89ab8723d-kube-api-access-djc54\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:28.948179 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.948116    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-credential-socket\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:28.948179 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.948137    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-data\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:28.948404 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.948186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-podinfo\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:28.948404 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:28.948244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faa15103-bbd5-444b-a1c4-88e89ab8723d-istiod-ca-cert\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.048785 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.048746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-token\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.048964 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.048799    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-workload-socket\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.048964 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.048845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-envoy\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.048964 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.048869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djc54\" (UniqueName: \"kubernetes.io/projected/faa15103-bbd5-444b-a1c4-88e89ab8723d-kube-api-access-djc54\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.048964 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.048899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-credential-socket\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.048964 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.048922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-data\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.048964 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.048955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-podinfo\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.049272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.049005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faa15103-bbd5-444b-a1c4-88e89ab8723d-istiod-ca-cert\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.049272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.049039    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-workload-certs\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.049272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.049238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-workload-socket\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.049463 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.049383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-workload-certs\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.049517 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.049494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-credential-socket\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.049800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.049769    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-data\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.049973 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.049954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faa15103-bbd5-444b-a1c4-88e89ab8723d-istiod-ca-cert\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.051593 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.051569    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-envoy\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.051710 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.051673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-podinfo\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.076571 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.076549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-token\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.076709 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.076694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djc54\" (UniqueName: \"kubernetes.io/projected/faa15103-bbd5-444b-a1c4-88e89ab8723d-kube-api-access-djc54\") pod \"e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") " pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.166188 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.166107    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"]
Sep 16 18:30:29.171088 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.171066    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.181362 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.181340    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-6942a4-openshift-default-dockercfg-2pkb5\""
Sep 16 18:30:29.189892 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.189828    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"]
Sep 16 18:30:29.193339 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.193307    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:29.263398 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.261497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-podinfo\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.263398 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.261558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-workload-socket\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.263398 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.261589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-workload-certs\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.263398 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.261617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-envoy\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.263398 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.261644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istiod-ca-cert\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.263398 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.261670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tdzq\" (UniqueName: \"kubernetes.io/projected/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-kube-api-access-8tdzq\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.263398 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.261697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-token\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.263398 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.261727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-data\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.263398 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.261818    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-credential-socket\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.363296 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.363264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-credential-socket\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.363511 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.363487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-podinfo\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.363575 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.363549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-workload-socket\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.363628 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.363584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-workload-certs\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.363628 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.363608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-envoy\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.363732 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.363711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istiod-ca-cert\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.363781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.363750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tdzq\" (UniqueName: \"kubernetes.io/projected/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-kube-api-access-8tdzq\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.363781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.363768    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-credential-socket\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.363879 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.363784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-token\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.363879 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.363829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-data\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.364083 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.363995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-workload-certs\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.364206 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.364190    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-workload-socket\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.364328 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.364308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-data\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.364914 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.364892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istiod-ca-cert\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.366266 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.366244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-envoy\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.366656 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.366636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-podinfo\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.380194 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.380172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-token\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.380409 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.380394    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tdzq\" (UniqueName: \"kubernetes.io/projected/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-kube-api-access-8tdzq\") pod \"e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") " pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.482275 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.482197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:29.499166 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.499140    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"]
Sep 16 18:30:29.500315 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:30:29.500288    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa15103_bbd5_444b_a1c4_88e89ab8723d.slice/crio-f4404b5da381b737677e58b6304137eee1a688c0802289cd7b3a0f32f32de3bc WatchSource:0}: Error finding container f4404b5da381b737677e58b6304137eee1a688c0802289cd7b3a0f32f32de3bc: Status 404 returned error can't find the container with id f4404b5da381b737677e58b6304137eee1a688c0802289cd7b3a0f32f32de3bc
Sep 16 18:30:29.502857 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.502821    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:29.502963 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.502894    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:29.502963 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.502923    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:29.764175 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.764092    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" event={"ID":"faa15103-bbd5-444b-a1c4-88e89ab8723d","Type":"ContainerStarted","Data":"b3361eb762776ce614627e4ad60f91e9d9f55adeff9cbc288b185bde8c030125"}
Sep 16 18:30:29.764175 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.764155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" event={"ID":"faa15103-bbd5-444b-a1c4-88e89ab8723d","Type":"ContainerStarted","Data":"f4404b5da381b737677e58b6304137eee1a688c0802289cd7b3a0f32f32de3bc"}
Sep 16 18:30:29.772449 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.772415    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"]
Sep 16 18:30:29.776870 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:30:29.776043    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843b1a82_0c4e_4d2e_9c4a_1f1a1d444f00.slice/crio-65ee0e8ae412c6aece572bf2243bfe48bd0d89dcd59564561da96c3802d8cc97 WatchSource:0}: Error finding container 65ee0e8ae412c6aece572bf2243bfe48bd0d89dcd59564561da96c3802d8cc97: Status 404 returned error can't find the container with id 65ee0e8ae412c6aece572bf2243bfe48bd0d89dcd59564561da96c3802d8cc97
Sep 16 18:30:29.780506 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.780476    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:29.780623 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.780549    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:29.780623 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.780597    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:29.793918 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:29.793872    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" podStartSLOduration=1.793855908 podStartE2EDuration="1.793855908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:30:29.790352988 +0000 UTC m=+848.433379027" watchObservedRunningTime="2026-09-16 18:30:29.793855908 +0000 UTC m=+848.436881982"
Sep 16 18:30:30.194438 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:30.194408    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:30.199253 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:30.199228    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:30.771587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:30.771546    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" event={"ID":"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00","Type":"ContainerStarted","Data":"5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d"}
Sep 16 18:30:30.771782 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:30.771605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" event={"ID":"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00","Type":"ContainerStarted","Data":"65ee0e8ae412c6aece572bf2243bfe48bd0d89dcd59564561da96c3802d8cc97"}
Sep 16 18:30:30.771878 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:30.771858    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:30.772795 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:30.772771    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:30.793770 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:30.793722    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" podStartSLOduration=1.7937052869999999 podStartE2EDuration="1.793705287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:30:30.79198293 +0000 UTC m=+849.435008971" watchObservedRunningTime="2026-09-16 18:30:30.793705287 +0000 UTC m=+849.436731326"
Sep 16 18:30:31.482981 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:31.482943    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:31.487851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:31.487824    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:31.777319 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:31.777246    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:31.777992 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:31.777973    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:30:33.670863 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.670830    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"]
Sep 16 18:30:33.674687 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.674662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:33.677110 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.677091    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-0197e4-serving-cert\""
Sep 16 18:30:33.688387 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.688311    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"]
Sep 16 18:30:33.708084 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.708055    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkqgc\" (UniqueName: \"kubernetes.io/projected/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-kube-api-access-vkqgc\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:33.708193 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.708138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-maas-api-tls\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:33.708193 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.708169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-metrics-certs\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:33.708261 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.708249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:33.808759 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.808723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-maas-api-tls\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:33.808951 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.808768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-metrics-certs\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:33.808951 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.808836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:33.808951 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:30:33.808875    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-serving-cert: secret "maas-api-e2e-inf-a-0197e4-serving-cert" not found
Sep 16 18:30:33.808951 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.808901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkqgc\" (UniqueName: \"kubernetes.io/projected/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-kube-api-access-vkqgc\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:33.809152 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:30:33.808967    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-maas-api-tls podName:e761b0f4-daf6-43fa-8fd1-c23dce5f8257 nodeName:}" failed. No retries permitted until 2026-09-16 18:30:34.308947414 +0000 UTC m=+852.951973441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-maas-api-tls") pod "maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4" (UID: "e761b0f4-daf6-43fa-8fd1-c23dce5f8257") : secret "maas-api-e2e-inf-a-0197e4-serving-cert" not found
Sep 16 18:30:33.810033 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.810000    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:33.812324 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.812208    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-metrics-certs\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:33.818404 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:33.818361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkqgc\" (UniqueName: \"kubernetes.io/projected/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-kube-api-access-vkqgc\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:34.314723 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:34.314682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-maas-api-tls\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:34.316998 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:34.316972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-maas-api-tls\") pod \"maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:34.589458 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:34.589423    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:34.915747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:34.915718    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"]
Sep 16 18:30:34.916285 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:30:34.916264    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode761b0f4_daf6_43fa_8fd1_c23dce5f8257.slice/crio-593a73d5fe590d15da59f237fbe7bace19cdc76d2ef4ac50a16ee805c636ada1 WatchSource:0}: Error finding container 593a73d5fe590d15da59f237fbe7bace19cdc76d2ef4ac50a16ee805c636ada1: Status 404 returned error can't find the container with id 593a73d5fe590d15da59f237fbe7bace19cdc76d2ef4ac50a16ee805c636ada1
Sep 16 18:30:35.801742 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:35.801652    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4" event={"ID":"e761b0f4-daf6-43fa-8fd1-c23dce5f8257","Type":"ContainerStarted","Data":"cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e"}
Sep 16 18:30:35.801742 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:35.801708    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4" event={"ID":"e761b0f4-daf6-43fa-8fd1-c23dce5f8257","Type":"ContainerStarted","Data":"593a73d5fe590d15da59f237fbe7bace19cdc76d2ef4ac50a16ee805c636ada1"}
Sep 16 18:30:35.801742 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:35.801743    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:35.826626 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:35.826574    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4" podStartSLOduration=2.264260882 podStartE2EDuration="2.826555584s" totalImagesPullingTime="562.294702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:30:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:30:35.824177137 +0000 UTC m=+854.467203189" watchObservedRunningTime="2026-09-16 18:30:35.826555584 +0000 UTC m=+854.469581671"
Sep 16 18:30:39.114313 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.114273    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"]
Sep 16 18:30:39.117976 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.117953    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.120793 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.120769    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-a24d09-serving-cert\""
Sep 16 18:30:39.130870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.130844    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"]
Sep 16 18:30:39.211974 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.211939    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"]
Sep 16 18:30:39.215282 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.215260    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.219860 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.219840    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-78d09e99-openshift-default-dockercfg-nljs4\""
Sep 16 18:30:39.230888 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.230863    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"]
Sep 16 18:30:39.268208 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-workload-certs\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.268411 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.268411 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268350    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9de123e4-486f-4933-8f0e-358f941e34c0-istiod-ca-cert\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.268529 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9de123e4-486f-4933-8f0e-358f941e34c0-istio-podinfo\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.268583 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-istio-envoy\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.268583 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268567    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzmjp\" (UniqueName: \"kubernetes.io/projected/9de123e4-486f-4933-8f0e-358f941e34c0-kube-api-access-wzmjp\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.268695 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48df287-c9e3-4eca-8db3-b50ee3210d16-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.268695 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5255\" (UniqueName: \"kubernetes.io/projected/f48df287-c9e3-4eca-8db3-b50ee3210d16-kube-api-access-c5255\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.268695 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268675    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-workload-socket\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.268845 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9de123e4-486f-4933-8f0e-358f941e34c0-istio-token\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.268845 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-credential-socket\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.268845 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-istio-data\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.268996 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.268877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-metrics-certs\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.369695 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369612    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9de123e4-486f-4933-8f0e-358f941e34c0-istio-podinfo\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.369695 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-istio-envoy\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.369695 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmjp\" (UniqueName: \"kubernetes.io/projected/9de123e4-486f-4933-8f0e-358f941e34c0-kube-api-access-wzmjp\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.369971 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48df287-c9e3-4eca-8db3-b50ee3210d16-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.369971 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5255\" (UniqueName: \"kubernetes.io/projected/f48df287-c9e3-4eca-8db3-b50ee3210d16-kube-api-access-c5255\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.369971 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-workload-socket\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.369971 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369799    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9de123e4-486f-4933-8f0e-358f941e34c0-istio-token\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.369971 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-credential-socket\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.369971 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-istio-data\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.369971 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-metrics-certs\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.369971 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-workload-certs\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.369971 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.370437 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.369995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9de123e4-486f-4933-8f0e-358f941e34c0-istiod-ca-cert\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.370437 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.370197    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-workload-socket\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.370437 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.370388    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-istio-data\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.370586 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.370470    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-workload-certs\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.370586 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.370529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48df287-c9e3-4eca-8db3-b50ee3210d16-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.370677 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:30:39.370624    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-serving-cert: secret "maas-api-e2e-worker-w0-a24d09-serving-cert" not found
Sep 16 18:30:39.370725 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:30:39.370694    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-maas-api-tls podName:f48df287-c9e3-4eca-8db3-b50ee3210d16 nodeName:}" failed. No retries permitted until 2026-09-16 18:30:39.87067379 +0000 UTC m=+858.513699822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-maas-api-tls") pod "maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q" (UID: "f48df287-c9e3-4eca-8db3-b50ee3210d16") : secret "maas-api-e2e-worker-w0-a24d09-serving-cert" not found
Sep 16 18:30:39.370787 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.370742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9de123e4-486f-4933-8f0e-358f941e34c0-istiod-ca-cert\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.370965 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.370922    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-credential-socket\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.372169 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.372148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-istio-envoy\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.372573 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.372550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9de123e4-486f-4933-8f0e-358f941e34c0-istio-podinfo\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.372777 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.372762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-metrics-certs\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.379519 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.379489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5255\" (UniqueName: \"kubernetes.io/projected/f48df287-c9e3-4eca-8db3-b50ee3210d16-kube-api-access-c5255\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.380450 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.380428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9de123e4-486f-4933-8f0e-358f941e34c0-istio-token\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.384763 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.384741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzmjp\" (UniqueName: \"kubernetes.io/projected/9de123e4-486f-4933-8f0e-358f941e34c0-kube-api-access-wzmjp\") pod \"e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") " pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.526841 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.526807    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:39.808756 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.808729    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"]
Sep 16 18:30:39.810315 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:30:39.810277    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de123e4_486f_4933_8f0e_358f941e34c0.slice/crio-6621723de8e48f28507b0d633bc4f4895ef1f8788652dd461e2d7947eaffab1b WatchSource:0}: Error finding container 6621723de8e48f28507b0d633bc4f4895ef1f8788652dd461e2d7947eaffab1b: Status 404 returned error can't find the container with id 6621723de8e48f28507b0d633bc4f4895ef1f8788652dd461e2d7947eaffab1b
Sep 16 18:30:39.812487 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.812452    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:39.812599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.812531    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:39.812599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.812574    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:39.823586 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.823562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" event={"ID":"9de123e4-486f-4933-8f0e-358f941e34c0","Type":"ContainerStarted","Data":"6621723de8e48f28507b0d633bc4f4895ef1f8788652dd461e2d7947eaffab1b"}
Sep 16 18:30:39.875014 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.874991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:39.877157 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:39.877135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:40.031242 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:40.031206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:40.332121 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:40.331124    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"]
Sep 16 18:30:40.834106 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:40.834072    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q" event={"ID":"f48df287-c9e3-4eca-8db3-b50ee3210d16","Type":"ContainerStarted","Data":"d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469"}
Sep 16 18:30:40.834411 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:40.834387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q" event={"ID":"f48df287-c9e3-4eca-8db3-b50ee3210d16","Type":"ContainerStarted","Data":"11f91a4983bc6db43c0799ab2ae0671c878b3cffb92d7646a9248122f893d186"}
Sep 16 18:30:40.835603 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:40.835586    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:40.842664 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:40.841978    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" event={"ID":"9de123e4-486f-4933-8f0e-358f941e34c0","Type":"ContainerStarted","Data":"b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d"}
Sep 16 18:30:40.874027 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:40.873975    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q" podStartSLOduration=1.5146902500000001 podStartE2EDuration="1.87395763s" totalImagesPullingTime="359.26738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:30:40.869293855 +0000 UTC m=+859.512319894" watchObservedRunningTime="2026-09-16 18:30:40.87395763 +0000 UTC m=+859.516983670"
Sep 16 18:30:40.934053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:40.923139    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" podStartSLOduration=1.92311654 podStartE2EDuration="1.92311654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:30:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:30:40.922724867 +0000 UTC m=+859.565750919" watchObservedRunningTime="2026-09-16 18:30:40.92311654 +0000 UTC m=+859.566142580"
Sep 16 18:30:41.527858 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:41.527808    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:41.533518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:41.533493    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:41.816187 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:41.816097    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:30:41.847094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:41.847062    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:41.847862 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:41.847844    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:30:47.288728 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.288693    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"]
Sep 16 18:30:47.295458 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.292979    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.296207 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.296183    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-305998-serving-cert\""
Sep 16 18:30:47.313778 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.313713    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"]
Sep 16 18:30:47.456594 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.456553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9vnn\" (UniqueName: \"kubernetes.io/projected/bac863fb-7b5b-429c-bdbf-b455d8601b51-kube-api-access-j9vnn\") pod \"maas-api-e2e-autores-305998-85b588676-m2l98\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.456784 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.456634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bac863fb-7b5b-429c-bdbf-b455d8601b51-metrics-certs\") pod \"maas-api-e2e-autores-305998-85b588676-m2l98\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.456784 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.456690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac863fb-7b5b-429c-bdbf-b455d8601b51-maas-api-tls\") pod \"maas-api-e2e-autores-305998-85b588676-m2l98\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.456784 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.456747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac863fb-7b5b-429c-bdbf-b455d8601b51-openshift-service-ca\") pod \"maas-api-e2e-autores-305998-85b588676-m2l98\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.557651 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.557558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bac863fb-7b5b-429c-bdbf-b455d8601b51-metrics-certs\") pod \"maas-api-e2e-autores-305998-85b588676-m2l98\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.557651 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.557611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac863fb-7b5b-429c-bdbf-b455d8601b51-maas-api-tls\") pod \"maas-api-e2e-autores-305998-85b588676-m2l98\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.557858 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.557687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac863fb-7b5b-429c-bdbf-b455d8601b51-openshift-service-ca\") pod \"maas-api-e2e-autores-305998-85b588676-m2l98\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.557858 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.557790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9vnn\" (UniqueName: \"kubernetes.io/projected/bac863fb-7b5b-429c-bdbf-b455d8601b51-kube-api-access-j9vnn\") pod \"maas-api-e2e-autores-305998-85b588676-m2l98\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.558426 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.558403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac863fb-7b5b-429c-bdbf-b455d8601b51-openshift-service-ca\") pod \"maas-api-e2e-autores-305998-85b588676-m2l98\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.559978 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.559958    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac863fb-7b5b-429c-bdbf-b455d8601b51-maas-api-tls\") pod \"maas-api-e2e-autores-305998-85b588676-m2l98\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.560051 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.560006    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bac863fb-7b5b-429c-bdbf-b455d8601b51-metrics-certs\") pod \"maas-api-e2e-autores-305998-85b588676-m2l98\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.570561 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.570535    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9vnn\" (UniqueName: \"kubernetes.io/projected/bac863fb-7b5b-429c-bdbf-b455d8601b51-kube-api-access-j9vnn\") pod \"maas-api-e2e-autores-305998-85b588676-m2l98\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.609201 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.609170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:47.857769 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.857740    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:30:47.896034 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:47.896005    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"]
Sep 16 18:30:47.897871 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:30:47.897840    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac863fb_7b5b_429c_bdbf_b455d8601b51.slice/crio-bd9cf44b2d84b28f8ec047ab8f58b92b90c6ee143b639e21de1f609eaeb3c187 WatchSource:0}: Error finding container bd9cf44b2d84b28f8ec047ab8f58b92b90c6ee143b639e21de1f609eaeb3c187: Status 404 returned error can't find the container with id bd9cf44b2d84b28f8ec047ab8f58b92b90c6ee143b639e21de1f609eaeb3c187
Sep 16 18:30:48.570785 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.570698    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"]
Sep 16 18:30:48.575749 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.575725    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:48.578445 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.578314    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-78d09e99-serving-cert\""
Sep 16 18:30:48.588119 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.587985    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"]
Sep 16 18:30:48.679605 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.675327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-metrics-certs\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:48.679605 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.675422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-openshift-service-ca\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:48.679605 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.675484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-maas-api-tls\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:48.679605 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.675627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6dr2\" (UniqueName: \"kubernetes.io/projected/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-kube-api-access-q6dr2\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:48.776710 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.776670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-metrics-certs\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:48.776897 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.776721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-openshift-service-ca\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:48.776897 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.776838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-maas-api-tls\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:48.777014 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:30:48.776972    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-serving-cert: secret "maas-api-e2e-ait-78d09e99-serving-cert" not found
Sep 16 18:30:48.777014 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.776996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6dr2\" (UniqueName: \"kubernetes.io/projected/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-kube-api-access-q6dr2\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:48.777107 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:30:48.777057    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-maas-api-tls podName:b1f089a8-9b43-4f7e-a497-8236bcdd1cf0 nodeName:}" failed. No retries permitted until 2026-09-16 18:30:49.277033903 +0000 UTC m=+867.920059921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-maas-api-tls") pod "maas-api-e2e-ait-78d09e99-56f89b557b-nzjww" (UID: "b1f089a8-9b43-4f7e-a497-8236bcdd1cf0") : secret "maas-api-e2e-ait-78d09e99-serving-cert" not found
Sep 16 18:30:48.777613 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.777583    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-openshift-service-ca\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:48.779309 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.779288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-metrics-certs\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:48.785754 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.785726    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6dr2\" (UniqueName: \"kubernetes.io/projected/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-kube-api-access-q6dr2\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:48.886833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.886797    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98" event={"ID":"bac863fb-7b5b-429c-bdbf-b455d8601b51","Type":"ContainerStarted","Data":"16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055"}
Sep 16 18:30:48.887023 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.886853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98" event={"ID":"bac863fb-7b5b-429c-bdbf-b455d8601b51","Type":"ContainerStarted","Data":"bd9cf44b2d84b28f8ec047ab8f58b92b90c6ee143b639e21de1f609eaeb3c187"}
Sep 16 18:30:48.887023 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.886937    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:48.909638 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:48.909585    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98" podStartSLOduration=1.5362247089999999 podStartE2EDuration="1.909569366s" totalImagesPullingTime="373.344657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:30:48.907467745 +0000 UTC m=+867.550493808" watchObservedRunningTime="2026-09-16 18:30:48.909569366 +0000 UTC m=+867.552595405"
Sep 16 18:30:49.282610 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:49.282521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-maas-api-tls\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:49.284988 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:49.284957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-maas-api-tls\") pod \"maas-api-e2e-ait-78d09e99-56f89b557b-nzjww\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:49.489525 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:49.489497    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:49.782230 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:49.782203    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"]
Sep 16 18:30:49.783501 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:30:49.783474    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f089a8_9b43_4f7e_a497_8236bcdd1cf0.slice/crio-ef057ed9225ee5cb4491a341be7770968b8aaf091722854e7acfe5b994895c3f WatchSource:0}: Error finding container ef057ed9225ee5cb4491a341be7770968b8aaf091722854e7acfe5b994895c3f: Status 404 returned error can't find the container with id ef057ed9225ee5cb4491a341be7770968b8aaf091722854e7acfe5b994895c3f
Sep 16 18:30:49.893726 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:49.893690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww" event={"ID":"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0","Type":"ContainerStarted","Data":"ef057ed9225ee5cb4491a341be7770968b8aaf091722854e7acfe5b994895c3f"}
Sep 16 18:30:49.895244 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:49.895220    2580 generic.go:356] "Generic (PLEG): container finished" podID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerID="b3361eb762776ce614627e4ad60f91e9d9f55adeff9cbc288b185bde8c030125" exitCode=0
Sep 16 18:30:49.895393 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:49.895290    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" event={"ID":"faa15103-bbd5-444b-a1c4-88e89ab8723d","Type":"ContainerDied","Data":"b3361eb762776ce614627e4ad60f91e9d9f55adeff9cbc288b185bde8c030125"}
Sep 16 18:30:49.895796 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:49.895780    2580 scope.go:117] "RemoveContainer" containerID="b3361eb762776ce614627e4ad60f91e9d9f55adeff9cbc288b185bde8c030125"
Sep 16 18:30:49.896842 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:49.896813    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:49.896934 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:49.896876    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:49.896934 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:49.896907    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:50.907591 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:50.906548    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" event={"ID":"faa15103-bbd5-444b-a1c4-88e89ab8723d","Type":"ContainerStarted","Data":"84d72be98ad465b1c4944d7e32915f126523aa591b194f7b9d6184fa0a81eab4"}
Sep 16 18:30:50.910806 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:50.910000    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww" event={"ID":"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0","Type":"ContainerStarted","Data":"057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2"}
Sep 16 18:30:50.910806 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:50.910600    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:50.952208 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:50.952136    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww" podStartSLOduration=2.097671417 podStartE2EDuration="2.952111545s" totalImagesPullingTime="854.440128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:30:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:30:50.949009316 +0000 UTC m=+869.592035368" watchObservedRunningTime="2026-09-16 18:30:50.952111545 +0000 UTC m=+869.595137586"
Sep 16 18:30:51.193760 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:51.193583    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:51.193902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:51.193768    2580 patch_prober.go:28] interesting pod/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 16 18:30:51.193902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:51.193817    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 16 18:30:52.194298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:52.194262    2580 patch_prober.go:28] interesting pod/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 16 18:30:52.194719 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:52.194328    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 16 18:30:53.194049 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:53.194017    2580 patch_prober.go:28] interesting pod/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 16 18:30:53.194211 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:53.194069    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 16 18:30:54.194191 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:54.194152    2580 patch_prober.go:28] interesting pod/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 16 18:30:54.194606 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:54.194209    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 16 18:30:54.916392 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:54.914517    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:30:55.194582 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:55.194503    2580 patch_prober.go:28] interesting pod/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 16 18:30:55.194582 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:55.194562    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 16 18:30:56.274287 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:56.274244    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:56.275605 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:56.275580    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:56.276605 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:56.276578    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:30:57.932243 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:57.932209    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:30:58.982454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:58.982423    2580 generic.go:356] "Generic (PLEG): container finished" podID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerID="5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d" exitCode=0
Sep 16 18:30:58.982902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:58.982479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" event={"ID":"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00","Type":"ContainerDied","Data":"5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d"}
Sep 16 18:30:58.982902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:58.982849    2580 scope.go:117] "RemoveContainer" containerID="5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d"
Sep 16 18:30:58.984174 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:58.984139    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:58.984467 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:58.984441    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:58.984655 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:58.984630    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:30:59.991914 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:30:59.991879    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" event={"ID":"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00","Type":"ContainerStarted","Data":"26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55"}
Sep 16 18:31:00.483486 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:00.483452    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:31:00.484426 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:00.484401    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 18:31:00.484488 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:00.484453    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 18:31:01.482609 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:01.482575    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 18:31:01.483096 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:01.482641    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 18:31:01.777402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:01.777304    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:31:02.483585 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:02.483547    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 18:31:02.483965 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:02.483604    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 18:31:03.482560 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:03.482523    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 18:31:03.482748 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:03.482580    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 18:31:04.483561 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:04.483528    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 18:31:04.484017 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:04.483590    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 18:31:05.486941 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:05.486911    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:31:05.488044 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:05.488024    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:31:09.055861 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:09.055824    2580 generic.go:356] "Generic (PLEG): container finished" podID="9de123e4-486f-4933-8f0e-358f941e34c0" containerID="b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d" exitCode=0
Sep 16 18:31:09.056278 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:09.055896    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" event={"ID":"9de123e4-486f-4933-8f0e-358f941e34c0","Type":"ContainerDied","Data":"b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d"}
Sep 16 18:31:09.056327 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:09.056311    2580 scope.go:117] "RemoveContainer" containerID="b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d"
Sep 16 18:31:09.057462 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:09.057436    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:31:09.057545 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:09.057505    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:31:09.057545 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:09.057534    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:31:10.063983 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:10.063951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" event={"ID":"9de123e4-486f-4933-8f0e-358f941e34c0","Type":"ContainerStarted","Data":"b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451"}
Sep 16 18:31:10.527874 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:10.527842    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:31:10.529540 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:10.529506    2580 patch_prober.go:28] interesting pod/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 16 18:31:10.529817 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:10.529777    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 16 18:31:11.528228 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:11.528190    2580 patch_prober.go:28] interesting pod/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 16 18:31:11.528663 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:11.528252    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 16 18:31:11.846921 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:11.846891    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:31:12.527885 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:12.527850    2580 patch_prober.go:28] interesting pod/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 16 18:31:12.528071 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:12.527903    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 16 18:31:13.527444 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:13.527404    2580 patch_prober.go:28] interesting pod/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 16 18:31:13.527840 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:13.527462    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 16 18:31:14.527323 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:14.527229    2580 patch_prober.go:28] interesting pod/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 16 18:31:14.527323 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:14.527305    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 16 18:31:15.531525 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:15.531490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:31:15.532532 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:15.532511    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:31:24.340477 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.340428    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"]
Sep 16 18:31:24.341232 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.341179    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww" podUID="b1f089a8-9b43-4f7e-a497-8236bcdd1cf0" containerName="maas-api" containerID="cri-o://057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2" gracePeriod=30
Sep 16 18:31:24.590562 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.590500    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:31:24.706134 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.706096    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"]
Sep 16 18:31:24.706405 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.706345    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" containerName="istio-proxy" containerID="cri-o://b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451" gracePeriod=30
Sep 16 18:31:24.771897 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.771869    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6dr2\" (UniqueName: \"kubernetes.io/projected/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-kube-api-access-q6dr2\") pod \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") "
Sep 16 18:31:24.772056 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.771907    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-openshift-service-ca\") pod \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") "
Sep 16 18:31:24.772056 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.772018    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-maas-api-tls\") pod \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") "
Sep 16 18:31:24.772056 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.772043    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-metrics-certs\") pod \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\" (UID: \"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0\") "
Sep 16 18:31:24.772363 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.772330    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1f089a8-9b43-4f7e-a497-8236bcdd1cf0" (UID: "b1f089a8-9b43-4f7e-a497-8236bcdd1cf0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:31:24.774100 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.774066    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1f089a8-9b43-4f7e-a497-8236bcdd1cf0" (UID: "b1f089a8-9b43-4f7e-a497-8236bcdd1cf0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:31:24.774214 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.774172    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b1f089a8-9b43-4f7e-a497-8236bcdd1cf0" (UID: "b1f089a8-9b43-4f7e-a497-8236bcdd1cf0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:31:24.774214 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.774178    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-kube-api-access-q6dr2" (OuterVolumeSpecName: "kube-api-access-q6dr2") pod "b1f089a8-9b43-4f7e-a497-8236bcdd1cf0" (UID: "b1f089a8-9b43-4f7e-a497-8236bcdd1cf0"). InnerVolumeSpecName "kube-api-access-q6dr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:31:24.873902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.873821    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:24.873902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.873849    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:24.873902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.873859    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6dr2\" (UniqueName: \"kubernetes.io/projected/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-kube-api-access-q6dr2\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:24.873902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:24.873869    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:25.145963 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.145869    2580 generic.go:356] "Generic (PLEG): container finished" podID="b1f089a8-9b43-4f7e-a497-8236bcdd1cf0" containerID="057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2" exitCode=0
Sep 16 18:31:25.145963 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.145926    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"
Sep 16 18:31:25.145963 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.145937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww" event={"ID":"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0","Type":"ContainerDied","Data":"057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2"}
Sep 16 18:31:25.146242 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.145992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww" event={"ID":"b1f089a8-9b43-4f7e-a497-8236bcdd1cf0","Type":"ContainerDied","Data":"ef057ed9225ee5cb4491a341be7770968b8aaf091722854e7acfe5b994895c3f"}
Sep 16 18:31:25.146242 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.146021    2580 scope.go:117] "RemoveContainer" containerID="057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2"
Sep 16 18:31:25.155990 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.155972    2580 scope.go:117] "RemoveContainer" containerID="057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2"
Sep 16 18:31:25.156239 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:31:25.156223    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2\": container with ID starting with 057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2 not found: ID does not exist" containerID="057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2"
Sep 16 18:31:25.156286 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.156247    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2"} err="failed to get container status \"057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2\": rpc error: code = NotFound desc = could not find container \"057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2\": container with ID starting with 057389a5f412201a5981fe1a2692801b092a354e371468ed04eb176d922479a2 not found: ID does not exist"
Sep 16 18:31:25.184233 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.184210    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"]
Sep 16 18:31:25.195837 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.195812    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-78d09e99-56f89b557b-nzjww"]
Sep 16 18:31:25.733921 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.733890    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"]
Sep 16 18:31:25.734639 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.734555    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f089a8-9b43-4f7e-a497-8236bcdd1cf0" containerName="maas-api"
Sep 16 18:31:25.734639 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.734581    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f089a8-9b43-4f7e-a497-8236bcdd1cf0" containerName="maas-api"
Sep 16 18:31:25.734824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.734696    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f089a8-9b43-4f7e-a497-8236bcdd1cf0" containerName="maas-api"
Sep 16 18:31:25.737944 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.737924    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.740272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.740253    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-78aa4077-gw-openshift-default-dockercfg-44vpz\""
Sep 16 18:31:25.751432 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.751405    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"]
Sep 16 18:31:25.871360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.871327    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f089a8-9b43-4f7e-a497-8236bcdd1cf0" path="/var/lib/kubelet/pods/b1f089a8-9b43-4f7e-a497-8236bcdd1cf0/volumes"
Sep 16 18:31:25.884038 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.884009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-podinfo\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.884173 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.884060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jndmw\" (UniqueName: \"kubernetes.io/projected/cc0898be-63a4-4e21-9050-00fb0c81ddfb-kube-api-access-jndmw\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.884173 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.884091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-workload-socket\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.884173 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.884111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-credential-socket\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.884300 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.884181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-envoy\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.884300 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.884215    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-workload-certs\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.884300 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.884231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istiod-ca-cert\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.884300 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.884279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-data\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.884457 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.884315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-token\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.985279 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.985202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-workload-certs\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.985279 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.985238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istiod-ca-cert\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.985544 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.985456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-data\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.985544 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.985529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-token\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.985665 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.985588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-podinfo\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.985975 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.985945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jndmw\" (UniqueName: \"kubernetes.io/projected/cc0898be-63a4-4e21-9050-00fb0c81ddfb-kube-api-access-jndmw\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.986155 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.986135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-workload-socket\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.986300 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.986281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-credential-socket\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.986463 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.986440    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-data\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.986547 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.986223    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-workload-certs\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.986547 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.986511    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istiod-ca-cert\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.987014 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.986801    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-envoy\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.987014 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.986946    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-credential-socket\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.994467 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.994439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-token\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.995114 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.995089    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-workload-socket\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.995979 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.995934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-envoy\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.996134 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.996071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-podinfo\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:25.997808 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:25.997786    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jndmw\" (UniqueName: \"kubernetes.io/projected/cc0898be-63a4-4e21-9050-00fb0c81ddfb-kube-api-access-jndmw\") pod \"e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") " pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:26.049015 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:26.048992    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:26.324393 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:26.324350    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"]
Sep 16 18:31:26.325775 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:31:26.325737    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0898be_63a4_4e21_9050_00fb0c81ddfb.slice/crio-2472769c1454bc9bbdb4f1b75b91cb1883f584509b6e6ef6b1b6fe7014c57f01 WatchSource:0}: Error finding container 2472769c1454bc9bbdb4f1b75b91cb1883f584509b6e6ef6b1b6fe7014c57f01: Status 404 returned error can't find the container with id 2472769c1454bc9bbdb4f1b75b91cb1883f584509b6e6ef6b1b6fe7014c57f01
Sep 16 18:31:26.328534 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:26.328495    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:31:26.328626 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:26.328562    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:31:26.328626 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:26.328591    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:31:27.160244 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:27.160195    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" event={"ID":"cc0898be-63a4-4e21-9050-00fb0c81ddfb","Type":"ContainerStarted","Data":"efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b"}
Sep 16 18:31:27.160662 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:27.160257    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" event={"ID":"cc0898be-63a4-4e21-9050-00fb0c81ddfb","Type":"ContainerStarted","Data":"2472769c1454bc9bbdb4f1b75b91cb1883f584509b6e6ef6b1b6fe7014c57f01"}
Sep 16 18:31:27.181557 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:27.181510    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" podStartSLOduration=2.181495333 podStartE2EDuration="2.181495333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:31:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:31:27.179349768 +0000 UTC m=+905.822375822" watchObservedRunningTime="2026-09-16 18:31:27.181495333 +0000 UTC m=+905.824521373"
Sep 16 18:31:28.049955 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:28.049918    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:28.056500 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:28.056471    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:28.166203 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:28.166168    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:28.167128 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:28.167107    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:29.964020 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:29.963999    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:31:30.025101 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.025016    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9de123e4-486f-4933-8f0e-358f941e34c0-istio-podinfo\") pod \"9de123e4-486f-4933-8f0e-358f941e34c0\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") "
Sep 16 18:31:30.025259 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.025115    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-credential-socket\") pod \"9de123e4-486f-4933-8f0e-358f941e34c0\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") "
Sep 16 18:31:30.025259 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.025174    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9de123e4-486f-4933-8f0e-358f941e34c0-istiod-ca-cert\") pod \"9de123e4-486f-4933-8f0e-358f941e34c0\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") "
Sep 16 18:31:30.025259 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.025211    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-workload-socket\") pod \"9de123e4-486f-4933-8f0e-358f941e34c0\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") "
Sep 16 18:31:30.025459 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.025260    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-istio-data\") pod \"9de123e4-486f-4933-8f0e-358f941e34c0\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") "
Sep 16 18:31:30.025459 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.025329    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-workload-certs\") pod \"9de123e4-486f-4933-8f0e-358f941e34c0\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") "
Sep 16 18:31:30.025459 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.025391    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzmjp\" (UniqueName: \"kubernetes.io/projected/9de123e4-486f-4933-8f0e-358f941e34c0-kube-api-access-wzmjp\") pod \"9de123e4-486f-4933-8f0e-358f941e34c0\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") "
Sep 16 18:31:30.025459 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.025448    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-istio-envoy\") pod \"9de123e4-486f-4933-8f0e-358f941e34c0\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") "
Sep 16 18:31:30.025652 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.025453    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9de123e4-486f-4933-8f0e-358f941e34c0" (UID: "9de123e4-486f-4933-8f0e-358f941e34c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:31:30.025652 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.025486    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9de123e4-486f-4933-8f0e-358f941e34c0-istio-token\") pod \"9de123e4-486f-4933-8f0e-358f941e34c0\" (UID: \"9de123e4-486f-4933-8f0e-358f941e34c0\") "
Sep 16 18:31:30.025652 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.025515    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9de123e4-486f-4933-8f0e-358f941e34c0" (UID: "9de123e4-486f-4933-8f0e-358f941e34c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:31:30.025652 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.025525    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "9de123e4-486f-4933-8f0e-358f941e34c0" (UID: "9de123e4-486f-4933-8f0e-358f941e34c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:31:30.026684 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.026654    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9de123e4-486f-4933-8f0e-358f941e34c0" (UID: "9de123e4-486f-4933-8f0e-358f941e34c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:31:30.026893 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.026870    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9de123e4-486f-4933-8f0e-358f941e34c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9de123e4-486f-4933-8f0e-358f941e34c0" (UID: "9de123e4-486f-4933-8f0e-358f941e34c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:31:30.027905 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.027861    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9de123e4-486f-4933-8f0e-358f941e34c0" (UID: "9de123e4-486f-4933-8f0e-358f941e34c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:31:30.028029 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.027954    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9de123e4-486f-4933-8f0e-358f941e34c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9de123e4-486f-4933-8f0e-358f941e34c0" (UID: "9de123e4-486f-4933-8f0e-358f941e34c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:31:30.028161 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.028081    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9de123e4-486f-4933-8f0e-358f941e34c0-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:30.028161 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.028101    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:30.028161 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.028111    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9de123e4-486f-4933-8f0e-358f941e34c0-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:30.028161 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.028118    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:30.028161 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.028127    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:30.028161 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.028134    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:30.028161 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.028141    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9de123e4-486f-4933-8f0e-358f941e34c0-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:30.028161 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.028121    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9de123e4-486f-4933-8f0e-358f941e34c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "9de123e4-486f-4933-8f0e-358f941e34c0" (UID: "9de123e4-486f-4933-8f0e-358f941e34c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:31:30.028573 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.028176    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9de123e4-486f-4933-8f0e-358f941e34c0-kube-api-access-wzmjp" (OuterVolumeSpecName: "kube-api-access-wzmjp") pod "9de123e4-486f-4933-8f0e-358f941e34c0" (UID: "9de123e4-486f-4933-8f0e-358f941e34c0"). InnerVolumeSpecName "kube-api-access-wzmjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:31:30.066745 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.066714    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"]
Sep 16 18:31:30.067119 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.067104    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" containerName="istio-proxy"
Sep 16 18:31:30.067119 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.067118    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" containerName="istio-proxy"
Sep 16 18:31:30.067269 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.067139    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" containerName="istio-proxy"
Sep 16 18:31:30.067269 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.067145    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" containerName="istio-proxy"
Sep 16 18:31:30.067269 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.067202    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" containerName="istio-proxy"
Sep 16 18:31:30.067269 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.067210    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" containerName="istio-proxy"
Sep 16 18:31:30.069898 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.069874    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.072055 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.072037    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-78aa4077-serving-cert\""
Sep 16 18:31:30.081238 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.081213    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"]
Sep 16 18:31:30.129417 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.129380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-maas-api-tls\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.129608 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.129465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-openshift-service-ca\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.129608 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.129497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-metrics-certs\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.129734 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.129606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86n9x\" (UniqueName: \"kubernetes.io/projected/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-kube-api-access-86n9x\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.129734 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.129676    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9de123e4-486f-4933-8f0e-358f941e34c0-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:30.129734 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.129701    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzmjp\" (UniqueName: \"kubernetes.io/projected/9de123e4-486f-4933-8f0e-358f941e34c0-kube-api-access-wzmjp\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:31:30.179631 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.179597    2580 generic.go:356] "Generic (PLEG): container finished" podID="9de123e4-486f-4933-8f0e-358f941e34c0" containerID="b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451" exitCode=0
Sep 16 18:31:30.179771 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.179669    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"
Sep 16 18:31:30.179771 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.179679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" event={"ID":"9de123e4-486f-4933-8f0e-358f941e34c0","Type":"ContainerDied","Data":"b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451"}
Sep 16 18:31:30.179771 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.179740    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl" event={"ID":"9de123e4-486f-4933-8f0e-358f941e34c0","Type":"ContainerDied","Data":"6621723de8e48f28507b0d633bc4f4895ef1f8788652dd461e2d7947eaffab1b"}
Sep 16 18:31:30.179771 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.179769    2580 scope.go:117] "RemoveContainer" containerID="b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451"
Sep 16 18:31:30.205172 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.205148    2580 scope.go:117] "RemoveContainer" containerID="b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d"
Sep 16 18:31:30.213866 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.213839    2580 scope.go:117] "RemoveContainer" containerID="b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451"
Sep 16 18:31:30.214134 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:31:30.214112    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451\": container with ID starting with b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451 not found: ID does not exist" containerID="b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451"
Sep 16 18:31:30.214186 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.214145    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451"} err="failed to get container status \"b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451\": rpc error: code = NotFound desc = could not find container \"b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451\": container with ID starting with b2a172856f134f8ace4b88ff428fdefa36db6a7fb1471850882f1651fc1ee451 not found: ID does not exist"
Sep 16 18:31:30.214186 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.214167    2580 scope.go:117] "RemoveContainer" containerID="b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d"
Sep 16 18:31:30.214439 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:31:30.214415    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d\": container with ID starting with b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d not found: ID does not exist" containerID="b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d"
Sep 16 18:31:30.214512 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.214448    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d"} err="failed to get container status \"b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d\": rpc error: code = NotFound desc = could not find container \"b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d\": container with ID starting with b4787e65eb8629cfde0bf247a6eb16f62f1d0534b75e5eb5bd59b9ff15ba4a1d not found: ID does not exist"
Sep 16 18:31:30.215058 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.215042    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"]
Sep 16 18:31:30.221180 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.221160    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-78d09e99-openshift-default-7576976d58-d9jzl"]
Sep 16 18:31:30.230505 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.230488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86n9x\" (UniqueName: \"kubernetes.io/projected/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-kube-api-access-86n9x\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.230586 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.230559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-maas-api-tls\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.230646 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.230632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-openshift-service-ca\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.230702 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.230678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-metrics-certs\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.230893 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:31:30.230877    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-serving-cert: secret "maas-api-e2e-migrate-78aa4077-serving-cert" not found
Sep 16 18:31:30.230963 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:31:30.230941    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-maas-api-tls podName:e4a4c4d1-8aa2-4c77-af3a-4615dc671cab nodeName:}" failed. No retries permitted until 2026-09-16 18:31:30.730922848 +0000 UTC m=+909.373948875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-maas-api-tls") pod "maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb" (UID: "e4a4c4d1-8aa2-4c77-af3a-4615dc671cab") : secret "maas-api-e2e-migrate-78aa4077-serving-cert" not found
Sep 16 18:31:30.231333 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.231312    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-openshift-service-ca\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.232913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.232897    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-metrics-certs\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.238274 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.238255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86n9x\" (UniqueName: \"kubernetes.io/projected/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-kube-api-access-86n9x\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.734787 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.734751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-maas-api-tls\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.737193 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.737162    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-maas-api-tls\") pod \"maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:30.988128 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:30.988035    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:31.261969 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:31.261945    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"]
Sep 16 18:31:31.263506 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:31:31.263476    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a4c4d1_8aa2_4c77_af3a_4615dc671cab.slice/crio-58b118eb713a4e8f12192fc1086f3bbe8cacdf08e0e6b908264baefb99123c4e WatchSource:0}: Error finding container 58b118eb713a4e8f12192fc1086f3bbe8cacdf08e0e6b908264baefb99123c4e: Status 404 returned error can't find the container with id 58b118eb713a4e8f12192fc1086f3bbe8cacdf08e0e6b908264baefb99123c4e
Sep 16 18:31:31.867800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:31.867769    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9de123e4-486f-4933-8f0e-358f941e34c0" path="/var/lib/kubelet/pods/9de123e4-486f-4933-8f0e-358f941e34c0/volumes"
Sep 16 18:31:32.193324 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:32.193291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb" event={"ID":"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab","Type":"ContainerStarted","Data":"830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72"}
Sep 16 18:31:32.193735 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:32.193346    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb" event={"ID":"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab","Type":"ContainerStarted","Data":"58b118eb713a4e8f12192fc1086f3bbe8cacdf08e0e6b908264baefb99123c4e"}
Sep 16 18:31:32.193735 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:32.193388    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:32.213214 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:32.213143    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb" podStartSLOduration=1.822984602 podStartE2EDuration="2.213128623s" totalImagesPullingTime="390.144021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:31:32.212009683 +0000 UTC m=+910.855035723" watchObservedRunningTime="2026-09-16 18:31:32.213128623 +0000 UTC m=+910.856154663"
Sep 16 18:31:38.210653 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:38.210617    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:31:43.973079 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:43.973039    2580 patch_prober.go:28] interesting pod/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:45886->10.134.0.49:15021: read: connection reset by peer" start-of-body=
Sep 16 18:31:43.973522 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:43.973125    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:45886->10.134.0.49:15021: read: connection reset by peer"
Sep 16 18:31:44.267042 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:44.266942    2580 generic.go:356] "Generic (PLEG): container finished" podID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerID="efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b" exitCode=0
Sep 16 18:31:44.267042 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:44.267012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" event={"ID":"cc0898be-63a4-4e21-9050-00fb0c81ddfb","Type":"ContainerDied","Data":"efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b"}
Sep 16 18:31:44.267476 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:44.267460    2580 scope.go:117] "RemoveContainer" containerID="efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b"
Sep 16 18:31:44.268597 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:44.268567    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:31:44.268720 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:44.268668    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:31:44.268784 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:44.268729    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:31:45.273955 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:45.273917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" event={"ID":"cc0898be-63a4-4e21-9050-00fb0c81ddfb","Type":"ContainerStarted","Data":"8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02"}
Sep 16 18:31:46.049919 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:46.049871    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:46.050168 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:46.050141    2580 patch_prober.go:28] interesting pod/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 16 18:31:46.050255 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:46.050215    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 16 18:31:47.050380 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:47.050340    2580 patch_prober.go:28] interesting pod/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 16 18:31:47.050796 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:47.050432    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 16 18:31:48.049810 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:48.049767    2580 patch_prober.go:28] interesting pod/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 16 18:31:48.050005 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:48.049852    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 16 18:31:49.050095 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:49.050054    2580 patch_prober.go:28] interesting pod/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 16 18:31:49.050532 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:49.050114    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 16 18:31:50.050101 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:50.050067    2580 patch_prober.go:28] interesting pod/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 16 18:31:50.050490 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:50.050122    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 16 18:31:51.053679 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:51.053649    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:51.054044 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:51.053888    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:31:51.054551 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:31:51.054537    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:32:00.590264 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.590081    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"]
Sep 16 18:32:00.590787 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.590697    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb" podUID="e4a4c4d1-8aa2-4c77-af3a-4615dc671cab" containerName="maas-api" containerID="cri-o://830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72" gracePeriod=30
Sep 16 18:32:00.850074 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.850011    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:32:00.949315 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.949286    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-openshift-service-ca\") pod \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") "
Sep 16 18:32:00.949555 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.949359    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86n9x\" (UniqueName: \"kubernetes.io/projected/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-kube-api-access-86n9x\") pod \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") "
Sep 16 18:32:00.949555 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.949410    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-maas-api-tls\") pod \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") "
Sep 16 18:32:00.949555 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.949513    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-metrics-certs\") pod \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\" (UID: \"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab\") "
Sep 16 18:32:00.949791 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.949760    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e4a4c4d1-8aa2-4c77-af3a-4615dc671cab" (UID: "e4a4c4d1-8aa2-4c77-af3a-4615dc671cab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:32:00.950402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.950354    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:00.951837 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.951785    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e4a4c4d1-8aa2-4c77-af3a-4615dc671cab" (UID: "e4a4c4d1-8aa2-4c77-af3a-4615dc671cab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:32:00.952052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.952025    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-kube-api-access-86n9x" (OuterVolumeSpecName: "kube-api-access-86n9x") pod "e4a4c4d1-8aa2-4c77-af3a-4615dc671cab" (UID: "e4a4c4d1-8aa2-4c77-af3a-4615dc671cab"). InnerVolumeSpecName "kube-api-access-86n9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:32:00.952052 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.952035    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e4a4c4d1-8aa2-4c77-af3a-4615dc671cab" (UID: "e4a4c4d1-8aa2-4c77-af3a-4615dc671cab"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:32:00.984449 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.984418    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"]
Sep 16 18:32:00.984666 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:00.984624    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy" containerID="cri-o://8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02" gracePeriod=30
Sep 16 18:32:01.051031 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.050997    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86n9x\" (UniqueName: \"kubernetes.io/projected/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-kube-api-access-86n9x\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:01.051031 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.051026    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:01.051031 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.051035    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:01.367011 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.366950    2580 generic.go:356] "Generic (PLEG): container finished" podID="e4a4c4d1-8aa2-4c77-af3a-4615dc671cab" containerID="830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72" exitCode=0
Sep 16 18:32:01.367254 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.367131    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb" event={"ID":"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab","Type":"ContainerDied","Data":"830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72"}
Sep 16 18:32:01.367254 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.367244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb" event={"ID":"e4a4c4d1-8aa2-4c77-af3a-4615dc671cab","Type":"ContainerDied","Data":"58b118eb713a4e8f12192fc1086f3bbe8cacdf08e0e6b908264baefb99123c4e"}
Sep 16 18:32:01.367441 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.367292    2580 scope.go:117] "RemoveContainer" containerID="830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72"
Sep 16 18:32:01.368408 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.367526    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"
Sep 16 18:32:01.383457 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.383429    2580 scope.go:117] "RemoveContainer" containerID="830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72"
Sep 16 18:32:01.383807 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:32:01.383785    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72\": container with ID starting with 830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72 not found: ID does not exist" containerID="830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72"
Sep 16 18:32:01.383868 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.383816    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72"} err="failed to get container status \"830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72\": rpc error: code = NotFound desc = could not find container \"830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72\": container with ID starting with 830eb903529f10cc47da5936f527485eedcc38ff47eb3af813ccca1384efee72 not found: ID does not exist"
Sep 16 18:32:01.401210 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.401185    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"]
Sep 16 18:32:01.410386 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.410352    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-78aa4077-868f9f679-fbdwb"]
Sep 16 18:32:01.797733 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.797639    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"]
Sep 16 18:32:01.798111 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.798095    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4a4c4d1-8aa2-4c77-af3a-4615dc671cab" containerName="maas-api"
Sep 16 18:32:01.798111 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.798112    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4a4c4d1-8aa2-4c77-af3a-4615dc671cab" containerName="maas-api"
Sep 16 18:32:01.798201 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.798176    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4a4c4d1-8aa2-4c77-af3a-4615dc671cab" containerName="maas-api"
Sep 16 18:32:01.801053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.801030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.804536 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.804513    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-69621cf4-openshift-default-dockercfg-7rkzw\""
Sep 16 18:32:01.818102 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.818076    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"]
Sep 16 18:32:01.860184 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.860145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-data\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.860415 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.860196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istiod-ca-cert\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.860415 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.860233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-podinfo\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.860415 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.860260    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-envoy\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.860415 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.860392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qrc6\" (UniqueName: \"kubernetes.io/projected/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-kube-api-access-9qrc6\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.860634 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.860462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-credential-socket\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.860634 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.860516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-workload-certs\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.860634 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.860546    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-workload-socket\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.860634 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.860568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-token\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.869838 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.869810    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4a4c4d1-8aa2-4c77-af3a-4615dc671cab" path="/var/lib/kubelet/pods/e4a4c4d1-8aa2-4c77-af3a-4615dc671cab/volumes"
Sep 16 18:32:01.961549 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.961513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qrc6\" (UniqueName: \"kubernetes.io/projected/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-kube-api-access-9qrc6\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.961728 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.961558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-credential-socket\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.961809 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.961749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-workload-certs\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.961809 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.961795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-workload-socket\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.961915 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.961840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-token\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.961915 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.961892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-data\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.962020 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.961932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istiod-ca-cert\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.962020 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.961966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-credential-socket\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.962020 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.961984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-podinfo\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.962224 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.962034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-envoy\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.962224 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.962094    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-workload-certs\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.962224 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.962148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-workload-socket\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.962224 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.962196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-data\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.962647 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.962623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istiod-ca-cert\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.964295 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.964274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-envoy\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.964395 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.964343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-podinfo\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.970347 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.970327    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-token\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:01.970452 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:01.970349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qrc6\" (UniqueName: \"kubernetes.io/projected/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-kube-api-access-9qrc6\") pod \"e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") " pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:02.112739 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:02.112707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:02.394853 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:02.394830    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"]
Sep 16 18:32:02.397051 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:32:02.397023    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78bfbfcb_03c4_4bf1_9241_9d6f581c2883.slice/crio-0def72c6b7903d5b01cbd9d4d72ed7dc80f11038fa704636ed73dac002975ca8 WatchSource:0}: Error finding container 0def72c6b7903d5b01cbd9d4d72ed7dc80f11038fa704636ed73dac002975ca8: Status 404 returned error can't find the container with id 0def72c6b7903d5b01cbd9d4d72ed7dc80f11038fa704636ed73dac002975ca8
Sep 16 18:32:02.399223 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:02.399191    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:32:02.399287 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:02.399261    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:32:02.399331 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:02.399291    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:32:03.381534 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:03.381493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" event={"ID":"78bfbfcb-03c4-4bf1-9241-9d6f581c2883","Type":"ContainerStarted","Data":"5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3"}
Sep 16 18:32:03.381890 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:03.381552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" event={"ID":"78bfbfcb-03c4-4bf1-9241-9d6f581c2883","Type":"ContainerStarted","Data":"0def72c6b7903d5b01cbd9d4d72ed7dc80f11038fa704636ed73dac002975ca8"}
Sep 16 18:32:03.406779 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:03.406732    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" podStartSLOduration=2.40671777 podStartE2EDuration="2.40671777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:32:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:32:03.403505518 +0000 UTC m=+942.046531579" watchObservedRunningTime="2026-09-16 18:32:03.40671777 +0000 UTC m=+942.049743808"
Sep 16 18:32:04.113172 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:04.113132    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:04.118038 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:04.118013    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:04.387814 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:04.387734    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:04.388652 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:04.388634    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:06.055188 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.055151    2580 patch_prober.go:28] interesting pod/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 16 18:32:06.055561 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.055210    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 16 18:32:06.228917 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.228890    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:32:06.269588 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.269506    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"]
Sep 16 18:32:06.269915 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.269902    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy"
Sep 16 18:32:06.269962 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.269916    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy"
Sep 16 18:32:06.269999 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.269991    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy"
Sep 16 18:32:06.269999 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.269998    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy"
Sep 16 18:32:06.271873 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.271856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.274330 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.274300    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-69621cf4-serving-cert\""
Sep 16 18:32:06.287178 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.287149    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"]
Sep 16 18:32:06.304826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.304799    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-podinfo\") pod \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") "
Sep 16 18:32:06.304989 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.304836    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istiod-ca-cert\") pod \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") "
Sep 16 18:32:06.304989 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.304876    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-credential-socket\") pod \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") "
Sep 16 18:32:06.304989 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.304902    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jndmw\" (UniqueName: \"kubernetes.io/projected/cc0898be-63a4-4e21-9050-00fb0c81ddfb-kube-api-access-jndmw\") pod \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") "
Sep 16 18:32:06.304989 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.304929    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-workload-certs\") pod \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") "
Sep 16 18:32:06.305188 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305013    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-data\") pod \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") "
Sep 16 18:32:06.305188 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305060    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-token\") pod \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") "
Sep 16 18:32:06.305188 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305090    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-envoy\") pod \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") "
Sep 16 18:32:06.305188 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305116    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-workload-socket\") pod \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\" (UID: \"cc0898be-63a4-4e21-9050-00fb0c81ddfb\") "
Sep 16 18:32:06.305482 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305460    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-maas-api-tls\") pod \"maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.305554 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-metrics-certs\") pod \"maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.305554 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305513    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc0898be-63a4-4e21-9050-00fb0c81ddfb" (UID: "cc0898be-63a4-4e21-9050-00fb0c81ddfb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:32:06.305656 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfgbq\" (UniqueName: \"kubernetes.io/projected/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-kube-api-access-qfgbq\") pod \"maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.305656 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-openshift-service-ca\") pod \"maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.305759 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305664    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc0898be-63a4-4e21-9050-00fb0c81ddfb" (UID: "cc0898be-63a4-4e21-9050-00fb0c81ddfb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:32:06.306047 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305801    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc0898be-63a4-4e21-9050-00fb0c81ddfb" (UID: "cc0898be-63a4-4e21-9050-00fb0c81ddfb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:32:06.306047 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305888    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc0898be-63a4-4e21-9050-00fb0c81ddfb" (UID: "cc0898be-63a4-4e21-9050-00fb0c81ddfb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:32:06.306047 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305940    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:06.306047 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305965    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:06.306047 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305979    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:06.306047 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.305845    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc0898be-63a4-4e21-9050-00fb0c81ddfb" (UID: "cc0898be-63a4-4e21-9050-00fb0c81ddfb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:32:06.307591 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.307543    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc0898be-63a4-4e21-9050-00fb0c81ddfb" (UID: "cc0898be-63a4-4e21-9050-00fb0c81ddfb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:32:06.307870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.307841    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc0898be-63a4-4e21-9050-00fb0c81ddfb" (UID: "cc0898be-63a4-4e21-9050-00fb0c81ddfb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:32:06.308200 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.308176    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc0898be-63a4-4e21-9050-00fb0c81ddfb" (UID: "cc0898be-63a4-4e21-9050-00fb0c81ddfb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:32:06.308454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.308435    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0898be-63a4-4e21-9050-00fb0c81ddfb-kube-api-access-jndmw" (OuterVolumeSpecName: "kube-api-access-jndmw") pod "cc0898be-63a4-4e21-9050-00fb0c81ddfb" (UID: "cc0898be-63a4-4e21-9050-00fb0c81ddfb"). InnerVolumeSpecName "kube-api-access-jndmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:32:06.399524 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.399488    2580 generic.go:356] "Generic (PLEG): container finished" podID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerID="8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02" exitCode=0
Sep 16 18:32:06.399661 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.399542    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"
Sep 16 18:32:06.399661 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.399570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" event={"ID":"cc0898be-63a4-4e21-9050-00fb0c81ddfb","Type":"ContainerDied","Data":"8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02"}
Sep 16 18:32:06.399661 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.399623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl" event={"ID":"cc0898be-63a4-4e21-9050-00fb0c81ddfb","Type":"ContainerDied","Data":"2472769c1454bc9bbdb4f1b75b91cb1883f584509b6e6ef6b1b6fe7014c57f01"}
Sep 16 18:32:06.399661 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.399644    2580 scope.go:117] "RemoveContainer" containerID="8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02"
Sep 16 18:32:06.407198 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.407150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-maas-api-tls\") pod \"maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.407281 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.407199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-metrics-certs\") pod \"maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.407281 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.407245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfgbq\" (UniqueName: \"kubernetes.io/projected/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-kube-api-access-qfgbq\") pod \"maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.407502 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.407282    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-openshift-service-ca\") pod \"maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.407502 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.407423    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:06.407502 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.407440    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:06.407502 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.407454    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:06.407502 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.407467    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0898be-63a4-4e21-9050-00fb0c81ddfb-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:06.407502 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.407479    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0898be-63a4-4e21-9050-00fb0c81ddfb-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:06.407502 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.407494    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jndmw\" (UniqueName: \"kubernetes.io/projected/cc0898be-63a4-4e21-9050-00fb0c81ddfb-kube-api-access-jndmw\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:06.408106 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.408083    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-openshift-service-ca\") pod \"maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.409285 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.409271    2580 scope.go:117] "RemoveContainer" containerID="efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b"
Sep 16 18:32:06.409573 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.409550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-metrics-certs\") pod \"maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.409671 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.409654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-maas-api-tls\") pod \"maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.431656 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.418588    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfgbq\" (UniqueName: \"kubernetes.io/projected/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-kube-api-access-qfgbq\") pod \"maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.431656 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.420690    2580 scope.go:117] "RemoveContainer" containerID="8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02"
Sep 16 18:32:06.431656 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:32:06.421139    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02\": container with ID starting with 8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02 not found: ID does not exist" containerID="8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02"
Sep 16 18:32:06.431656 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.422571    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02"} err="failed to get container status \"8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02\": rpc error: code = NotFound desc = could not find container \"8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02\": container with ID starting with 8075ec9c504d0d9294dafc35753347182afb01e184eb161c08b9ab78da30fb02 not found: ID does not exist"
Sep 16 18:32:06.431656 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.422612    2580 scope.go:117] "RemoveContainer" containerID="efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b"
Sep 16 18:32:06.431656 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:32:06.428702    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b\": container with ID starting with efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b not found: ID does not exist" containerID="efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b"
Sep 16 18:32:06.431656 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.428740    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b"} err="failed to get container status \"efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b\": rpc error: code = NotFound desc = could not find container \"efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b\": container with ID starting with efeb2fbc4e0eb058a045cc7961f758e9ec176fb877de0524a83d65aa0bbff23b not found: ID does not exist"
Sep 16 18:32:06.431656 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.428903    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"]
Sep 16 18:32:06.436883 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.436849    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-78aa4077-gw-openshift-default-f4b644bd8-b6htl"]
Sep 16 18:32:06.585791 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.585760    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:06.860474 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.860443    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"]
Sep 16 18:32:06.861774 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:32:06.861747    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3cfefc8_e99c_4ab6_bf89_1eb103547e0b.slice/crio-4243e5cc1aa758dffa2d77b1626524c670a49d96ee3ef34877ed0c14df33930c WatchSource:0}: Error finding container 4243e5cc1aa758dffa2d77b1626524c670a49d96ee3ef34877ed0c14df33930c: Status 404 returned error can't find the container with id 4243e5cc1aa758dffa2d77b1626524c670a49d96ee3ef34877ed0c14df33930c
Sep 16 18:32:06.863192 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:06.863175    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:32:07.407156 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:07.407119    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf" event={"ID":"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b","Type":"ContainerStarted","Data":"750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b"}
Sep 16 18:32:07.407590 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:07.407177    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf" event={"ID":"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b","Type":"ContainerStarted","Data":"4243e5cc1aa758dffa2d77b1626524c670a49d96ee3ef34877ed0c14df33930c"}
Sep 16 18:32:07.407590 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:07.407211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:07.427302 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:07.427254    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf" podStartSLOduration=1.053317804 podStartE2EDuration="1.427237894s" totalImagesPullingTime="373.92009ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:32:07.424324007 +0000 UTC m=+946.067350046" watchObservedRunningTime="2026-09-16 18:32:07.427237894 +0000 UTC m=+946.070263933"
Sep 16 18:32:07.872937 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:07.872893    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" path="/var/lib/kubelet/pods/cc0898be-63a4-4e21-9050-00fb0c81ddfb/volumes"
Sep 16 18:32:13.418800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:13.418764    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:29.550201 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:29.550164    2580 generic.go:356] "Generic (PLEG): container finished" podID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerID="5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3" exitCode=0
Sep 16 18:32:29.550588 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:29.550234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" event={"ID":"78bfbfcb-03c4-4bf1-9241-9d6f581c2883","Type":"ContainerDied","Data":"5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3"}
Sep 16 18:32:29.550655 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:29.550643    2580 scope.go:117] "RemoveContainer" containerID="5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3"
Sep 16 18:32:29.551737 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:29.551709    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:32:29.551841 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:29.551793    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:32:29.551907 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:29.551838    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:32:30.557839 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:30.557805    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" event={"ID":"78bfbfcb-03c4-4bf1-9241-9d6f581c2883","Type":"ContainerStarted","Data":"0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d"}
Sep 16 18:32:31.114517 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:31.114482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:31.114846 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:31.114823    2580 patch_prober.go:28] interesting pod/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 16 18:32:31.115009 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:31.114986    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 16 18:32:32.113700 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:32.113663    2580 patch_prober.go:28] interesting pod/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 16 18:32:32.114301 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:32.114264    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 16 18:32:33.113943 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.113899    2580 patch_prober.go:28] interesting pod/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 16 18:32:33.114441 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.113969    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 16 18:32:33.642826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.642788    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"]
Sep 16 18:32:33.643200 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.643189    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy"
Sep 16 18:32:33.643254 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.643202    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0898be-63a4-4e21-9050-00fb0c81ddfb" containerName="istio-proxy"
Sep 16 18:32:33.645406 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.645390    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.647885 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.647865    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0197e4\"/\"test-model-0197e4-kserve-self-signed-certs\""
Sep 16 18:32:33.648776 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.648757    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0197e4\"/\"kube-root-ca.crt\""
Sep 16 18:32:33.648878 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.648761    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0197e4\"/\"default-dockercfg-pndf8\""
Sep 16 18:32:33.648878 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.648794    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0197e4\"/\"openshift-service-ca.crt\""
Sep 16 18:32:33.660654 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.660632    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"]
Sep 16 18:32:33.773924 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.773887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-model-cache\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.774099 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.773999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-tmp-dir\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.774099 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.774043    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-home\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.774198 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.774100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d202f8c-94b7-4456-8188-5a265c96b454-tls-certs\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.774254 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.774232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-dshm\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.774292 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.774272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj8rl\" (UniqueName: \"kubernetes.io/projected/2d202f8c-94b7-4456-8188-5a265c96b454-kube-api-access-dj8rl\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.875360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.875323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-tmp-dir\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.875561 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.875397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-home\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.875561 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.875437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d202f8c-94b7-4456-8188-5a265c96b454-tls-certs\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.875561 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.875538    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-dshm\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.875727 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.875563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj8rl\" (UniqueName: \"kubernetes.io/projected/2d202f8c-94b7-4456-8188-5a265c96b454-kube-api-access-dj8rl\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.875727 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.875603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-model-cache\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.875839 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.875788    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-tmp-dir\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.875839 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.875810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-home\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.875991 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.875973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-model-cache\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.877751 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.877734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-dshm\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.878445 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.878429    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d202f8c-94b7-4456-8188-5a265c96b454-tls-certs\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.890057 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.890034    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj8rl\" (UniqueName: \"kubernetes.io/projected/2d202f8c-94b7-4456-8188-5a265c96b454-kube-api-access-dj8rl\") pod \"test-model-0197e4-kserve-6cc868c5d9-2s82m\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") " pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:33.954654 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:33.954569    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:34.118390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:34.117752    2580 patch_prober.go:28] interesting pod/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 16 18:32:34.118390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:34.117817    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 16 18:32:34.277203 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:34.277181    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"]
Sep 16 18:32:34.278765 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:32:34.278741    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d202f8c_94b7_4456_8188_5a265c96b454.slice/crio-8adde3b45c7d874410027fd40b41628021ee050c87ba4bc23924d868633d4e0c WatchSource:0}: Error finding container 8adde3b45c7d874410027fd40b41628021ee050c87ba4bc23924d868633d4e0c: Status 404 returned error can't find the container with id 8adde3b45c7d874410027fd40b41628021ee050c87ba4bc23924d868633d4e0c
Sep 16 18:32:34.387975 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:34.387951    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:34.581799 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:34.581720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m" event={"ID":"2d202f8c-94b7-4456-8188-5a265c96b454","Type":"ContainerStarted","Data":"6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780"}
Sep 16 18:32:34.581799 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:34.581760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m" event={"ID":"2d202f8c-94b7-4456-8188-5a265c96b454","Type":"ContainerStarted","Data":"8adde3b45c7d874410027fd40b41628021ee050c87ba4bc23924d868633d4e0c"}
Sep 16 18:32:34.625974 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:34.625909    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m" podStartSLOduration=1.625800001 podStartE2EDuration="1.625800001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:32:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:32:34.620806891 +0000 UTC m=+973.263832934" watchObservedRunningTime="2026-09-16 18:32:34.625800001 +0000 UTC m=+973.268826043"
Sep 16 18:32:35.116391 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:35.114714    2580 patch_prober.go:28] interesting pod/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 16 18:32:35.116391 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:35.114778    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 16 18:32:36.116938 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:36.116909    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:36.117912 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:36.117890    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:41.161077 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.161043    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"]
Sep 16 18:32:41.161556 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.161247    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf" podUID="c3cfefc8-e99c-4ab6-bf89-1eb103547e0b" containerName="maas-api" containerID="cri-o://750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b" gracePeriod=30
Sep 16 18:32:41.412714 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.412644    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:41.559837 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.559804    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfgbq\" (UniqueName: \"kubernetes.io/projected/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-kube-api-access-qfgbq\") pod \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") "
Sep 16 18:32:41.560019 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.559860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-maas-api-tls\") pod \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") "
Sep 16 18:32:41.560019 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.559887    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-metrics-certs\") pod \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") "
Sep 16 18:32:41.560019 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.559989    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-openshift-service-ca\") pod \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\" (UID: \"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b\") "
Sep 16 18:32:41.560344 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.560320    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c3cfefc8-e99c-4ab6-bf89-1eb103547e0b" (UID: "c3cfefc8-e99c-4ab6-bf89-1eb103547e0b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:32:41.562166 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.562139    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-kube-api-access-qfgbq" (OuterVolumeSpecName: "kube-api-access-qfgbq") pod "c3cfefc8-e99c-4ab6-bf89-1eb103547e0b" (UID: "c3cfefc8-e99c-4ab6-bf89-1eb103547e0b"). InnerVolumeSpecName "kube-api-access-qfgbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:32:41.562400 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.562359    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c3cfefc8-e99c-4ab6-bf89-1eb103547e0b" (UID: "c3cfefc8-e99c-4ab6-bf89-1eb103547e0b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:32:41.562496 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.562482    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c3cfefc8-e99c-4ab6-bf89-1eb103547e0b" (UID: "c3cfefc8-e99c-4ab6-bf89-1eb103547e0b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:32:41.638590 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.638551    2580 generic.go:356] "Generic (PLEG): container finished" podID="c3cfefc8-e99c-4ab6-bf89-1eb103547e0b" containerID="750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b" exitCode=0
Sep 16 18:32:41.638781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.638695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf" event={"ID":"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b","Type":"ContainerDied","Data":"750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b"}
Sep 16 18:32:41.638781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.638744    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf" event={"ID":"c3cfefc8-e99c-4ab6-bf89-1eb103547e0b","Type":"ContainerDied","Data":"4243e5cc1aa758dffa2d77b1626524c670a49d96ee3ef34877ed0c14df33930c"}
Sep 16 18:32:41.638781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.638775    2580 scope.go:117] "RemoveContainer" containerID="750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b"
Sep 16 18:32:41.638976 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.638957    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"
Sep 16 18:32:41.666116 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.666042    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfgbq\" (UniqueName: \"kubernetes.io/projected/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-kube-api-access-qfgbq\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:41.666352 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.666295    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:41.666352 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.666317    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:41.666604 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.666331    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:41.666604 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.666246    2580 scope.go:117] "RemoveContainer" containerID="750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b"
Sep 16 18:32:41.671241 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:32:41.667202    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b\": container with ID starting with 750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b not found: ID does not exist" containerID="750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b"
Sep 16 18:32:41.671241 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.667241    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b"} err="failed to get container status \"750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b\": rpc error: code = NotFound desc = could not find container \"750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b\": container with ID starting with 750b4e088dc78ac9893b182ee7bf5fd608259b9c60b9790ee1342797baf3384b not found: ID does not exist"
Sep 16 18:32:41.693472 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.693441    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"]
Sep 16 18:32:41.697486 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.697456    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69621cf4-754c86fd7b-ld2cf"]
Sep 16 18:32:41.867236 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:41.867201    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3cfefc8-e99c-4ab6-bf89-1eb103547e0b" path="/var/lib/kubelet/pods/c3cfefc8-e99c-4ab6-bf89-1eb103547e0b/volumes"
Sep 16 18:32:42.747754 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:42.747723    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"]
Sep 16 18:32:42.748164 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:42.747959    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerName="istio-proxy" containerID="cri-o://0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d" gracePeriod=30
Sep 16 18:32:43.955678 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:43.955640    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:43.955678 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:43.955688    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:43.968520 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:43.968494    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:44.668162 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:44.668134    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:32:47.997084 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:47.997063    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:48.027824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.027764    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-data\") pod \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") "
Sep 16 18:32:48.027953 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.027823    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-workload-certs\") pod \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") "
Sep 16 18:32:48.027953 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.027855    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-token\") pod \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") "
Sep 16 18:32:48.027953 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.027891    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-podinfo\") pod \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") "
Sep 16 18:32:48.027953 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.027927    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-envoy\") pod \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") "
Sep 16 18:32:48.028166 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028034    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-data" (OuterVolumeSpecName: "istio-data") pod "78bfbfcb-03c4-4bf1-9241-9d6f581c2883" (UID: "78bfbfcb-03c4-4bf1-9241-9d6f581c2883"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:32:48.028166 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028122    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "78bfbfcb-03c4-4bf1-9241-9d6f581c2883" (UID: "78bfbfcb-03c4-4bf1-9241-9d6f581c2883"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:32:48.028276 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028173    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istiod-ca-cert\") pod \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") "
Sep 16 18:32:48.028276 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028214    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-credential-socket\") pod \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") "
Sep 16 18:32:48.028276 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028271    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qrc6\" (UniqueName: \"kubernetes.io/projected/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-kube-api-access-9qrc6\") pod \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") "
Sep 16 18:32:48.028463 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028386    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-workload-socket\") pod \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\" (UID: \"78bfbfcb-03c4-4bf1-9241-9d6f581c2883\") "
Sep 16 18:32:48.028586 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028560    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "78bfbfcb-03c4-4bf1-9241-9d6f581c2883" (UID: "78bfbfcb-03c4-4bf1-9241-9d6f581c2883"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:32:48.029021 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028793    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "78bfbfcb-03c4-4bf1-9241-9d6f581c2883" (UID: "78bfbfcb-03c4-4bf1-9241-9d6f581c2883"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:32:48.029021 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028910    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:48.029021 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028932    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:48.029021 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028947    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:48.029021 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028961    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:48.029021 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.028972    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "78bfbfcb-03c4-4bf1-9241-9d6f581c2883" (UID: "78bfbfcb-03c4-4bf1-9241-9d6f581c2883"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:32:48.030609 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.030579    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-token" (OuterVolumeSpecName: "istio-token") pod "78bfbfcb-03c4-4bf1-9241-9d6f581c2883" (UID: "78bfbfcb-03c4-4bf1-9241-9d6f581c2883"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:32:48.030709 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.030656    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "78bfbfcb-03c4-4bf1-9241-9d6f581c2883" (UID: "78bfbfcb-03c4-4bf1-9241-9d6f581c2883"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:32:48.030709 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.030663    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "78bfbfcb-03c4-4bf1-9241-9d6f581c2883" (UID: "78bfbfcb-03c4-4bf1-9241-9d6f581c2883"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:32:48.031224 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.031202    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-kube-api-access-9qrc6" (OuterVolumeSpecName: "kube-api-access-9qrc6") pod "78bfbfcb-03c4-4bf1-9241-9d6f581c2883" (UID: "78bfbfcb-03c4-4bf1-9241-9d6f581c2883"). InnerVolumeSpecName "kube-api-access-9qrc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:32:48.129875 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.129846    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:48.129875 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.129871    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:48.129875 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.129880    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:48.130071 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.129888    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:48.130071 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.129896    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qrc6\" (UniqueName: \"kubernetes.io/projected/78bfbfcb-03c4-4bf1-9241-9d6f581c2883-kube-api-access-9qrc6\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:48.176878 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.176847    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"]
Sep 16 18:32:48.177413 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.177395    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerName="istio-proxy"
Sep 16 18:32:48.177413 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.177413    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerName="istio-proxy"
Sep 16 18:32:48.177607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.177448    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3cfefc8-e99c-4ab6-bf89-1eb103547e0b" containerName="maas-api"
Sep 16 18:32:48.177607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.177457    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3cfefc8-e99c-4ab6-bf89-1eb103547e0b" containerName="maas-api"
Sep 16 18:32:48.177607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.177555    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerName="istio-proxy"
Sep 16 18:32:48.177607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.177567    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerName="istio-proxy"
Sep 16 18:32:48.177607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.177578    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3cfefc8-e99c-4ab6-bf89-1eb103547e0b" containerName="maas-api"
Sep 16 18:32:48.180241 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.180200    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.186922 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.186734    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-7e8b5de5-serving-cert\""
Sep 16 18:32:48.201515 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.201489    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"]
Sep 16 18:32:48.230493 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.230465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-metrics-certs\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.230597 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.230499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75rlf\" (UniqueName: \"kubernetes.io/projected/6982a2b7-afad-4347-82b2-d6250cd45bca-kube-api-access-75rlf\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.230597 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.230515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6982a2b7-afad-4347-82b2-d6250cd45bca-openshift-service-ca\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.230690 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.230606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-maas-api-tls\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.331860 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.331773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-metrics-certs\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.331860 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.331808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75rlf\" (UniqueName: \"kubernetes.io/projected/6982a2b7-afad-4347-82b2-d6250cd45bca-kube-api-access-75rlf\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.331860 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.331826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6982a2b7-afad-4347-82b2-d6250cd45bca-openshift-service-ca\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.332135 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.331882    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-maas-api-tls\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.332135 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:32:48.332025    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-serving-cert: secret "maas-api-e2e-derive-7e8b5de5-serving-cert" not found
Sep 16 18:32:48.332135 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:32:48.332083    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-maas-api-tls podName:6982a2b7-afad-4347-82b2-d6250cd45bca nodeName:}" failed. No retries permitted until 2026-09-16 18:32:48.832065403 +0000 UTC m=+987.475091436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-maas-api-tls") pod "maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z" (UID: "6982a2b7-afad-4347-82b2-d6250cd45bca") : secret "maas-api-e2e-derive-7e8b5de5-serving-cert" not found
Sep 16 18:32:48.332581 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.332559    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6982a2b7-afad-4347-82b2-d6250cd45bca-openshift-service-ca\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.334140 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.334119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-metrics-certs\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.352204 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.352183    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75rlf\" (UniqueName: \"kubernetes.io/projected/6982a2b7-afad-4347-82b2-d6250cd45bca-kube-api-access-75rlf\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.680718 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.680628    2580 generic.go:356] "Generic (PLEG): container finished" podID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerID="0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d" exitCode=0
Sep 16 18:32:48.680861 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.680708    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" event={"ID":"78bfbfcb-03c4-4bf1-9241-9d6f581c2883","Type":"ContainerDied","Data":"0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d"}
Sep 16 18:32:48.680861 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.680724    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"
Sep 16 18:32:48.680861 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.680764    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg" event={"ID":"78bfbfcb-03c4-4bf1-9241-9d6f581c2883","Type":"ContainerDied","Data":"0def72c6b7903d5b01cbd9d4d72ed7dc80f11038fa704636ed73dac002975ca8"}
Sep 16 18:32:48.680861 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.680786    2580 scope.go:117] "RemoveContainer" containerID="0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d"
Sep 16 18:32:48.693483 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.693466    2580 scope.go:117] "RemoveContainer" containerID="5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3"
Sep 16 18:32:48.701306 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.701290    2580 scope.go:117] "RemoveContainer" containerID="0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d"
Sep 16 18:32:48.701579 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:32:48.701558    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d\": container with ID starting with 0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d not found: ID does not exist" containerID="0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d"
Sep 16 18:32:48.701629 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.701588    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d"} err="failed to get container status \"0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d\": rpc error: code = NotFound desc = could not find container \"0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d\": container with ID starting with 0db5cb29b9e59665202de9755d3f8e4b64ce0dd8abe29c1d159ff37a41e48a0d not found: ID does not exist"
Sep 16 18:32:48.701629 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.701605    2580 scope.go:117] "RemoveContainer" containerID="5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3"
Sep 16 18:32:48.701885 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:32:48.701863    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3\": container with ID starting with 5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3 not found: ID does not exist" containerID="5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3"
Sep 16 18:32:48.701930 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.701893    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3"} err="failed to get container status \"5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3\": rpc error: code = NotFound desc = could not find container \"5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3\": container with ID starting with 5949469ba9b7424f3561fc060379d482df55e48ce3b9c0095ac2d79a2cb462e3 not found: ID does not exist"
Sep 16 18:32:48.729184 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.729146    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"]
Sep 16 18:32:48.735098 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.735079    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-69621cf4-openshift-default-665778b4db-4bjvg"]
Sep 16 18:32:48.834784 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.834750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-maas-api-tls\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:48.837007 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:48.836982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-maas-api-tls\") pod \"maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:49.098762 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:49.098735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:49.389426 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:49.389395    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"]
Sep 16 18:32:49.390360 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:32:49.390338    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6982a2b7_afad_4347_82b2_d6250cd45bca.slice/crio-0aa5cd0a61e2b5ba604bfab53ed9d2612f8568be0f230127ca6b5a0f795be0de WatchSource:0}: Error finding container 0aa5cd0a61e2b5ba604bfab53ed9d2612f8568be0f230127ca6b5a0f795be0de: Status 404 returned error can't find the container with id 0aa5cd0a61e2b5ba604bfab53ed9d2612f8568be0f230127ca6b5a0f795be0de
Sep 16 18:32:49.687903 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:49.687821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z" event={"ID":"6982a2b7-afad-4347-82b2-d6250cd45bca","Type":"ContainerStarted","Data":"0aa5cd0a61e2b5ba604bfab53ed9d2612f8568be0f230127ca6b5a0f795be0de"}
Sep 16 18:32:49.866258 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:49.866227    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" path="/var/lib/kubelet/pods/78bfbfcb-03c4-4bf1-9241-9d6f581c2883/volumes"
Sep 16 18:32:50.694980 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:50.694933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z" event={"ID":"6982a2b7-afad-4347-82b2-d6250cd45bca","Type":"ContainerStarted","Data":"b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02"}
Sep 16 18:32:50.695389 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:50.695014    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:32:50.725506 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:50.725454    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z" podStartSLOduration=2.193614568 podStartE2EDuration="2.725438082s" totalImagesPullingTime="531.823514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:32:50.723729434 +0000 UTC m=+989.366755478" watchObservedRunningTime="2026-09-16 18:32:50.725438082 +0000 UTC m=+989.368464190"
Sep 16 18:32:52.118755 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.118723    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"]
Sep 16 18:32:52.119118 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.118921    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98" podUID="bac863fb-7b5b-429c-bdbf-b455d8601b51" containerName="maas-api" containerID="cri-o://16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055" gracePeriod=30
Sep 16 18:32:52.361596 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.361575    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:32:52.470948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.470859    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac863fb-7b5b-429c-bdbf-b455d8601b51-openshift-service-ca\") pod \"bac863fb-7b5b-429c-bdbf-b455d8601b51\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") "
Sep 16 18:32:52.470948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.470901    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9vnn\" (UniqueName: \"kubernetes.io/projected/bac863fb-7b5b-429c-bdbf-b455d8601b51-kube-api-access-j9vnn\") pod \"bac863fb-7b5b-429c-bdbf-b455d8601b51\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") "
Sep 16 18:32:52.471152 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.471038    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac863fb-7b5b-429c-bdbf-b455d8601b51-maas-api-tls\") pod \"bac863fb-7b5b-429c-bdbf-b455d8601b51\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") "
Sep 16 18:32:52.471152 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.471083    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bac863fb-7b5b-429c-bdbf-b455d8601b51-metrics-certs\") pod \"bac863fb-7b5b-429c-bdbf-b455d8601b51\" (UID: \"bac863fb-7b5b-429c-bdbf-b455d8601b51\") "
Sep 16 18:32:52.471260 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.471228    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bac863fb-7b5b-429c-bdbf-b455d8601b51-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bac863fb-7b5b-429c-bdbf-b455d8601b51" (UID: "bac863fb-7b5b-429c-bdbf-b455d8601b51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:32:52.471412 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.471395    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac863fb-7b5b-429c-bdbf-b455d8601b51-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:52.473100 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.473071    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac863fb-7b5b-429c-bdbf-b455d8601b51-kube-api-access-j9vnn" (OuterVolumeSpecName: "kube-api-access-j9vnn") pod "bac863fb-7b5b-429c-bdbf-b455d8601b51" (UID: "bac863fb-7b5b-429c-bdbf-b455d8601b51"). InnerVolumeSpecName "kube-api-access-j9vnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:32:52.473100 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.473095    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bac863fb-7b5b-429c-bdbf-b455d8601b51-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bac863fb-7b5b-429c-bdbf-b455d8601b51" (UID: "bac863fb-7b5b-429c-bdbf-b455d8601b51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:32:52.473218 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.473138    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bac863fb-7b5b-429c-bdbf-b455d8601b51-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bac863fb-7b5b-429c-bdbf-b455d8601b51" (UID: "bac863fb-7b5b-429c-bdbf-b455d8601b51"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:32:52.572090 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.572058    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9vnn\" (UniqueName: \"kubernetes.io/projected/bac863fb-7b5b-429c-bdbf-b455d8601b51-kube-api-access-j9vnn\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:52.572090 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.572087    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac863fb-7b5b-429c-bdbf-b455d8601b51-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:52.572090 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.572096    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bac863fb-7b5b-429c-bdbf-b455d8601b51-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:32:52.707917 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.707877    2580 generic.go:356] "Generic (PLEG): container finished" podID="bac863fb-7b5b-429c-bdbf-b455d8601b51" containerID="16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055" exitCode=0
Sep 16 18:32:52.707917 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.707919    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"
Sep 16 18:32:52.708144 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.707920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98" event={"ID":"bac863fb-7b5b-429c-bdbf-b455d8601b51","Type":"ContainerDied","Data":"16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055"}
Sep 16 18:32:52.708144 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.707973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98" event={"ID":"bac863fb-7b5b-429c-bdbf-b455d8601b51","Type":"ContainerDied","Data":"bd9cf44b2d84b28f8ec047ab8f58b92b90c6ee143b639e21de1f609eaeb3c187"}
Sep 16 18:32:52.708144 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.707999    2580 scope.go:117] "RemoveContainer" containerID="16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055"
Sep 16 18:32:52.721654 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.718409    2580 scope.go:117] "RemoveContainer" containerID="16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055"
Sep 16 18:32:52.721654 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:32:52.718768    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055\": container with ID starting with 16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055 not found: ID does not exist" containerID="16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055"
Sep 16 18:32:52.721654 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.718807    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055"} err="failed to get container status \"16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055\": rpc error: code = NotFound desc = could not find container \"16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055\": container with ID starting with 16b78f119437838003dae2f6e2367320724c6093ddcf6b7302508044aff08055 not found: ID does not exist"
Sep 16 18:32:52.758026 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.757993    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"]
Sep 16 18:32:52.779692 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:52.779665    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-305998-85b588676-m2l98"]
Sep 16 18:32:53.866669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:53.866640    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bac863fb-7b5b-429c-bdbf-b455d8601b51" path="/var/lib/kubelet/pods/bac863fb-7b5b-429c-bdbf-b455d8601b51/volumes"
Sep 16 18:32:56.706941 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:32:56.706912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:33:00.709497 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.709461    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"]
Sep 16 18:33:00.710018 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.710003    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac863fb-7b5b-429c-bdbf-b455d8601b51" containerName="maas-api"
Sep 16 18:33:00.710070 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.710021    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac863fb-7b5b-429c-bdbf-b455d8601b51" containerName="maas-api"
Sep 16 18:33:00.710070 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.710033    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerName="istio-proxy"
Sep 16 18:33:00.710070 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.710041    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="78bfbfcb-03c4-4bf1-9241-9d6f581c2883" containerName="istio-proxy"
Sep 16 18:33:00.710186 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.710174    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac863fb-7b5b-429c-bdbf-b455d8601b51" containerName="maas-api"
Sep 16 18:33:00.714147 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.714125    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.717631 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.717610    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-2c3173-openshift-default-dockercfg-vqdqc\""
Sep 16 18:33:00.728456 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.728430    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"]
Sep 16 18:33:00.850706 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.850669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istiod-ca-cert\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.850706 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.850711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-token\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.850965 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.850737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-podinfo\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.850965 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.850843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-credential-socket\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.850965 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.850881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-workload-certs\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.851119 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.850979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-workload-socket\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.851119 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.851048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5l47\" (UniqueName: \"kubernetes.io/projected/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-kube-api-access-z5l47\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.851119 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.851084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-data\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.851268 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.851140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-envoy\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952046 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952013    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-data\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952248 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-envoy\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952248 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istiod-ca-cert\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952248 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-token\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952248 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-podinfo\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952248 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-credential-socket\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952248 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-workload-certs\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952592 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-workload-socket\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952592 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5l47\" (UniqueName: \"kubernetes.io/projected/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-kube-api-access-z5l47\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952592 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-data\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952755 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952715    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-workload-certs\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952810 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-credential-socket\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952925 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952905    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-workload-socket\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.952980 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.952907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istiod-ca-cert\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.954650 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.954627    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-envoy\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.954762 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.954721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-podinfo\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.960005 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.959949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-token\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:00.960104 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:00.960087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5l47\" (UniqueName: \"kubernetes.io/projected/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-kube-api-access-z5l47\") pod \"e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") " pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:01.024640 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:01.024604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:01.332464 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:33:01.332439    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c48adf_0d02_4926_b8c0_1fc5e42cac53.slice/crio-d76f6c4e455a4868656dd780c21092c7be56383231f158375f445d7b156a7ee5 WatchSource:0}: Error finding container d76f6c4e455a4868656dd780c21092c7be56383231f158375f445d7b156a7ee5: Status 404 returned error can't find the container with id d76f6c4e455a4868656dd780c21092c7be56383231f158375f445d7b156a7ee5
Sep 16 18:33:01.334309 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:01.334271    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:33:01.334410 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:01.334354    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:33:01.334458 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:01.334444    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:33:01.335071 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:01.335054    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"]
Sep 16 18:33:01.763245 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:01.763211    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" event={"ID":"d2c48adf-0d02-4926-b8c0-1fc5e42cac53","Type":"ContainerStarted","Data":"505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72"}
Sep 16 18:33:01.763774 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:01.763259    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" event={"ID":"d2c48adf-0d02-4926-b8c0-1fc5e42cac53","Type":"ContainerStarted","Data":"d76f6c4e455a4868656dd780c21092c7be56383231f158375f445d7b156a7ee5"}
Sep 16 18:33:01.786245 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:01.786187    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" podStartSLOduration=1.786169506 podStartE2EDuration="1.786169506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:33:01.782928071 +0000 UTC m=+1000.425954111" watchObservedRunningTime="2026-09-16 18:33:01.786169506 +0000 UTC m=+1000.429195546"
Sep 16 18:33:02.025590 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:02.025499    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:02.030681 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:02.030653    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:02.774202 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:02.774169    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:02.775300 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:02.775279    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:06.856541 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:06.856497    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"]
Sep 16 18:33:06.860753 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:06.860724    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:06.862973 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:06.862951    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-2c3173-serving-cert\""
Sep 16 18:33:06.871338 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:06.871317    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"]
Sep 16 18:33:07.017414 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.017382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e695b858-d711-4be1-986e-24eb5360181f-openshift-service-ca\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.017587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.017461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-maas-api-tls\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.017642 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.017630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkn6p\" (UniqueName: \"kubernetes.io/projected/e695b858-d711-4be1-986e-24eb5360181f-kube-api-access-gkn6p\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.017709 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.017667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-metrics-certs\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.118662 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.118575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-maas-api-tls\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.118662 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.118661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkn6p\" (UniqueName: \"kubernetes.io/projected/e695b858-d711-4be1-986e-24eb5360181f-kube-api-access-gkn6p\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.118895 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.118682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-metrics-certs\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.118895 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.118725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e695b858-d711-4be1-986e-24eb5360181f-openshift-service-ca\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.118895 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:33:07.118728    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-serving-cert: secret "maas-api-e2e-explicit-2c3173-serving-cert" not found
Sep 16 18:33:07.118895 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:33:07.118813    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-maas-api-tls podName:e695b858-d711-4be1-986e-24eb5360181f nodeName:}" failed. No retries permitted until 2026-09-16 18:33:07.618792038 +0000 UTC m=+1006.261818062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-maas-api-tls") pod "maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq" (UID: "e695b858-d711-4be1-986e-24eb5360181f") : secret "maas-api-e2e-explicit-2c3173-serving-cert" not found
Sep 16 18:33:07.119349 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.119324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e695b858-d711-4be1-986e-24eb5360181f-openshift-service-ca\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.121147 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.121123    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-metrics-certs\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.127075 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.127053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkn6p\" (UniqueName: \"kubernetes.io/projected/e695b858-d711-4be1-986e-24eb5360181f-kube-api-access-gkn6p\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.624659 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.624628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-maas-api-tls\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.626932 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.626908    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-maas-api-tls\") pod \"maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:07.774025 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:07.773992    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:08.057505 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:08.057479    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"]
Sep 16 18:33:08.058973 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:33:08.058948    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode695b858_d711_4be1_986e_24eb5360181f.slice/crio-2728dc33dc99f483e89f8590f4149652b2b96c443ee56ee9b39e6d6b36953e0d WatchSource:0}: Error finding container 2728dc33dc99f483e89f8590f4149652b2b96c443ee56ee9b39e6d6b36953e0d: Status 404 returned error can't find the container with id 2728dc33dc99f483e89f8590f4149652b2b96c443ee56ee9b39e6d6b36953e0d
Sep 16 18:33:08.809461 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:08.809423    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq" event={"ID":"e695b858-d711-4be1-986e-24eb5360181f","Type":"ContainerStarted","Data":"961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff"}
Sep 16 18:33:08.809663 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:08.809475    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq" event={"ID":"e695b858-d711-4be1-986e-24eb5360181f","Type":"ContainerStarted","Data":"2728dc33dc99f483e89f8590f4149652b2b96c443ee56ee9b39e6d6b36953e0d"}
Sep 16 18:33:08.809663 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:08.809518    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:08.847899 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:08.847848    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq" podStartSLOduration=2.2752296149999998 podStartE2EDuration="2.847831367s" totalImagesPullingTime="572.601752ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:33:08.847084157 +0000 UTC m=+1007.490110209" watchObservedRunningTime="2026-09-16 18:33:08.847831367 +0000 UTC m=+1007.490857406"
Sep 16 18:33:10.978269 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:10.978231    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"]
Sep 16 18:33:10.978668 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:10.978439    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z" podUID="6982a2b7-afad-4347-82b2-d6250cd45bca" containerName="maas-api" containerID="cri-o://b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02" gracePeriod=30
Sep 16 18:33:11.239861 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.239800    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:33:11.362089 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.362056    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-metrics-certs\") pod \"6982a2b7-afad-4347-82b2-d6250cd45bca\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") "
Sep 16 18:33:11.362283 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.362116    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-maas-api-tls\") pod \"6982a2b7-afad-4347-82b2-d6250cd45bca\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") "
Sep 16 18:33:11.362283 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.362144    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6982a2b7-afad-4347-82b2-d6250cd45bca-openshift-service-ca\") pod \"6982a2b7-afad-4347-82b2-d6250cd45bca\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") "
Sep 16 18:33:11.362283 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.362279    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75rlf\" (UniqueName: \"kubernetes.io/projected/6982a2b7-afad-4347-82b2-d6250cd45bca-kube-api-access-75rlf\") pod \"6982a2b7-afad-4347-82b2-d6250cd45bca\" (UID: \"6982a2b7-afad-4347-82b2-d6250cd45bca\") "
Sep 16 18:33:11.362667 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.362635    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6982a2b7-afad-4347-82b2-d6250cd45bca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6982a2b7-afad-4347-82b2-d6250cd45bca" (UID: "6982a2b7-afad-4347-82b2-d6250cd45bca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:33:11.364235 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.364214    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6982a2b7-afad-4347-82b2-d6250cd45bca" (UID: "6982a2b7-afad-4347-82b2-d6250cd45bca"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:33:11.364356 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.364338    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6982a2b7-afad-4347-82b2-d6250cd45bca-kube-api-access-75rlf" (OuterVolumeSpecName: "kube-api-access-75rlf") pod "6982a2b7-afad-4347-82b2-d6250cd45bca" (UID: "6982a2b7-afad-4347-82b2-d6250cd45bca"). InnerVolumeSpecName "kube-api-access-75rlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:33:11.364435 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.364324    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6982a2b7-afad-4347-82b2-d6250cd45bca" (UID: "6982a2b7-afad-4347-82b2-d6250cd45bca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:33:11.463114 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.463079    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75rlf\" (UniqueName: \"kubernetes.io/projected/6982a2b7-afad-4347-82b2-d6250cd45bca-kube-api-access-75rlf\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:33:11.463114 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.463109    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:33:11.463114 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.463119    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6982a2b7-afad-4347-82b2-d6250cd45bca-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:33:11.463339 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.463127    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6982a2b7-afad-4347-82b2-d6250cd45bca-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:33:11.828797 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.828762    2580 generic.go:356] "Generic (PLEG): container finished" podID="6982a2b7-afad-4347-82b2-d6250cd45bca" containerID="b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02" exitCode=0
Sep 16 18:33:11.828972 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.828812    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"
Sep 16 18:33:11.828972 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.828841    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z" event={"ID":"6982a2b7-afad-4347-82b2-d6250cd45bca","Type":"ContainerDied","Data":"b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02"}
Sep 16 18:33:11.828972 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.828897    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z" event={"ID":"6982a2b7-afad-4347-82b2-d6250cd45bca","Type":"ContainerDied","Data":"0aa5cd0a61e2b5ba604bfab53ed9d2612f8568be0f230127ca6b5a0f795be0de"}
Sep 16 18:33:11.828972 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.828926    2580 scope.go:117] "RemoveContainer" containerID="b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02"
Sep 16 18:33:11.839183 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.839163    2580 scope.go:117] "RemoveContainer" containerID="b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02"
Sep 16 18:33:11.839517 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:33:11.839498    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02\": container with ID starting with b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02 not found: ID does not exist" containerID="b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02"
Sep 16 18:33:11.839574 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.839527    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02"} err="failed to get container status \"b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02\": rpc error: code = NotFound desc = could not find container \"b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02\": container with ID starting with b4ea8452627b174356ef9d7d05f1d254b3f4728a8a85231a99286222f4b7af02 not found: ID does not exist"
Sep 16 18:33:11.867590 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.867558    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"]
Sep 16 18:33:11.872424 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:11.872399    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7e8b5de5-59f8cd54bc-gcd7z"]
Sep 16 18:33:13.865824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:13.865791    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6982a2b7-afad-4347-82b2-d6250cd45bca" path="/var/lib/kubelet/pods/6982a2b7-afad-4347-82b2-d6250cd45bca/volumes"
Sep 16 18:33:14.821630 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:14.821601    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:33:29.941253 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:29.941215    2580 generic.go:356] "Generic (PLEG): container finished" podID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerID="505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72" exitCode=0
Sep 16 18:33:29.941804 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:29.941286    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" event={"ID":"d2c48adf-0d02-4926-b8c0-1fc5e42cac53","Type":"ContainerDied","Data":"505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72"}
Sep 16 18:33:29.941804 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:29.941694    2580 scope.go:117] "RemoveContainer" containerID="505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72"
Sep 16 18:33:29.942760 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:29.942733    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:33:29.942833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:29.942801    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:33:29.942889 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:29.942834    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:33:30.948828 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:30.948791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" event={"ID":"d2c48adf-0d02-4926-b8c0-1fc5e42cac53","Type":"ContainerStarted","Data":"8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed"}
Sep 16 18:33:31.025131 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:31.025093    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:31.026440 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:31.026414    2580 patch_prober.go:28] interesting pod/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 18:33:31.026560 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:31.026469    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 18:33:32.025563 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:32.025527    2580 patch_prober.go:28] interesting pod/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 18:33:32.026020 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:32.025592    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 18:33:32.774484 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:32.774446    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:33.026065 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:33.025981    2580 patch_prober.go:28] interesting pod/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 18:33:33.026442 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:33.026059    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 18:33:34.024967 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:34.024928    2580 patch_prober.go:28] interesting pod/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 18:33:34.025150 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:34.024984    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 18:33:35.025135 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:35.025096    2580 patch_prober.go:28] interesting pod/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 18:33:35.025548 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:35.025160    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 18:33:36.025548 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:36.025510    2580 patch_prober.go:28] interesting pod/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 18:33:36.025934 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:36.025571    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 18:33:37.029180 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:37.029149    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:37.030006 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:37.029987    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:33:57.919106 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:57.919067    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"]
Sep 16 18:33:57.919579 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:57.919462    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6982a2b7-afad-4347-82b2-d6250cd45bca" containerName="maas-api"
Sep 16 18:33:57.919579 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:57.919474    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6982a2b7-afad-4347-82b2-d6250cd45bca" containerName="maas-api"
Sep 16 18:33:57.919579 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:57.919548    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6982a2b7-afad-4347-82b2-d6250cd45bca" containerName="maas-api"
Sep 16 18:33:57.921496 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:57.921480    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:57.926406 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:57.926385    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a24d09\"/\"openshift-service-ca.crt\""
Sep 16 18:33:57.926538 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:57.926392    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a24d09\"/\"default-dockercfg-m4w58\""
Sep 16 18:33:57.926538 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:57.926458    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a24d09\"/\"premium-w0-a24d09-kserve-self-signed-certs\""
Sep 16 18:33:57.926538 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:57.926483    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a24d09\"/\"kube-root-ca.crt\""
Sep 16 18:33:57.934291 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:57.934268    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"]
Sep 16 18:33:58.014530 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.014501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-dshm\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.014707 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.014585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-model-cache\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.014707 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.014606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333553b5-c7bf-469d-8268-05d194458bf4-tls-certs\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.014707 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.014640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-tmp-dir\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.014707 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.014667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-home\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.014707 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.014690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlp5x\" (UniqueName: \"kubernetes.io/projected/333553b5-c7bf-469d-8268-05d194458bf4-kube-api-access-qlp5x\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.116003 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.115972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-dshm\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.116195 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.116051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-model-cache\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.116195 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.116073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333553b5-c7bf-469d-8268-05d194458bf4-tls-certs\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.116195 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.116107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-tmp-dir\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.116195 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.116135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-home\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.116195 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.116166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlp5x\" (UniqueName: \"kubernetes.io/projected/333553b5-c7bf-469d-8268-05d194458bf4-kube-api-access-qlp5x\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.116544 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.116509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-model-cache\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.116680 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.116568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-home\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.116680 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.116568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-tmp-dir\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.118275 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.118252    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-dshm\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.118590 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.118574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333553b5-c7bf-469d-8268-05d194458bf4-tls-certs\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.125074 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.125054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlp5x\" (UniqueName: \"kubernetes.io/projected/333553b5-c7bf-469d-8268-05d194458bf4-kube-api-access-qlp5x\") pod \"premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") " pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.230432 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.230338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:33:58.508817 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:58.506475    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"]
Sep 16 18:33:58.510851 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:33:58.510819    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod333553b5_c7bf_469d_8268_05d194458bf4.slice/crio-17de53c3da05e0f110d3b6daae01d5242a4aa879a910fa777439c9966417c19a WatchSource:0}: Error finding container 17de53c3da05e0f110d3b6daae01d5242a4aa879a910fa777439c9966417c19a: Status 404 returned error can't find the container with id 17de53c3da05e0f110d3b6daae01d5242a4aa879a910fa777439c9966417c19a
Sep 16 18:33:59.110914 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:59.110879    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq" event={"ID":"333553b5-c7bf-469d-8268-05d194458bf4","Type":"ContainerStarted","Data":"458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089"}
Sep 16 18:33:59.110914 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:59.110918    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq" event={"ID":"333553b5-c7bf-469d-8268-05d194458bf4","Type":"ContainerStarted","Data":"17de53c3da05e0f110d3b6daae01d5242a4aa879a910fa777439c9966417c19a"}
Sep 16 18:33:59.133692 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:33:59.133646    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq" podStartSLOduration=2.133630828 podStartE2EDuration="2.133630828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:33:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:33:59.130235376 +0000 UTC m=+1057.773261417" watchObservedRunningTime="2026-09-16 18:33:59.133630828 +0000 UTC m=+1057.776656867"
Sep 16 18:34:08.230678 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:08.230643    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:34:08.231154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:08.230713    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:34:08.243188 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:08.243166    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:34:09.178847 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:09.178816    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:34:18.621724 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.621634    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"]
Sep 16 18:34:18.624594 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.624572    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.628504 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.628484    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5ca9c2\"/\"openshift-service-ca.crt\""
Sep 16 18:34:18.629341 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.629319    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5ca9c2\"/\"test-model-5ca9c2-kserve-self-signed-certs\""
Sep 16 18:34:18.629464 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.629360    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5ca9c2\"/\"default-dockercfg-g2smj\""
Sep 16 18:34:18.629464 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.629328    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5ca9c2\"/\"kube-root-ca.crt\""
Sep 16 18:34:18.641547 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.641525    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"]
Sep 16 18:34:18.707360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.707323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqftg\" (UniqueName: \"kubernetes.io/projected/7314bdc7-3d1d-43ce-be51-6765086bfee8-kube-api-access-bqftg\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.707552 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.707454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-tmp-dir\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.707552 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.707501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-dshm\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.707660 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.707605    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-home\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.707660 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.707639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7314bdc7-3d1d-43ce-be51-6765086bfee8-tls-certs\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.707747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.707676    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-model-cache\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.808706 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.808671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqftg\" (UniqueName: \"kubernetes.io/projected/7314bdc7-3d1d-43ce-be51-6765086bfee8-kube-api-access-bqftg\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.808899 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.808742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-tmp-dir\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.808899 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.808772    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-dshm\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.809019 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.808916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-home\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.809019 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.808963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7314bdc7-3d1d-43ce-be51-6765086bfee8-tls-certs\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.809019 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.809002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-model-cache\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.809247 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.809227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-tmp-dir\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.809307 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.809244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-home\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.809342 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.809307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-model-cache\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.811033 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.811014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-dshm\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.811353 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.811338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7314bdc7-3d1d-43ce-be51-6765086bfee8-tls-certs\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.817827 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.817807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqftg\" (UniqueName: \"kubernetes.io/projected/7314bdc7-3d1d-43ce-be51-6765086bfee8-kube-api-access-bqftg\") pod \"test-model-5ca9c2-kserve-64d4649467-65vnl\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") " pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:18.934549 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:18.934464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:19.258621 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:19.258588    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"]
Sep 16 18:34:19.258903 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:34:19.258881    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7314bdc7_3d1d_43ce_be51_6765086bfee8.slice/crio-695e898656eca48bd4001be440411b933b424c2015953d4bbaa2d1400f5cbccc WatchSource:0}: Error finding container 695e898656eca48bd4001be440411b933b424c2015953d4bbaa2d1400f5cbccc: Status 404 returned error can't find the container with id 695e898656eca48bd4001be440411b933b424c2015953d4bbaa2d1400f5cbccc
Sep 16 18:34:20.228690 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:20.228648    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl" event={"ID":"7314bdc7-3d1d-43ce-be51-6765086bfee8","Type":"ContainerStarted","Data":"e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a"}
Sep 16 18:34:20.228690 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:20.228696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl" event={"ID":"7314bdc7-3d1d-43ce-be51-6765086bfee8","Type":"ContainerStarted","Data":"695e898656eca48bd4001be440411b933b424c2015953d4bbaa2d1400f5cbccc"}
Sep 16 18:34:20.253614 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:20.253572    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl" podStartSLOduration=2.253556142 podStartE2EDuration="2.253556142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:34:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:34:20.252288836 +0000 UTC m=+1078.895314901" watchObservedRunningTime="2026-09-16 18:34:20.253556142 +0000 UTC m=+1078.896582181"
Sep 16 18:34:28.934913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:28.934880    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:28.935412 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:28.934931    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:28.947375 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:28.947344    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:29.289849 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:29.289758    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:34:52.000014 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:51.999982    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"]
Sep 16 18:34:52.000509 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.000191    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq" podUID="e695b858-d711-4be1-986e-24eb5360181f" containerName="maas-api" containerID="cri-o://961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff" gracePeriod=30
Sep 16 18:34:52.250251 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.250188    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:34:52.335053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.335028    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-maas-api-tls\") pod \"e695b858-d711-4be1-986e-24eb5360181f\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") "
Sep 16 18:34:52.335212 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.335085    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-metrics-certs\") pod \"e695b858-d711-4be1-986e-24eb5360181f\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") "
Sep 16 18:34:52.335212 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.335107    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e695b858-d711-4be1-986e-24eb5360181f-openshift-service-ca\") pod \"e695b858-d711-4be1-986e-24eb5360181f\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") "
Sep 16 18:34:52.335212 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.335160    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkn6p\" (UniqueName: \"kubernetes.io/projected/e695b858-d711-4be1-986e-24eb5360181f-kube-api-access-gkn6p\") pod \"e695b858-d711-4be1-986e-24eb5360181f\" (UID: \"e695b858-d711-4be1-986e-24eb5360181f\") "
Sep 16 18:34:52.335563 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.335540    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e695b858-d711-4be1-986e-24eb5360181f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e695b858-d711-4be1-986e-24eb5360181f" (UID: "e695b858-d711-4be1-986e-24eb5360181f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:34:52.337217 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.337193    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e695b858-d711-4be1-986e-24eb5360181f" (UID: "e695b858-d711-4be1-986e-24eb5360181f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:34:52.337318 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.337274    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e695b858-d711-4be1-986e-24eb5360181f-kube-api-access-gkn6p" (OuterVolumeSpecName: "kube-api-access-gkn6p") pod "e695b858-d711-4be1-986e-24eb5360181f" (UID: "e695b858-d711-4be1-986e-24eb5360181f"). InnerVolumeSpecName "kube-api-access-gkn6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:34:52.337318 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.337313    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e695b858-d711-4be1-986e-24eb5360181f" (UID: "e695b858-d711-4be1-986e-24eb5360181f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:34:52.409864 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.409832    2580 generic.go:356] "Generic (PLEG): container finished" podID="e695b858-d711-4be1-986e-24eb5360181f" containerID="961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff" exitCode=0
Sep 16 18:34:52.410021 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.409871    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq" event={"ID":"e695b858-d711-4be1-986e-24eb5360181f","Type":"ContainerDied","Data":"961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff"}
Sep 16 18:34:52.410021 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.409878    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"
Sep 16 18:34:52.410021 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.409960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq" event={"ID":"e695b858-d711-4be1-986e-24eb5360181f","Type":"ContainerDied","Data":"2728dc33dc99f483e89f8590f4149652b2b96c443ee56ee9b39e6d6b36953e0d"}
Sep 16 18:34:52.410021 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.409984    2580 scope.go:117] "RemoveContainer" containerID="961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff"
Sep 16 18:34:52.420931 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.420910    2580 scope.go:117] "RemoveContainer" containerID="961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff"
Sep 16 18:34:52.421299 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:34:52.421272    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff\": container with ID starting with 961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff not found: ID does not exist" containerID="961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff"
Sep 16 18:34:52.421363 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.421312    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff"} err="failed to get container status \"961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff\": rpc error: code = NotFound desc = could not find container \"961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff\": container with ID starting with 961f9628733af2cee8bab1dbbbd5158d02caab9bcdcc8592a92ac02956f5b1ff not found: ID does not exist"
Sep 16 18:34:52.438105 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.438025    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:34:52.438105 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.438056    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e695b858-d711-4be1-986e-24eb5360181f-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:34:52.438105 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.438069    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e695b858-d711-4be1-986e-24eb5360181f-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:34:52.438105 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.438081    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkn6p\" (UniqueName: \"kubernetes.io/projected/e695b858-d711-4be1-986e-24eb5360181f-kube-api-access-gkn6p\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:34:52.462512 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.462458    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"]
Sep 16 18:34:52.469129 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:52.469053    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2c3173-bfb877d5b-5rrrq"]
Sep 16 18:34:53.871574 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:34:53.871537    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e695b858-d711-4be1-986e-24eb5360181f" path="/var/lib/kubelet/pods/e695b858-d711-4be1-986e-24eb5360181f/volumes"
Sep 16 18:35:05.905980 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:05.905950    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"]
Sep 16 18:35:05.906347 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:05.906149    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy" containerID="cri-o://8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed" gracePeriod=30
Sep 16 18:35:07.032057 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:07.031953    2580 patch_prober.go:28] interesting pod/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 18:35:07.032598 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:07.032040    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 18:35:11.143607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.143581    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:35:11.235142 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235063    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5l47\" (UniqueName: \"kubernetes.io/projected/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-kube-api-access-z5l47\") pod \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") "
Sep 16 18:35:11.235142 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235110    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-data\") pod \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") "
Sep 16 18:35:11.235350 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235165    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-envoy\") pod \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") "
Sep 16 18:35:11.235350 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235202    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-workload-socket\") pod \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") "
Sep 16 18:35:11.235350 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235229    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-credential-socket\") pod \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") "
Sep 16 18:35:11.235350 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235256    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-token\") pod \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") "
Sep 16 18:35:11.235350 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235299    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istiod-ca-cert\") pod \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") "
Sep 16 18:35:11.235350 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235341    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-podinfo\") pod \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") "
Sep 16 18:35:11.235676 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235398    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-workload-certs\") pod \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\" (UID: \"d2c48adf-0d02-4926-b8c0-1fc5e42cac53\") "
Sep 16 18:35:11.235676 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235513    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2c48adf-0d02-4926-b8c0-1fc5e42cac53" (UID: "d2c48adf-0d02-4926-b8c0-1fc5e42cac53"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:35:11.235676 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235533    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2c48adf-0d02-4926-b8c0-1fc5e42cac53" (UID: "d2c48adf-0d02-4926-b8c0-1fc5e42cac53"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:35:11.235676 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235583    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2c48adf-0d02-4926-b8c0-1fc5e42cac53" (UID: "d2c48adf-0d02-4926-b8c0-1fc5e42cac53"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:35:11.235874 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235731    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2c48adf-0d02-4926-b8c0-1fc5e42cac53" (UID: "d2c48adf-0d02-4926-b8c0-1fc5e42cac53"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:35:11.235874 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235818    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2c48adf-0d02-4926-b8c0-1fc5e42cac53" (UID: "d2c48adf-0d02-4926-b8c0-1fc5e42cac53"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:35:11.235956 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235881    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:11.235956 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235900    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:11.235956 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235914    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:11.235956 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.235927    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:11.237197 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.237173    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-kube-api-access-z5l47" (OuterVolumeSpecName: "kube-api-access-z5l47") pod "d2c48adf-0d02-4926-b8c0-1fc5e42cac53" (UID: "d2c48adf-0d02-4926-b8c0-1fc5e42cac53"). InnerVolumeSpecName "kube-api-access-z5l47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:35:11.237579 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.237552    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2c48adf-0d02-4926-b8c0-1fc5e42cac53" (UID: "d2c48adf-0d02-4926-b8c0-1fc5e42cac53"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:35:11.237679 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.237666    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2c48adf-0d02-4926-b8c0-1fc5e42cac53" (UID: "d2c48adf-0d02-4926-b8c0-1fc5e42cac53"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:35:11.237735 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.237685    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2c48adf-0d02-4926-b8c0-1fc5e42cac53" (UID: "d2c48adf-0d02-4926-b8c0-1fc5e42cac53"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:35:11.336723 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.336686    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:11.336723 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.336716    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5l47\" (UniqueName: \"kubernetes.io/projected/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-kube-api-access-z5l47\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:11.336723 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.336727    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:11.336948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.336737    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:11.336948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.336745    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c48adf-0d02-4926-b8c0-1fc5e42cac53-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:11.524490 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.524405    2580 generic.go:356] "Generic (PLEG): container finished" podID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerID="8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed" exitCode=0
Sep 16 18:35:11.524490 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.524451    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"
Sep 16 18:35:11.524700 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.524486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" event={"ID":"d2c48adf-0d02-4926-b8c0-1fc5e42cac53","Type":"ContainerDied","Data":"8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed"}
Sep 16 18:35:11.524700 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.524542    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8" event={"ID":"d2c48adf-0d02-4926-b8c0-1fc5e42cac53","Type":"ContainerDied","Data":"d76f6c4e455a4868656dd780c21092c7be56383231f158375f445d7b156a7ee5"}
Sep 16 18:35:11.524700 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.524572    2580 scope.go:117] "RemoveContainer" containerID="8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed"
Sep 16 18:35:11.534663 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.534646    2580 scope.go:117] "RemoveContainer" containerID="505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72"
Sep 16 18:35:11.542618 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.542600    2580 scope.go:117] "RemoveContainer" containerID="8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed"
Sep 16 18:35:11.542898 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:35:11.542878    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed\": container with ID starting with 8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed not found: ID does not exist" containerID="8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed"
Sep 16 18:35:11.542970 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.542905    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed"} err="failed to get container status \"8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed\": rpc error: code = NotFound desc = could not find container \"8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed\": container with ID starting with 8461d55b9b5e46ed8c47ce8639ba7ddb806de5374278da0bc85f123d0711c7ed not found: ID does not exist"
Sep 16 18:35:11.542970 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.542921    2580 scope.go:117] "RemoveContainer" containerID="505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72"
Sep 16 18:35:11.543154 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:35:11.543138    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72\": container with ID starting with 505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72 not found: ID does not exist" containerID="505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72"
Sep 16 18:35:11.543197 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.543163    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72"} err="failed to get container status \"505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72\": rpc error: code = NotFound desc = could not find container \"505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72\": container with ID starting with 505974b83adc87b8aae8b5cb075da8d18ad3336dff1c97d0177240089be0de72 not found: ID does not exist"
Sep 16 18:35:11.558949 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.558927    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"]
Sep 16 18:35:11.562499 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.562479    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-2c3173-openshift-default-7b97c64c44-6sjs8"]
Sep 16 18:35:11.868782 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:11.868746    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" path="/var/lib/kubelet/pods/d2c48adf-0d02-4926-b8c0-1fc5e42cac53/volumes"
Sep 16 18:35:13.610684 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.610647    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"]
Sep 16 18:35:13.611195 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.611181    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e695b858-d711-4be1-986e-24eb5360181f" containerName="maas-api"
Sep 16 18:35:13.611237 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.611198    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e695b858-d711-4be1-986e-24eb5360181f" containerName="maas-api"
Sep 16 18:35:13.611237 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.611211    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy"
Sep 16 18:35:13.611237 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.611219    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy"
Sep 16 18:35:13.611237 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.611229    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy"
Sep 16 18:35:13.611237 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.611237    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy"
Sep 16 18:35:13.611429 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.611322    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy"
Sep 16 18:35:13.611429 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.611330    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e695b858-d711-4be1-986e-24eb5360181f" containerName="maas-api"
Sep 16 18:35:13.611429 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.611337    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c48adf-0d02-4926-b8c0-1fc5e42cac53" containerName="istio-proxy"
Sep 16 18:35:13.614399 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.614355    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.616763 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.616738    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d485ed3e-serving-cert\""
Sep 16 18:35:13.637176 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.637148    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"]
Sep 16 18:35:13.761289 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.761256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27682\" (UniqueName: \"kubernetes.io/projected/d2af3dc1-e54a-47ba-90cd-f2a609006f54-kube-api-access-27682\") pod \"maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.761289 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.761293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2af3dc1-e54a-47ba-90cd-f2a609006f54-metrics-certs\") pod \"maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.761547 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.761321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2af3dc1-e54a-47ba-90cd-f2a609006f54-maas-api-tls\") pod \"maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.761547 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.761426    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2af3dc1-e54a-47ba-90cd-f2a609006f54-openshift-service-ca\") pod \"maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.862910 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.862827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2af3dc1-e54a-47ba-90cd-f2a609006f54-maas-api-tls\") pod \"maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.862910 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.862901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2af3dc1-e54a-47ba-90cd-f2a609006f54-openshift-service-ca\") pod \"maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.863129 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.863063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27682\" (UniqueName: \"kubernetes.io/projected/d2af3dc1-e54a-47ba-90cd-f2a609006f54-kube-api-access-27682\") pod \"maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.863129 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.863098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2af3dc1-e54a-47ba-90cd-f2a609006f54-metrics-certs\") pod \"maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.863690 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.863668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2af3dc1-e54a-47ba-90cd-f2a609006f54-openshift-service-ca\") pod \"maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.865384 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.865347    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2af3dc1-e54a-47ba-90cd-f2a609006f54-maas-api-tls\") pod \"maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.865511 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.865493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2af3dc1-e54a-47ba-90cd-f2a609006f54-metrics-certs\") pod \"maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.872996 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.872974    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27682\" (UniqueName: \"kubernetes.io/projected/d2af3dc1-e54a-47ba-90cd-f2a609006f54-kube-api-access-27682\") pod \"maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:13.924892 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:13.924869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:14.201288 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:14.201255    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"]
Sep 16 18:35:14.201885 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:35:14.201860    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2af3dc1_e54a_47ba_90cd_f2a609006f54.slice/crio-c3e0986a9a47c796d87d4a3b05ba7c045682b7d720835053231f7368139d7811 WatchSource:0}: Error finding container c3e0986a9a47c796d87d4a3b05ba7c045682b7d720835053231f7368139d7811: Status 404 returned error can't find the container with id c3e0986a9a47c796d87d4a3b05ba7c045682b7d720835053231f7368139d7811
Sep 16 18:35:14.543630 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:14.543552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2" event={"ID":"d2af3dc1-e54a-47ba-90cd-f2a609006f54","Type":"ContainerStarted","Data":"c3e0986a9a47c796d87d4a3b05ba7c045682b7d720835053231f7368139d7811"}
Sep 16 18:35:15.550606 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:15.550566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2" event={"ID":"d2af3dc1-e54a-47ba-90cd-f2a609006f54","Type":"ContainerStarted","Data":"27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158"}
Sep 16 18:35:15.551018 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:15.550692    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:15.571806 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:15.571762    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2" podStartSLOduration=2.119177146 podStartE2EDuration="2.571749581s" totalImagesPullingTime="452.572435ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:35:15.57050242 +0000 UTC m=+1134.213528457" watchObservedRunningTime="2026-09-16 18:35:15.571749581 +0000 UTC m=+1134.214775621"
Sep 16 18:35:21.561142 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:21.561114    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:49.614266 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.614187    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"]
Sep 16 18:35:49.619227 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.619205    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.623916 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.623893    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-a8ab8d\"/\"noten-model-a8ab8d-kserve-self-signed-certs\""
Sep 16 18:35:49.624060 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.623923    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-a8ab8d\"/\"default-dockercfg-lznbc\""
Sep 16 18:35:49.624060 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.623933    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-a8ab8d\"/\"kube-root-ca.crt\""
Sep 16 18:35:49.624060 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.623962    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-a8ab8d\"/\"openshift-service-ca.crt\""
Sep 16 18:35:49.631869 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.631850    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"]
Sep 16 18:35:49.728326 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.728295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-dshm\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.728507 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.728341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-home\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.728507 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.728362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-tmp-dir\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.728507 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.728494    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca37c889-f84a-4111-aafa-6fc96814d250-tls-certs\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.728622 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.728596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt9zj\" (UniqueName: \"kubernetes.io/projected/ca37c889-f84a-4111-aafa-6fc96814d250-kube-api-access-jt9zj\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.728657 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.728640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-model-cache\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.830433 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.829653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-dshm\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.830433 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.829738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-home\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.830433 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.829767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-tmp-dir\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.830433 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.829867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca37c889-f84a-4111-aafa-6fc96814d250-tls-certs\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.830433 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.829957    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt9zj\" (UniqueName: \"kubernetes.io/projected/ca37c889-f84a-4111-aafa-6fc96814d250-kube-api-access-jt9zj\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.830433 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.830009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-model-cache\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.831016 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.830477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-model-cache\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.831016 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.830921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-tmp-dir\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.831395 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.831216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-home\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.835570 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.835545    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca37c889-f84a-4111-aafa-6fc96814d250-tls-certs\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.846207 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.841211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-dshm\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.846207 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.843465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt9zj\" (UniqueName: \"kubernetes.io/projected/ca37c889-f84a-4111-aafa-6fc96814d250-kube-api-access-jt9zj\") pod \"noten-model-a8ab8d-kserve-75f577f5bc-mjg7h\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") " pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:49.928641 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:49.928564    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:50.206240 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:50.206182    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"]
Sep 16 18:35:50.207239 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:35:50.207211    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca37c889_f84a_4111_aafa_6fc96814d250.slice/crio-7c4820296129a2dc151a6909b257c8218c8370ce71a532206d4bc94e175dc82b WatchSource:0}: Error finding container 7c4820296129a2dc151a6909b257c8218c8370ce71a532206d4bc94e175dc82b: Status 404 returned error can't find the container with id 7c4820296129a2dc151a6909b257c8218c8370ce71a532206d4bc94e175dc82b
Sep 16 18:35:50.746381 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:50.746343    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h" event={"ID":"ca37c889-f84a-4111-aafa-6fc96814d250","Type":"ContainerStarted","Data":"805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5"}
Sep 16 18:35:50.746770 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:50.746396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h" event={"ID":"ca37c889-f84a-4111-aafa-6fc96814d250","Type":"ContainerStarted","Data":"7c4820296129a2dc151a6909b257c8218c8370ce71a532206d4bc94e175dc82b"}
Sep 16 18:35:50.770648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:50.770603    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h" podStartSLOduration=1.770589806 podStartE2EDuration="1.770589806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:35:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:35:50.768724178 +0000 UTC m=+1169.411750218" watchObservedRunningTime="2026-09-16 18:35:50.770589806 +0000 UTC m=+1169.413615852"
Sep 16 18:35:57.149815 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.149774    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"]
Sep 16 18:35:57.150394 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.149965    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2" podUID="d2af3dc1-e54a-47ba-90cd-f2a609006f54" containerName="maas-api" containerID="cri-o://27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158" gracePeriod=30
Sep 16 18:35:57.391530 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.391502    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:57.507488 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.507410    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27682\" (UniqueName: \"kubernetes.io/projected/d2af3dc1-e54a-47ba-90cd-f2a609006f54-kube-api-access-27682\") pod \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") "
Sep 16 18:35:57.507488 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.507468    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2af3dc1-e54a-47ba-90cd-f2a609006f54-metrics-certs\") pod \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") "
Sep 16 18:35:57.507721 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.507563    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2af3dc1-e54a-47ba-90cd-f2a609006f54-maas-api-tls\") pod \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") "
Sep 16 18:35:57.507721 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.507587    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2af3dc1-e54a-47ba-90cd-f2a609006f54-openshift-service-ca\") pod \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\" (UID: \"d2af3dc1-e54a-47ba-90cd-f2a609006f54\") "
Sep 16 18:35:57.508085 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.508054    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2af3dc1-e54a-47ba-90cd-f2a609006f54-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d2af3dc1-e54a-47ba-90cd-f2a609006f54" (UID: "d2af3dc1-e54a-47ba-90cd-f2a609006f54"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:35:57.509614 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.509591    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2af3dc1-e54a-47ba-90cd-f2a609006f54-kube-api-access-27682" (OuterVolumeSpecName: "kube-api-access-27682") pod "d2af3dc1-e54a-47ba-90cd-f2a609006f54" (UID: "d2af3dc1-e54a-47ba-90cd-f2a609006f54"). InnerVolumeSpecName "kube-api-access-27682". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:35:57.509988 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.509974    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2af3dc1-e54a-47ba-90cd-f2a609006f54-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d2af3dc1-e54a-47ba-90cd-f2a609006f54" (UID: "d2af3dc1-e54a-47ba-90cd-f2a609006f54"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:35:57.510085 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.510061    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2af3dc1-e54a-47ba-90cd-f2a609006f54-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d2af3dc1-e54a-47ba-90cd-f2a609006f54" (UID: "d2af3dc1-e54a-47ba-90cd-f2a609006f54"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:35:57.609036 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.608996    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2af3dc1-e54a-47ba-90cd-f2a609006f54-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:57.609036 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.609027    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2af3dc1-e54a-47ba-90cd-f2a609006f54-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:57.609036 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.609038    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27682\" (UniqueName: \"kubernetes.io/projected/d2af3dc1-e54a-47ba-90cd-f2a609006f54-kube-api-access-27682\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:57.609036 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.609046    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2af3dc1-e54a-47ba-90cd-f2a609006f54-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:35:57.786642 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.786556    2580 generic.go:356] "Generic (PLEG): container finished" podID="d2af3dc1-e54a-47ba-90cd-f2a609006f54" containerID="27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158" exitCode=0
Sep 16 18:35:57.786642 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.786604    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"
Sep 16 18:35:57.786821 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.786637    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2" event={"ID":"d2af3dc1-e54a-47ba-90cd-f2a609006f54","Type":"ContainerDied","Data":"27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158"}
Sep 16 18:35:57.786821 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.786713    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2" event={"ID":"d2af3dc1-e54a-47ba-90cd-f2a609006f54","Type":"ContainerDied","Data":"c3e0986a9a47c796d87d4a3b05ba7c045682b7d720835053231f7368139d7811"}
Sep 16 18:35:57.786821 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.786728    2580 scope.go:117] "RemoveContainer" containerID="27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158"
Sep 16 18:35:57.796692 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.796674    2580 scope.go:117] "RemoveContainer" containerID="27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158"
Sep 16 18:35:57.796939 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:35:57.796922    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158\": container with ID starting with 27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158 not found: ID does not exist" containerID="27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158"
Sep 16 18:35:57.796987 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.796948    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158"} err="failed to get container status \"27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158\": rpc error: code = NotFound desc = could not find container \"27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158\": container with ID starting with 27b2c2b6a9521bffc918c10bbe10c53cd023a5967e41ec5c2a5d8b1b67934158 not found: ID does not exist"
Sep 16 18:35:57.812291 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.812260    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"]
Sep 16 18:35:57.814783 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.814765    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d485ed3e-5dd744dffb-z76w2"]
Sep 16 18:35:57.866597 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:57.866567    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2af3dc1-e54a-47ba-90cd-f2a609006f54" path="/var/lib/kubelet/pods/d2af3dc1-e54a-47ba-90cd-f2a609006f54/volumes"
Sep 16 18:35:59.929430 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:59.929399    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:59.929835 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:59.929448    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:35:59.941778 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:35:59.941748    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:36:00.815993 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:00.815963    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:36:13.857014 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:13.856978    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"]
Sep 16 18:36:15.117788 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:15.117750    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"]
Sep 16 18:36:28.241469 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.241337    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"]
Sep 16 18:36:28.241929 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.241906    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2af3dc1-e54a-47ba-90cd-f2a609006f54" containerName="maas-api"
Sep 16 18:36:28.242006 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.241933    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2af3dc1-e54a-47ba-90cd-f2a609006f54" containerName="maas-api"
Sep 16 18:36:28.242060 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.242050    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2af3dc1-e54a-47ba-90cd-f2a609006f54" containerName="maas-api"
Sep 16 18:36:28.247936 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.247910    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.252067 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.252040    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-ad6826-serving-cert\""
Sep 16 18:36:28.264500 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.264476    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"]
Sep 16 18:36:28.325765 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.325733    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvfwt\" (UniqueName: \"kubernetes.io/projected/6248ccee-e7ca-4c44-baf7-2f0f507d7936-kube-api-access-cvfwt\") pod \"maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.326006 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.325793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6248ccee-e7ca-4c44-baf7-2f0f507d7936-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.326006 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.325876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6248ccee-e7ca-4c44-baf7-2f0f507d7936-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.326006 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.325949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6248ccee-e7ca-4c44-baf7-2f0f507d7936-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.427020 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.426991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6248ccee-e7ca-4c44-baf7-2f0f507d7936-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.427205 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.427077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6248ccee-e7ca-4c44-baf7-2f0f507d7936-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.427205 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.427132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvfwt\" (UniqueName: \"kubernetes.io/projected/6248ccee-e7ca-4c44-baf7-2f0f507d7936-kube-api-access-cvfwt\") pod \"maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.427205 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.427196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6248ccee-e7ca-4c44-baf7-2f0f507d7936-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.427839 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.427815    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6248ccee-e7ca-4c44-baf7-2f0f507d7936-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.429567 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.429540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6248ccee-e7ca-4c44-baf7-2f0f507d7936-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.429685 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.429662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6248ccee-e7ca-4c44-baf7-2f0f507d7936-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.435937 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.435911    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvfwt\" (UniqueName: \"kubernetes.io/projected/6248ccee-e7ca-4c44-baf7-2f0f507d7936-kube-api-access-cvfwt\") pod \"maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.561603 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.561521    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:28.839306 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.839276    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"]
Sep 16 18:36:28.841040 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:36:28.841011    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6248ccee_e7ca_4c44_baf7_2f0f507d7936.slice/crio-6ed3c2c1ffa154cfb6a00bd96d2d072ef269464d2daa213957c81eb00b660394 WatchSource:0}: Error finding container 6ed3c2c1ffa154cfb6a00bd96d2d072ef269464d2daa213957c81eb00b660394: Status 404 returned error can't find the container with id 6ed3c2c1ffa154cfb6a00bd96d2d072ef269464d2daa213957c81eb00b660394
Sep 16 18:36:28.877513 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.877469    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h" podUID="ca37c889-f84a-4111-aafa-6fc96814d250" containerName="main" containerID="cri-o://805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5" gracePeriod=45
Sep 16 18:36:28.964483 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:28.964449    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk" event={"ID":"6248ccee-e7ca-4c44-baf7-2f0f507d7936","Type":"ContainerStarted","Data":"6ed3c2c1ffa154cfb6a00bd96d2d072ef269464d2daa213957c81eb00b660394"}
Sep 16 18:36:29.113221 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.113197    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:36:29.236166 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.236136    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-home\") pod \"ca37c889-f84a-4111-aafa-6fc96814d250\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") "
Sep 16 18:36:29.236358 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.236210    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt9zj\" (UniqueName: \"kubernetes.io/projected/ca37c889-f84a-4111-aafa-6fc96814d250-kube-api-access-jt9zj\") pod \"ca37c889-f84a-4111-aafa-6fc96814d250\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") "
Sep 16 18:36:29.236358 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.236238    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca37c889-f84a-4111-aafa-6fc96814d250-tls-certs\") pod \"ca37c889-f84a-4111-aafa-6fc96814d250\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") "
Sep 16 18:36:29.236358 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.236287    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-dshm\") pod \"ca37c889-f84a-4111-aafa-6fc96814d250\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") "
Sep 16 18:36:29.236358 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.236329    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-tmp-dir\") pod \"ca37c889-f84a-4111-aafa-6fc96814d250\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") "
Sep 16 18:36:29.236358 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.236359    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-model-cache\") pod \"ca37c889-f84a-4111-aafa-6fc96814d250\" (UID: \"ca37c889-f84a-4111-aafa-6fc96814d250\") "
Sep 16 18:36:29.236976 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.236929    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-home" (OuterVolumeSpecName: "home") pod "ca37c889-f84a-4111-aafa-6fc96814d250" (UID: "ca37c889-f84a-4111-aafa-6fc96814d250"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:36:29.236976 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.236952    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-model-cache" (OuterVolumeSpecName: "model-cache") pod "ca37c889-f84a-4111-aafa-6fc96814d250" (UID: "ca37c889-f84a-4111-aafa-6fc96814d250"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:36:29.236976 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.236938    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ca37c889-f84a-4111-aafa-6fc96814d250" (UID: "ca37c889-f84a-4111-aafa-6fc96814d250"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:36:29.238955 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.238934    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca37c889-f84a-4111-aafa-6fc96814d250-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ca37c889-f84a-4111-aafa-6fc96814d250" (UID: "ca37c889-f84a-4111-aafa-6fc96814d250"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:36:29.239048 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.238961    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-dshm" (OuterVolumeSpecName: "dshm") pod "ca37c889-f84a-4111-aafa-6fc96814d250" (UID: "ca37c889-f84a-4111-aafa-6fc96814d250"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:36:29.239098 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.239070    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca37c889-f84a-4111-aafa-6fc96814d250-kube-api-access-jt9zj" (OuterVolumeSpecName: "kube-api-access-jt9zj") pod "ca37c889-f84a-4111-aafa-6fc96814d250" (UID: "ca37c889-f84a-4111-aafa-6fc96814d250"). InnerVolumeSpecName "kube-api-access-jt9zj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:36:29.337720 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.337698    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:29.337720 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.337721    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt9zj\" (UniqueName: \"kubernetes.io/projected/ca37c889-f84a-4111-aafa-6fc96814d250-kube-api-access-jt9zj\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:29.338037 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.337730    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca37c889-f84a-4111-aafa-6fc96814d250-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:29.338037 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.337738    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:29.338037 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.337746    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:29.338037 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.337754    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca37c889-f84a-4111-aafa-6fc96814d250-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:29.971779 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.971738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk" event={"ID":"6248ccee-e7ca-4c44-baf7-2f0f507d7936","Type":"ContainerStarted","Data":"8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a"}
Sep 16 18:36:29.971974 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.971801    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:29.973095 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.973072    2580 generic.go:356] "Generic (PLEG): container finished" podID="ca37c889-f84a-4111-aafa-6fc96814d250" containerID="805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5" exitCode=0
Sep 16 18:36:29.973165 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.973103    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"
Sep 16 18:36:29.973165 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.973142    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h" event={"ID":"ca37c889-f84a-4111-aafa-6fc96814d250","Type":"ContainerDied","Data":"805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5"}
Sep 16 18:36:29.973233 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.973170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h" event={"ID":"ca37c889-f84a-4111-aafa-6fc96814d250","Type":"ContainerDied","Data":"7c4820296129a2dc151a6909b257c8218c8370ce71a532206d4bc94e175dc82b"}
Sep 16 18:36:29.973233 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.973191    2580 scope.go:117] "RemoveContainer" containerID="805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5"
Sep 16 18:36:29.981789 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.981765    2580 scope.go:117] "RemoveContainer" containerID="805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5"
Sep 16 18:36:29.982086 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:36:29.982064    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5\": container with ID starting with 805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5 not found: ID does not exist" containerID="805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5"
Sep 16 18:36:29.982162 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:29.982094    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5"} err="failed to get container status \"805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5\": rpc error: code = NotFound desc = could not find container \"805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5\": container with ID starting with 805178fe9929eafdde21e060fd8ed6ed25588d78c4e0b18038bc7734e06825e5 not found: ID does not exist"
Sep 16 18:36:30.033595 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.033551    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk" podStartSLOduration=1.5850457470000001 podStartE2EDuration="2.033535344s" totalImagesPullingTime="448.489597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:36:30.03178367 +0000 UTC m=+1208.674809720" watchObservedRunningTime="2026-09-16 18:36:30.033535344 +0000 UTC m=+1208.676561384"
Sep 16 18:36:30.064915 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.064889    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"]
Sep 16 18:36:30.090658 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.090633    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-a8ab8d/noten-model-a8ab8d-kserve-75f577f5bc-mjg7h"]
Sep 16 18:36:30.135959 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.135882    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m" podUID="2d202f8c-94b7-4456-8188-5a265c96b454" containerName="main" containerID="cri-o://6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780" gracePeriod=45
Sep 16 18:36:30.387242 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.387184    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:36:30.449110 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.449080    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-model-cache\") pod \"2d202f8c-94b7-4456-8188-5a265c96b454\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") "
Sep 16 18:36:30.449278 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.449156    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-home\") pod \"2d202f8c-94b7-4456-8188-5a265c96b454\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") "
Sep 16 18:36:30.449278 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.449197    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj8rl\" (UniqueName: \"kubernetes.io/projected/2d202f8c-94b7-4456-8188-5a265c96b454-kube-api-access-dj8rl\") pod \"2d202f8c-94b7-4456-8188-5a265c96b454\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") "
Sep 16 18:36:30.449278 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.449249    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d202f8c-94b7-4456-8188-5a265c96b454-tls-certs\") pod \"2d202f8c-94b7-4456-8188-5a265c96b454\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") "
Sep 16 18:36:30.449278 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.449272    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-tmp-dir\") pod \"2d202f8c-94b7-4456-8188-5a265c96b454\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") "
Sep 16 18:36:30.449526 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.449303    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-dshm\") pod \"2d202f8c-94b7-4456-8188-5a265c96b454\" (UID: \"2d202f8c-94b7-4456-8188-5a265c96b454\") "
Sep 16 18:36:30.449526 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.449412    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-model-cache" (OuterVolumeSpecName: "model-cache") pod "2d202f8c-94b7-4456-8188-5a265c96b454" (UID: "2d202f8c-94b7-4456-8188-5a265c96b454"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:36:30.449663 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.449630    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2d202f8c-94b7-4456-8188-5a265c96b454" (UID: "2d202f8c-94b7-4456-8188-5a265c96b454"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:36:30.449735 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.449666    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:30.449787 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.449755    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-home" (OuterVolumeSpecName: "home") pod "2d202f8c-94b7-4456-8188-5a265c96b454" (UID: "2d202f8c-94b7-4456-8188-5a265c96b454"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:36:30.451636 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.451609    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-dshm" (OuterVolumeSpecName: "dshm") pod "2d202f8c-94b7-4456-8188-5a265c96b454" (UID: "2d202f8c-94b7-4456-8188-5a265c96b454"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:36:30.451730 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.451660    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d202f8c-94b7-4456-8188-5a265c96b454-kube-api-access-dj8rl" (OuterVolumeSpecName: "kube-api-access-dj8rl") pod "2d202f8c-94b7-4456-8188-5a265c96b454" (UID: "2d202f8c-94b7-4456-8188-5a265c96b454"). InnerVolumeSpecName "kube-api-access-dj8rl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:36:30.451871 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.451850    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d202f8c-94b7-4456-8188-5a265c96b454-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2d202f8c-94b7-4456-8188-5a265c96b454" (UID: "2d202f8c-94b7-4456-8188-5a265c96b454"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:36:30.551076 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.551043    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d202f8c-94b7-4456-8188-5a265c96b454-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:30.551076 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.551070    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:30.551076 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.551078    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:30.551076 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.551087    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d202f8c-94b7-4456-8188-5a265c96b454-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:30.551330 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.551096    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj8rl\" (UniqueName: \"kubernetes.io/projected/2d202f8c-94b7-4456-8188-5a265c96b454-kube-api-access-dj8rl\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:30.986051 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.986018    2580 generic.go:356] "Generic (PLEG): container finished" podID="2d202f8c-94b7-4456-8188-5a265c96b454" containerID="6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780" exitCode=0
Sep 16 18:36:30.986223 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.986070    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"
Sep 16 18:36:30.986223 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.986104    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m" event={"ID":"2d202f8c-94b7-4456-8188-5a265c96b454","Type":"ContainerDied","Data":"6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780"}
Sep 16 18:36:30.986223 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.986154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m" event={"ID":"2d202f8c-94b7-4456-8188-5a265c96b454","Type":"ContainerDied","Data":"8adde3b45c7d874410027fd40b41628021ee050c87ba4bc23924d868633d4e0c"}
Sep 16 18:36:30.986223 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.986172    2580 scope.go:117] "RemoveContainer" containerID="6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780"
Sep 16 18:36:30.995550 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.995533    2580 scope.go:117] "RemoveContainer" containerID="6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780"
Sep 16 18:36:30.995824 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:36:30.995804    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780\": container with ID starting with 6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780 not found: ID does not exist" containerID="6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780"
Sep 16 18:36:30.995892 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:30.995829    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780"} err="failed to get container status \"6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780\": rpc error: code = NotFound desc = could not find container \"6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780\": container with ID starting with 6048fd24542be671e23fed626af7ad27c6f46484b9260f2c6da64f3214095780 not found: ID does not exist"
Sep 16 18:36:31.009119 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:31.009095    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"]
Sep 16 18:36:31.015352 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:31.015330    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-0197e4/test-model-0197e4-kserve-6cc868c5d9-2s82m"]
Sep 16 18:36:31.867123 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:31.867094    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d202f8c-94b7-4456-8188-5a265c96b454" path="/var/lib/kubelet/pods/2d202f8c-94b7-4456-8188-5a265c96b454/volumes"
Sep 16 18:36:31.867512 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:31.867491    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca37c889-f84a-4111-aafa-6fc96814d250" path="/var/lib/kubelet/pods/ca37c889-f84a-4111-aafa-6fc96814d250/volumes"
Sep 16 18:36:35.993086 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:35.993059    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:36:49.582466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.582430    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"]
Sep 16 18:36:49.582957 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.582855    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca37c889-f84a-4111-aafa-6fc96814d250" containerName="main"
Sep 16 18:36:49.582957 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.582870    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca37c889-f84a-4111-aafa-6fc96814d250" containerName="main"
Sep 16 18:36:49.582957 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.582886    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d202f8c-94b7-4456-8188-5a265c96b454" containerName="main"
Sep 16 18:36:49.582957 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.582895    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d202f8c-94b7-4456-8188-5a265c96b454" containerName="main"
Sep 16 18:36:49.583138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.583009    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca37c889-f84a-4111-aafa-6fc96814d250" containerName="main"
Sep 16 18:36:49.583138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.583022    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d202f8c-94b7-4456-8188-5a265c96b454" containerName="main"
Sep 16 18:36:49.587985 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.587963    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.591019 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.590999    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-cf62d1-openshift-default-dockercfg-cvcdp\""
Sep 16 18:36:49.601564 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.601537    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"]
Sep 16 18:36:49.734644 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.734613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-workload-certs\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.734813 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.734702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb00e099-486d-4954-b41a-72b24d8802af-istio-token\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.734813 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.734749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-credential-socket\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.734813 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.734802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb00e099-486d-4954-b41a-72b24d8802af-istiod-ca-cert\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.734948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.734849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-workload-socket\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.734948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.734884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-istio-data\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.735017 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.734996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-istio-envoy\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.735075 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.735059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5w5j\" (UniqueName: \"kubernetes.io/projected/eb00e099-486d-4954-b41a-72b24d8802af-kube-api-access-v5w5j\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.735131 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.735117    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb00e099-486d-4954-b41a-72b24d8802af-istio-podinfo\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.835974 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.835887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5w5j\" (UniqueName: \"kubernetes.io/projected/eb00e099-486d-4954-b41a-72b24d8802af-kube-api-access-v5w5j\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.835974 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.835944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb00e099-486d-4954-b41a-72b24d8802af-istio-podinfo\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.836204 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.835987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-workload-certs\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.836204 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.836021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb00e099-486d-4954-b41a-72b24d8802af-istio-token\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.836204 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.836141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-credential-socket\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.836204 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.836184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb00e099-486d-4954-b41a-72b24d8802af-istiod-ca-cert\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.836445 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.836235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-workload-socket\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.836445 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.836292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-istio-data\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.836445 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.836432    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-workload-certs\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.836605 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.836512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-credential-socket\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.836605 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.836539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-istio-envoy\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.836605 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.836571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-workload-socket\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.836770 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.836663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-istio-data\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.836956 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.836926    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb00e099-486d-4954-b41a-72b24d8802af-istiod-ca-cert\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.838514 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.838492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-istio-envoy\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.838622 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.838603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb00e099-486d-4954-b41a-72b24d8802af-istio-podinfo\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.847605 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.847582    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb00e099-486d-4954-b41a-72b24d8802af-istio-token\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.847917 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.847901    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5w5j\" (UniqueName: \"kubernetes.io/projected/eb00e099-486d-4954-b41a-72b24d8802af-kube-api-access-v5w5j\") pod \"e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") " pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:49.898295 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:49.898261    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:50.181344 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:50.181242    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"]
Sep 16 18:36:50.187209 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:36:50.187179    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb00e099_486d_4954_b41a_72b24d8802af.slice/crio-29cfd14516d2ec9f5be16d6d0a36123f3e9d75bc382632bcd138d0c437f9bbdf WatchSource:0}: Error finding container 29cfd14516d2ec9f5be16d6d0a36123f3e9d75bc382632bcd138d0c437f9bbdf: Status 404 returned error can't find the container with id 29cfd14516d2ec9f5be16d6d0a36123f3e9d75bc382632bcd138d0c437f9bbdf
Sep 16 18:36:50.189535 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:50.189500    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:36:50.189630 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:50.189575    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:36:50.189630 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:50.189603    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:36:51.100800 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:51.100766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" event={"ID":"eb00e099-486d-4954-b41a-72b24d8802af","Type":"ContainerStarted","Data":"73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67"}
Sep 16 18:36:51.101189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:51.100813    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" event={"ID":"eb00e099-486d-4954-b41a-72b24d8802af","Type":"ContainerStarted","Data":"29cfd14516d2ec9f5be16d6d0a36123f3e9d75bc382632bcd138d0c437f9bbdf"}
Sep 16 18:36:51.133379 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:51.133321    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" podStartSLOduration=2.133306221 podStartE2EDuration="2.133306221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:36:51.132470587 +0000 UTC m=+1229.775496626" watchObservedRunningTime="2026-09-16 18:36:51.133306221 +0000 UTC m=+1229.776332261"
Sep 16 18:36:51.899321 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:51.899288    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:51.904405 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:51.904380    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:52.107069 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:52.107034    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:52.108128 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:52.108101    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:36:54.711082 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.710966    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"]
Sep 16 18:36:54.715154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.715130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:54.718313 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.718290    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-cf62d1-serving-cert\""
Sep 16 18:36:54.728971 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.728948    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"]
Sep 16 18:36:54.783626 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.783593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:54.783804 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.783664    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6be09580-b2fd-4690-bda3-111de556a3a6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:54.783804 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.783688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkr8f\" (UniqueName: \"kubernetes.io/projected/6be09580-b2fd-4690-bda3-111de556a3a6-kube-api-access-jkr8f\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:54.783917 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.783805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:54.884345 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.884310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:54.884529 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.884417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:54.884529 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:36:54.884475    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-serving-cert: secret "maas-api-e2e-shared-b-w2-cf62d1-serving-cert" not found
Sep 16 18:36:54.884643 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:36:54.884536    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-maas-api-tls podName:6be09580-b2fd-4690-bda3-111de556a3a6 nodeName:}" failed. No retries permitted until 2026-09-16 18:36:55.384519711 +0000 UTC m=+1234.027545729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-maas-api-tls") pod "maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn" (UID: "6be09580-b2fd-4690-bda3-111de556a3a6") : secret "maas-api-e2e-shared-b-w2-cf62d1-serving-cert" not found
Sep 16 18:36:54.884643 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.884480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6be09580-b2fd-4690-bda3-111de556a3a6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:54.884643 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.884598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkr8f\" (UniqueName: \"kubernetes.io/projected/6be09580-b2fd-4690-bda3-111de556a3a6-kube-api-access-jkr8f\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:54.885148 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.885124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6be09580-b2fd-4690-bda3-111de556a3a6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:54.886884 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.886866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:54.894917 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:54.894892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkr8f\" (UniqueName: \"kubernetes.io/projected/6be09580-b2fd-4690-bda3-111de556a3a6-kube-api-access-jkr8f\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:55.389440 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:55.389403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:55.392074 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:55.392046    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:55.628983 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:55.628950    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:55.907577 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:55.907553    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"]
Sep 16 18:36:55.909302 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:36:55.909276    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be09580_b2fd_4690_bda3_111de556a3a6.slice/crio-4f9c9ffcc0c3ae5cde931a2aeb8fbb7f7ac1fb1115cf5cefeb6c94440e1ec574 WatchSource:0}: Error finding container 4f9c9ffcc0c3ae5cde931a2aeb8fbb7f7ac1fb1115cf5cefeb6c94440e1ec574: Status 404 returned error can't find the container with id 4f9c9ffcc0c3ae5cde931a2aeb8fbb7f7ac1fb1115cf5cefeb6c94440e1ec574
Sep 16 18:36:56.130934 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:56.130894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn" event={"ID":"6be09580-b2fd-4690-bda3-111de556a3a6","Type":"ContainerStarted","Data":"4f9c9ffcc0c3ae5cde931a2aeb8fbb7f7ac1fb1115cf5cefeb6c94440e1ec574"}
Sep 16 18:36:57.138899 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:57.138862    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn" event={"ID":"6be09580-b2fd-4690-bda3-111de556a3a6","Type":"ContainerStarted","Data":"314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be"}
Sep 16 18:36:57.139335 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:57.138940    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:36:57.179531 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:57.179484    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn" podStartSLOduration=2.7886207069999998 podStartE2EDuration="3.179468109s" totalImagesPullingTime="390.847402ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:36:57.177576989 +0000 UTC m=+1235.820603028" watchObservedRunningTime="2026-09-16 18:36:57.179468109 +0000 UTC m=+1235.822494214"
Sep 16 18:36:58.579477 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:58.579449    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"]
Sep 16 18:36:58.579896 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:58.579636    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4" podUID="e761b0f4-daf6-43fa-8fd1-c23dce5f8257" containerName="maas-api" containerID="cri-o://cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e" gracePeriod=30
Sep 16 18:36:58.821439 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:58.821415    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:36:58.923907 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:58.923873    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-maas-api-tls\") pod \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") "
Sep 16 18:36:58.924078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:58.924014    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkqgc\" (UniqueName: \"kubernetes.io/projected/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-kube-api-access-vkqgc\") pod \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") "
Sep 16 18:36:58.924078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:58.924045    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-openshift-service-ca\") pod \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") "
Sep 16 18:36:58.924206 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:58.924181    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-metrics-certs\") pod \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\" (UID: \"e761b0f4-daf6-43fa-8fd1-c23dce5f8257\") "
Sep 16 18:36:58.924442 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:58.924416    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e761b0f4-daf6-43fa-8fd1-c23dce5f8257" (UID: "e761b0f4-daf6-43fa-8fd1-c23dce5f8257"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:36:58.924958 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:58.924665    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:58.926260 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:58.926226    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e761b0f4-daf6-43fa-8fd1-c23dce5f8257" (UID: "e761b0f4-daf6-43fa-8fd1-c23dce5f8257"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:36:58.926260 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:58.926240    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-kube-api-access-vkqgc" (OuterVolumeSpecName: "kube-api-access-vkqgc") pod "e761b0f4-daf6-43fa-8fd1-c23dce5f8257" (UID: "e761b0f4-daf6-43fa-8fd1-c23dce5f8257"). InnerVolumeSpecName "kube-api-access-vkqgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:36:58.926422 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:58.926311    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e761b0f4-daf6-43fa-8fd1-c23dce5f8257" (UID: "e761b0f4-daf6-43fa-8fd1-c23dce5f8257"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:36:59.025517 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.025486    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:59.025517 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.025511    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:59.025517 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.025520    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkqgc\" (UniqueName: \"kubernetes.io/projected/e761b0f4-daf6-43fa-8fd1-c23dce5f8257-kube-api-access-vkqgc\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:36:59.151927 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.151890    2580 generic.go:356] "Generic (PLEG): container finished" podID="e761b0f4-daf6-43fa-8fd1-c23dce5f8257" containerID="cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e" exitCode=0
Sep 16 18:36:59.152096 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.151945    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"
Sep 16 18:36:59.152096 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.151977    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4" event={"ID":"e761b0f4-daf6-43fa-8fd1-c23dce5f8257","Type":"ContainerDied","Data":"cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e"}
Sep 16 18:36:59.152096 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.152024    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4" event={"ID":"e761b0f4-daf6-43fa-8fd1-c23dce5f8257","Type":"ContainerDied","Data":"593a73d5fe590d15da59f237fbe7bace19cdc76d2ef4ac50a16ee805c636ada1"}
Sep 16 18:36:59.152096 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.152044    2580 scope.go:117] "RemoveContainer" containerID="cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e"
Sep 16 18:36:59.162139 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.162120    2580 scope.go:117] "RemoveContainer" containerID="cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e"
Sep 16 18:36:59.162425 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:36:59.162405    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e\": container with ID starting with cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e not found: ID does not exist" containerID="cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e"
Sep 16 18:36:59.162505 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.162434    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e"} err="failed to get container status \"cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e\": rpc error: code = NotFound desc = could not find container \"cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e\": container with ID starting with cd03361492c963a02546e6b6267c059fbbc6d69c0e8d74f5c51376c09f36845e not found: ID does not exist"
Sep 16 18:36:59.177825 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.177773    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"]
Sep 16 18:36:59.181190 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.181168    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0197e4-7d4f6b4768-f48f4"]
Sep 16 18:36:59.867050 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:36:59.867010    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e761b0f4-daf6-43fa-8fd1-c23dce5f8257" path="/var/lib/kubelet/pods/e761b0f4-daf6-43fa-8fd1-c23dce5f8257/volumes"
Sep 16 18:37:03.149495 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:03.149466    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:37:06.060376 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:06.060328    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"]
Sep 16 18:37:06.060780 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:06.060583    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy" containerID="cri-o://84d72be98ad465b1c4944d7e32915f126523aa591b194f7b9d6184fa0a81eab4" gracePeriod=30
Sep 16 18:37:11.228360 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.228331    2580 generic.go:356] "Generic (PLEG): container finished" podID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerID="84d72be98ad465b1c4944d7e32915f126523aa591b194f7b9d6184fa0a81eab4" exitCode=0
Sep 16 18:37:11.228805 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.228435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" event={"ID":"faa15103-bbd5-444b-a1c4-88e89ab8723d","Type":"ContainerDied","Data":"84d72be98ad465b1c4944d7e32915f126523aa591b194f7b9d6184fa0a81eab4"}
Sep 16 18:37:11.228805 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.228496    2580 scope.go:117] "RemoveContainer" containerID="b3361eb762776ce614627e4ad60f91e9d9f55adeff9cbc288b185bde8c030125"
Sep 16 18:37:11.306080 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.306059    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:37:11.449738 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.449705    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-workload-socket\") pod \"faa15103-bbd5-444b-a1c4-88e89ab8723d\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") "
Sep 16 18:37:11.449738 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.449738    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djc54\" (UniqueName: \"kubernetes.io/projected/faa15103-bbd5-444b-a1c4-88e89ab8723d-kube-api-access-djc54\") pod \"faa15103-bbd5-444b-a1c4-88e89ab8723d\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") "
Sep 16 18:37:11.449946 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.449757    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-credential-socket\") pod \"faa15103-bbd5-444b-a1c4-88e89ab8723d\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") "
Sep 16 18:37:11.449946 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.449798    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-data\") pod \"faa15103-bbd5-444b-a1c4-88e89ab8723d\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") "
Sep 16 18:37:11.449946 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.449876    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-podinfo\") pod \"faa15103-bbd5-444b-a1c4-88e89ab8723d\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") "
Sep 16 18:37:11.450085 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.449951    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-token\") pod \"faa15103-bbd5-444b-a1c4-88e89ab8723d\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") "
Sep 16 18:37:11.450085 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.449981    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-envoy\") pod \"faa15103-bbd5-444b-a1c4-88e89ab8723d\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") "
Sep 16 18:37:11.450085 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.450019    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faa15103-bbd5-444b-a1c4-88e89ab8723d-istiod-ca-cert\") pod \"faa15103-bbd5-444b-a1c4-88e89ab8723d\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") "
Sep 16 18:37:11.450085 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.450024    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "faa15103-bbd5-444b-a1c4-88e89ab8723d" (UID: "faa15103-bbd5-444b-a1c4-88e89ab8723d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:11.450085 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.450055    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-workload-certs\") pod \"faa15103-bbd5-444b-a1c4-88e89ab8723d\" (UID: \"faa15103-bbd5-444b-a1c4-88e89ab8723d\") "
Sep 16 18:37:11.450085 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.450060    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "faa15103-bbd5-444b-a1c4-88e89ab8723d" (UID: "faa15103-bbd5-444b-a1c4-88e89ab8723d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:11.450429 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.450135    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-data" (OuterVolumeSpecName: "istio-data") pod "faa15103-bbd5-444b-a1c4-88e89ab8723d" (UID: "faa15103-bbd5-444b-a1c4-88e89ab8723d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:11.450495 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.450424    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "faa15103-bbd5-444b-a1c4-88e89ab8723d" (UID: "faa15103-bbd5-444b-a1c4-88e89ab8723d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:11.450495 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.450446    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:11.450495 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.450470    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:11.450495 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.450484    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:11.450495 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.450447    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faa15103-bbd5-444b-a1c4-88e89ab8723d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "faa15103-bbd5-444b-a1c4-88e89ab8723d" (UID: "faa15103-bbd5-444b-a1c4-88e89ab8723d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:37:11.452086 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.452056    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-token" (OuterVolumeSpecName: "istio-token") pod "faa15103-bbd5-444b-a1c4-88e89ab8723d" (UID: "faa15103-bbd5-444b-a1c4-88e89ab8723d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:37:11.452086 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.452084    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faa15103-bbd5-444b-a1c4-88e89ab8723d-kube-api-access-djc54" (OuterVolumeSpecName: "kube-api-access-djc54") pod "faa15103-bbd5-444b-a1c4-88e89ab8723d" (UID: "faa15103-bbd5-444b-a1c4-88e89ab8723d"). InnerVolumeSpecName "kube-api-access-djc54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:37:11.452436 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.452405    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "faa15103-bbd5-444b-a1c4-88e89ab8723d" (UID: "faa15103-bbd5-444b-a1c4-88e89ab8723d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:11.452541 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.452452    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "faa15103-bbd5-444b-a1c4-88e89ab8723d" (UID: "faa15103-bbd5-444b-a1c4-88e89ab8723d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:37:11.551818 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.551787    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faa15103-bbd5-444b-a1c4-88e89ab8723d-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:11.551818 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.551813    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:11.551818 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.551822    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djc54\" (UniqueName: \"kubernetes.io/projected/faa15103-bbd5-444b-a1c4-88e89ab8723d-kube-api-access-djc54\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:11.552056 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.551831    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:11.552056 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.551841    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:11.552056 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:11.551848    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faa15103-bbd5-444b-a1c4-88e89ab8723d-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:12.234937 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:12.234857    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"
Sep 16 18:37:12.235359 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:12.234853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" event={"ID":"faa15103-bbd5-444b-a1c4-88e89ab8723d","Type":"ContainerDied","Data":"f4404b5da381b737677e58b6304137eee1a688c0802289cd7b3a0f32f32de3bc"}
Sep 16 18:37:12.235359 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:12.235009    2580 scope.go:117] "RemoveContainer" containerID="84d72be98ad465b1c4944d7e32915f126523aa591b194f7b9d6184fa0a81eab4"
Sep 16 18:37:12.255703 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:12.255681    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"]
Sep 16 18:37:12.258048 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:12.258029    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn"]
Sep 16 18:37:12.276043 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:12.276017    2580 patch_prober.go:28] interesting pod/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 18:37:12.276125 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:12.276063    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-0197e4-openshift-default-7f7b58995d-4crgn" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 18:37:13.867453 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:13.867420    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" path="/var/lib/kubelet/pods/faa15103-bbd5-444b-a1c4-88e89ab8723d/volumes"
Sep 16 18:37:17.054838 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.054805    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7706-dd68c4"]
Sep 16 18:37:17.055335 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.055302    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy"
Sep 16 18:37:17.055335 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.055328    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy"
Sep 16 18:37:17.055493 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.055354    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy"
Sep 16 18:37:17.055493 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.055378    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy"
Sep 16 18:37:17.055493 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.055399    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e761b0f4-daf6-43fa-8fd1-c23dce5f8257" containerName="maas-api"
Sep 16 18:37:17.055493 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.055408    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e761b0f4-daf6-43fa-8fd1-c23dce5f8257" containerName="maas-api"
Sep 16 18:37:17.055633 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.055502    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy"
Sep 16 18:37:17.055633 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.055511    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e761b0f4-daf6-43fa-8fd1-c23dce5f8257" containerName="maas-api"
Sep 16 18:37:17.059314 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.059298    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7706-dd68c4"
Sep 16 18:37:17.061969 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.061949    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xhq6g\""
Sep 16 18:37:17.070498 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.070474    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7706-dd68c4"]
Sep 16 18:37:17.208036 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.208000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4k5r\" (UniqueName: \"kubernetes.io/projected/b0f45a39-47f2-46d8-9798-ee8c30dc7857-kube-api-access-z4k5r\") pod \"test-curl-7706-dd68c4\" (UID: \"b0f45a39-47f2-46d8-9798-ee8c30dc7857\") " pod="opendatahub/test-curl-7706-dd68c4"
Sep 16 18:37:17.308593 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.308497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4k5r\" (UniqueName: \"kubernetes.io/projected/b0f45a39-47f2-46d8-9798-ee8c30dc7857-kube-api-access-z4k5r\") pod \"test-curl-7706-dd68c4\" (UID: \"b0f45a39-47f2-46d8-9798-ee8c30dc7857\") " pod="opendatahub/test-curl-7706-dd68c4"
Sep 16 18:37:17.317729 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.317697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4k5r\" (UniqueName: \"kubernetes.io/projected/b0f45a39-47f2-46d8-9798-ee8c30dc7857-kube-api-access-z4k5r\") pod \"test-curl-7706-dd68c4\" (UID: \"b0f45a39-47f2-46d8-9798-ee8c30dc7857\") " pod="opendatahub/test-curl-7706-dd68c4"
Sep 16 18:37:17.368281 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.368241    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7706-dd68c4"
Sep 16 18:37:17.653993 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.653968    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7706-dd68c4"]
Sep 16 18:37:17.655839 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:37:17.655812    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0f45a39_47f2_46d8_9798_ee8c30dc7857.slice/crio-4c474504eb6b8727f1a1cc0f48eb5a4c390ef82d2adbffb72fc2cb78f1201703 WatchSource:0}: Error finding container 4c474504eb6b8727f1a1cc0f48eb5a4c390ef82d2adbffb72fc2cb78f1201703: Status 404 returned error can't find the container with id 4c474504eb6b8727f1a1cc0f48eb5a4c390ef82d2adbffb72fc2cb78f1201703
Sep 16 18:37:17.657821 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:17.657805    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:37:18.280166 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:18.280128    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7706-dd68c4" event={"ID":"b0f45a39-47f2-46d8-9798-ee8c30dc7857","Type":"ContainerStarted","Data":"4c474504eb6b8727f1a1cc0f48eb5a4c390ef82d2adbffb72fc2cb78f1201703"}
Sep 16 18:37:20.293946 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:20.293914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7706-dd68c4" event={"ID":"b0f45a39-47f2-46d8-9798-ee8c30dc7857","Type":"ContainerStarted","Data":"62161c07d372b79c43a52f66a11ba019461043c3b447f07b64e2c56824d37268"}
Sep 16 18:37:20.315394 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:20.315315    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7706-dd68c4" podStartSLOduration=1.41666104 podStartE2EDuration="3.315292693s" totalImagesPullingTime="1.898631653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:37:20.311073167 +0000 UTC m=+1258.954099210" watchObservedRunningTime="2026-09-16 18:37:20.315292693 +0000 UTC m=+1258.958318734"
Sep 16 18:37:20.962531 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:20.962498    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7706-dd68c4"]
Sep 16 18:37:20.971742 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:20.971635    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7706-dd68c4"]
Sep 16 18:37:21.307735 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:37:21.307698    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7706-dd68c4" container="test-curl-7706-dd68c4"
Sep 16 18:37:21.610961 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:21.597783    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"]
Sep 16 18:37:22.315644 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:22.315523    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7706-dd68c4" podUID="b0f45a39-47f2-46d8-9798-ee8c30dc7857" containerName="test-curl-7706-dd68c4" containerID="cri-o://62161c07d372b79c43a52f66a11ba019461043c3b447f07b64e2c56824d37268" gracePeriod=2
Sep 16 18:37:23.942225 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:23.942186    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"]
Sep 16 18:37:23.942641 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:23.942576    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0f45a39-47f2-46d8-9798-ee8c30dc7857" containerName="test-curl-7706-dd68c4"
Sep 16 18:37:23.942641 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:23.942587    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0f45a39-47f2-46d8-9798-ee8c30dc7857" containerName="test-curl-7706-dd68c4"
Sep 16 18:37:23.942715 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:23.942662    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0f45a39-47f2-46d8-9798-ee8c30dc7857" containerName="test-curl-7706-dd68c4"
Sep 16 18:37:23.942715 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:23.942671    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="faa15103-bbd5-444b-a1c4-88e89ab8723d" containerName="istio-proxy"
Sep 16 18:37:23.948093 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:23.948069    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:23.950402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:23.950358    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a462d953-openshift-default-dockercfg-hwljf\""
Sep 16 18:37:23.960537 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:23.960516    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"]
Sep 16 18:37:24.079636 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.079600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-credential-socket\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.079816 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.079654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb128aa7-05e9-4920-96a2-ffece0144d1c-istiod-ca-cert\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.079816 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.079682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-workload-certs\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.079816 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.079704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-token\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.079816 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.079722    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-workload-socket\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.079816 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.079765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-envoy\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.079986 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.079824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-data\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.079986 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.079884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-podinfo\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.079986 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.079923    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w556g\" (UniqueName: \"kubernetes.io/projected/cb128aa7-05e9-4920-96a2-ffece0144d1c-kube-api-access-w556g\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181111 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-workload-certs\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181111 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-token\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181403 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-workload-socket\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181403 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-envoy\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181403 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-data\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181403 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-podinfo\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181639 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w556g\" (UniqueName: \"kubernetes.io/projected/cb128aa7-05e9-4920-96a2-ffece0144d1c-kube-api-access-w556g\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181639 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-workload-certs\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181639 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-credential-socket\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181639 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb128aa7-05e9-4920-96a2-ffece0144d1c-istiod-ca-cert\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181639 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-workload-socket\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181886 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181648    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-data\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.181886 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.181856    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-credential-socket\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.182298 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.182277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb128aa7-05e9-4920-96a2-ffece0144d1c-istiod-ca-cert\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.183663 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.183641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-envoy\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.184082 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.184059    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-podinfo\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.191559 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.191536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w556g\" (UniqueName: \"kubernetes.io/projected/cb128aa7-05e9-4920-96a2-ffece0144d1c-kube-api-access-w556g\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.191712 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.191687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-token\") pod \"e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") " pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.259092 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.259021    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:24.489099 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.489077    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7706-dd68c4"
Sep 16 18:37:24.583932 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.583906    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"]
Sep 16 18:37:24.585324 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.585302    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4k5r\" (UniqueName: \"kubernetes.io/projected/b0f45a39-47f2-46d8-9798-ee8c30dc7857-kube-api-access-z4k5r\") pod \"b0f45a39-47f2-46d8-9798-ee8c30dc7857\" (UID: \"b0f45a39-47f2-46d8-9798-ee8c30dc7857\") "
Sep 16 18:37:24.585657 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:37:24.585633    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb128aa7_05e9_4920_96a2_ffece0144d1c.slice/crio-07de4a0bb29b9be3e73a497a22f4c5aa095fcb805d478c93a38313aec255b811 WatchSource:0}: Error finding container 07de4a0bb29b9be3e73a497a22f4c5aa095fcb805d478c93a38313aec255b811: Status 404 returned error can't find the container with id 07de4a0bb29b9be3e73a497a22f4c5aa095fcb805d478c93a38313aec255b811
Sep 16 18:37:24.587498 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.587471    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0f45a39-47f2-46d8-9798-ee8c30dc7857-kube-api-access-z4k5r" (OuterVolumeSpecName: "kube-api-access-z4k5r") pod "b0f45a39-47f2-46d8-9798-ee8c30dc7857" (UID: "b0f45a39-47f2-46d8-9798-ee8c30dc7857"). InnerVolumeSpecName "kube-api-access-z4k5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:37:24.587958 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.587926    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:24.587996 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.587989    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:24.588037 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.588016    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:24.686244 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:24.686221    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4k5r\" (UniqueName: \"kubernetes.io/projected/b0f45a39-47f2-46d8-9798-ee8c30dc7857-kube-api-access-z4k5r\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:25.345497 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:25.345467    2580 generic.go:356] "Generic (PLEG): container finished" podID="b0f45a39-47f2-46d8-9798-ee8c30dc7857" containerID="62161c07d372b79c43a52f66a11ba019461043c3b447f07b64e2c56824d37268" exitCode=137
Sep 16 18:37:25.345893 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:25.345518    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7706-dd68c4"
Sep 16 18:37:25.345893 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:25.345545    2580 scope.go:117] "RemoveContainer" containerID="62161c07d372b79c43a52f66a11ba019461043c3b447f07b64e2c56824d37268"
Sep 16 18:37:25.347685 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:25.347655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" event={"ID":"cb128aa7-05e9-4920-96a2-ffece0144d1c","Type":"ContainerStarted","Data":"d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0"}
Sep 16 18:37:25.347798 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:25.347715    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" event={"ID":"cb128aa7-05e9-4920-96a2-ffece0144d1c","Type":"ContainerStarted","Data":"07de4a0bb29b9be3e73a497a22f4c5aa095fcb805d478c93a38313aec255b811"}
Sep 16 18:37:25.354413 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:25.354394    2580 scope.go:117] "RemoveContainer" containerID="62161c07d372b79c43a52f66a11ba019461043c3b447f07b64e2c56824d37268"
Sep 16 18:37:25.354683 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:37:25.354661    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62161c07d372b79c43a52f66a11ba019461043c3b447f07b64e2c56824d37268\": container with ID starting with 62161c07d372b79c43a52f66a11ba019461043c3b447f07b64e2c56824d37268 not found: ID does not exist" containerID="62161c07d372b79c43a52f66a11ba019461043c3b447f07b64e2c56824d37268"
Sep 16 18:37:25.354746 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:25.354694    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62161c07d372b79c43a52f66a11ba019461043c3b447f07b64e2c56824d37268"} err="failed to get container status \"62161c07d372b79c43a52f66a11ba019461043c3b447f07b64e2c56824d37268\": rpc error: code = NotFound desc = could not find container \"62161c07d372b79c43a52f66a11ba019461043c3b447f07b64e2c56824d37268\": container with ID starting with 62161c07d372b79c43a52f66a11ba019461043c3b447f07b64e2c56824d37268 not found: ID does not exist"
Sep 16 18:37:25.377604 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:37:25.377570    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7706-dd68c4\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="b0f45a39-47f2-46d8-9798-ee8c30dc7857" pod="opendatahub/test-curl-7706-dd68c4"
Sep 16 18:37:25.379573 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:25.379538    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" podStartSLOduration=2.379524903 podStartE2EDuration="2.379524903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:37:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:37:25.375056281 +0000 UTC m=+1264.018082320" watchObservedRunningTime="2026-09-16 18:37:25.379524903 +0000 UTC m=+1264.022550942"
Sep 16 18:37:25.867438 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:25.867407    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0f45a39-47f2-46d8-9798-ee8c30dc7857" path="/var/lib/kubelet/pods/b0f45a39-47f2-46d8-9798-ee8c30dc7857/volumes"
Sep 16 18:37:26.259265 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:26.259178    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:26.264463 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:26.264437    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:26.354810 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:26.354772    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:26.355746 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:26.355726    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:28.367798 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:28.367768    2580 generic.go:356] "Generic (PLEG): container finished" podID="eb00e099-486d-4954-b41a-72b24d8802af" containerID="73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67" exitCode=0
Sep 16 18:37:28.368233 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:28.367842    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" event={"ID":"eb00e099-486d-4954-b41a-72b24d8802af","Type":"ContainerDied","Data":"73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67"}
Sep 16 18:37:28.368355 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:28.368339    2580 scope.go:117] "RemoveContainer" containerID="73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67"
Sep 16 18:37:28.369335 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:28.369309    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:28.369415 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:28.369400    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:28.369456 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:28.369435    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:29.376210 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:29.376173    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" event={"ID":"eb00e099-486d-4954-b41a-72b24d8802af","Type":"ContainerStarted","Data":"9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b"}
Sep 16 18:37:29.899330 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:29.899292    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:37:29.899666 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:29.899547    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 16 18:37:29.899666 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:29.899606    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 16 18:37:30.899513 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:30.899480    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 16 18:37:30.900955 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:30.900920    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 16 18:37:31.904396 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:31.901734    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 16 18:37:31.904396 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:31.901819    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 16 18:37:32.536879 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.536846    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"]
Sep 16 18:37:32.541277 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.541249    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.544471 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.544444    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a462d953-serving-cert\""
Sep 16 18:37:32.555413 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.555386    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"]
Sep 16 18:37:32.667319 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.667270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-maas-api-tls\") pod \"maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.667517 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.667428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-metrics-certs\") pod \"maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.667517 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.667481    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2wvr\" (UniqueName: \"kubernetes.io/projected/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-kube-api-access-p2wvr\") pod \"maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.667648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.667618    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-openshift-service-ca\") pod \"maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.768982 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.768944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-metrics-certs\") pod \"maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.769172 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.768998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2wvr\" (UniqueName: \"kubernetes.io/projected/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-kube-api-access-p2wvr\") pod \"maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.769172 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.769052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-openshift-service-ca\") pod \"maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.769172 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.769079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-maas-api-tls\") pod \"maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.769749 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.769727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-openshift-service-ca\") pod \"maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.771358 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.771341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-maas-api-tls\") pod \"maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.771449 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.771416    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-metrics-certs\") pod \"maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.781942 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.781924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2wvr\" (UniqueName: \"kubernetes.io/projected/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-kube-api-access-p2wvr\") pod \"maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.853410 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.853353    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:32.902395 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.898840    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 16 18:37:32.902395 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:32.898915    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 16 18:37:33.160461 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:33.160437    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"]
Sep 16 18:37:33.161987 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:37:33.161948    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2b1e4c_0901_4b1c_905f_b89f872cebf2.slice/crio-fadce8b9a7e3dcd294f7d0c5bfdd53f8df7286d6127f4872aa1d399e0ae9d4d9 WatchSource:0}: Error finding container fadce8b9a7e3dcd294f7d0c5bfdd53f8df7286d6127f4872aa1d399e0ae9d4d9: Status 404 returned error can't find the container with id fadce8b9a7e3dcd294f7d0c5bfdd53f8df7286d6127f4872aa1d399e0ae9d4d9
Sep 16 18:37:33.404202 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:33.404108    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr" event={"ID":"cb2b1e4c-0901-4b1c-905f-b89f872cebf2","Type":"ContainerStarted","Data":"fadce8b9a7e3dcd294f7d0c5bfdd53f8df7286d6127f4872aa1d399e0ae9d4d9"}
Sep 16 18:37:33.901393 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:33.898675    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 16 18:37:33.901393 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:33.898736    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 16 18:37:34.415135 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:34.415086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr" event={"ID":"cb2b1e4c-0901-4b1c-905f-b89f872cebf2","Type":"ContainerStarted","Data":"9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4"}
Sep 16 18:37:34.416027 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:34.415999    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:34.455582 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:34.455532    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr" podStartSLOduration=2.063923158 podStartE2EDuration="2.455516976s" totalImagesPullingTime="391.593818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:37:34.453319301 +0000 UTC m=+1273.096345345" watchObservedRunningTime="2026-09-16 18:37:34.455516976 +0000 UTC m=+1273.098543052"
Sep 16 18:37:34.917533 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:34.917486    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:37:34.917876 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:34.917853    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:37:34.919870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:34.919845    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:37:36.642256 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.642209    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl" podUID="7314bdc7-3d1d-43ce-be51-6765086bfee8" containerName="main" containerID="cri-o://e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a" gracePeriod=45
Sep 16 18:37:36.888131 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.888108    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:37:36.907512 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.907451    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-dshm\") pod \"7314bdc7-3d1d-43ce-be51-6765086bfee8\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") "
Sep 16 18:37:36.907512 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.907481    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-model-cache\") pod \"7314bdc7-3d1d-43ce-be51-6765086bfee8\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") "
Sep 16 18:37:36.907717 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.907517    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7314bdc7-3d1d-43ce-be51-6765086bfee8-tls-certs\") pod \"7314bdc7-3d1d-43ce-be51-6765086bfee8\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") "
Sep 16 18:37:36.907717 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.907553    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-tmp-dir\") pod \"7314bdc7-3d1d-43ce-be51-6765086bfee8\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") "
Sep 16 18:37:36.907717 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.907638    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-home\") pod \"7314bdc7-3d1d-43ce-be51-6765086bfee8\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") "
Sep 16 18:37:36.907717 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.907685    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqftg\" (UniqueName: \"kubernetes.io/projected/7314bdc7-3d1d-43ce-be51-6765086bfee8-kube-api-access-bqftg\") pod \"7314bdc7-3d1d-43ce-be51-6765086bfee8\" (UID: \"7314bdc7-3d1d-43ce-be51-6765086bfee8\") "
Sep 16 18:37:36.907934 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.907771    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-model-cache" (OuterVolumeSpecName: "model-cache") pod "7314bdc7-3d1d-43ce-be51-6765086bfee8" (UID: "7314bdc7-3d1d-43ce-be51-6765086bfee8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:36.907934 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.907848    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7314bdc7-3d1d-43ce-be51-6765086bfee8" (UID: "7314bdc7-3d1d-43ce-be51-6765086bfee8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:36.908130 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.908069    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:36.908130 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.908082    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-home" (OuterVolumeSpecName: "home") pod "7314bdc7-3d1d-43ce-be51-6765086bfee8" (UID: "7314bdc7-3d1d-43ce-be51-6765086bfee8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:36.908130 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.908090    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:36.910222 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.910189    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-dshm" (OuterVolumeSpecName: "dshm") pod "7314bdc7-3d1d-43ce-be51-6765086bfee8" (UID: "7314bdc7-3d1d-43ce-be51-6765086bfee8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:36.910330 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.910313    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7314bdc7-3d1d-43ce-be51-6765086bfee8-kube-api-access-bqftg" (OuterVolumeSpecName: "kube-api-access-bqftg") pod "7314bdc7-3d1d-43ce-be51-6765086bfee8" (UID: "7314bdc7-3d1d-43ce-be51-6765086bfee8"). InnerVolumeSpecName "kube-api-access-bqftg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:37:36.910411 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:36.910332    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7314bdc7-3d1d-43ce-be51-6765086bfee8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7314bdc7-3d1d-43ce-be51-6765086bfee8" (UID: "7314bdc7-3d1d-43ce-be51-6765086bfee8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:37:37.008695 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.008661    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7314bdc7-3d1d-43ce-be51-6765086bfee8-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:37.008695 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.008691    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:37.008862 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.008701    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqftg\" (UniqueName: \"kubernetes.io/projected/7314bdc7-3d1d-43ce-be51-6765086bfee8-kube-api-access-bqftg\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:37.008862 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.008709    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7314bdc7-3d1d-43ce-be51-6765086bfee8-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:37:37.433309 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.433276    2580 generic.go:356] "Generic (PLEG): container finished" podID="7314bdc7-3d1d-43ce-be51-6765086bfee8" containerID="e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a" exitCode=0
Sep 16 18:37:37.433494 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.433332    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"
Sep 16 18:37:37.433494 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.433396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl" event={"ID":"7314bdc7-3d1d-43ce-be51-6765086bfee8","Type":"ContainerDied","Data":"e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a"}
Sep 16 18:37:37.433494 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.433432    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl" event={"ID":"7314bdc7-3d1d-43ce-be51-6765086bfee8","Type":"ContainerDied","Data":"695e898656eca48bd4001be440411b933b424c2015953d4bbaa2d1400f5cbccc"}
Sep 16 18:37:37.433494 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.433449    2580 scope.go:117] "RemoveContainer" containerID="e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a"
Sep 16 18:37:37.443177 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.443160    2580 scope.go:117] "RemoveContainer" containerID="e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a"
Sep 16 18:37:37.443446 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:37:37.443428    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a\": container with ID starting with e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a not found: ID does not exist" containerID="e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a"
Sep 16 18:37:37.443497 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.443455    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a"} err="failed to get container status \"e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a\": rpc error: code = NotFound desc = could not find container \"e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a\": container with ID starting with e4c7a7f9f58754825c99aee6c0e2485c7edad5bcfe4c4d1f291d3d7a80e8018a not found: ID does not exist"
Sep 16 18:37:37.460959 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.460930    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"]
Sep 16 18:37:37.466048 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.466028    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-5ca9c2/test-model-5ca9c2-kserve-64d4649467-65vnl"]
Sep 16 18:37:37.866300 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:37.866260    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7314bdc7-3d1d-43ce-be51-6765086bfee8" path="/var/lib/kubelet/pods/7314bdc7-3d1d-43ce-be51-6765086bfee8/volumes"
Sep 16 18:37:41.431473 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:41.431443    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:37:52.019390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.017244    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"]
Sep 16 18:37:52.019390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.017896    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7314bdc7-3d1d-43ce-be51-6765086bfee8" containerName="main"
Sep 16 18:37:52.019390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.017916    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7314bdc7-3d1d-43ce-be51-6765086bfee8" containerName="main"
Sep 16 18:37:52.019390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.018009    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7314bdc7-3d1d-43ce-be51-6765086bfee8" containerName="main"
Sep 16 18:37:52.021987 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.021472    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.027627 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.027606    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-972df0-openshift-default-dockercfg-rjvx5\""
Sep 16 18:37:52.033572 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.033540    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"]
Sep 16 18:37:52.150138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.149579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-envoy\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.150138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.149646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a19c4dae-940b-4159-aeec-1cf2281e479b-istiod-ca-cert\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.150138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.149689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-workload-certs\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.150138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.149729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-data\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.150138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.149758    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnz6d\" (UniqueName: \"kubernetes.io/projected/a19c4dae-940b-4159-aeec-1cf2281e479b-kube-api-access-gnz6d\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.150138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.149809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-token\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.150138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.149846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-podinfo\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.150138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.149943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-credential-socket\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.150138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.149981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-workload-socket\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.251501 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.251469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-credential-socket\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.251674 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.251505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-workload-socket\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.251674 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.251530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-envoy\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.251674 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.251555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a19c4dae-940b-4159-aeec-1cf2281e479b-istiod-ca-cert\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.251674 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.251578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-workload-certs\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.251674 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.251599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-data\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.251674 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.251621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnz6d\" (UniqueName: \"kubernetes.io/projected/a19c4dae-940b-4159-aeec-1cf2281e479b-kube-api-access-gnz6d\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.251674 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.251664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-token\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.252048 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.251698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-podinfo\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.252048 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.251908    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-credential-socket\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.252048 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.251918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-workload-socket\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.252048 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.252003    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-data\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.252216 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.252052    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-workload-certs\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.252349 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.252328    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a19c4dae-940b-4159-aeec-1cf2281e479b-istiod-ca-cert\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.254081 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.254065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-envoy\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.254301 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.254280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-podinfo\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.260887 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.260863    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-token\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.260887 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.260871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnz6d\" (UniqueName: \"kubernetes.io/projected/a19c4dae-940b-4159-aeec-1cf2281e479b-kube-api-access-gnz6d\") pod \"e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") " pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.341142 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.341112    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:52.625758 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.625721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"]
Sep 16 18:37:52.627424 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:37:52.627396    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19c4dae_940b_4159_aeec_1cf2281e479b.slice/crio-46868f93bdb8d4ef829a351f510ae60d0fc1be7d61bb36c3503cc56a65ce6a19 WatchSource:0}: Error finding container 46868f93bdb8d4ef829a351f510ae60d0fc1be7d61bb36c3503cc56a65ce6a19: Status 404 returned error can't find the container with id 46868f93bdb8d4ef829a351f510ae60d0fc1be7d61bb36c3503cc56a65ce6a19
Sep 16 18:37:52.629939 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.629894    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:52.630020 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.629993    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:52.630069 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:52.630037    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:53.538141 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:53.538104    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" event={"ID":"a19c4dae-940b-4159-aeec-1cf2281e479b","Type":"ContainerStarted","Data":"f86ead7cd4abce6f7ff45253e7b386a596e46e95fb89cb21e14210c05c21d388"}
Sep 16 18:37:53.538556 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:53.538156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" event={"ID":"a19c4dae-940b-4159-aeec-1cf2281e479b","Type":"ContainerStarted","Data":"46868f93bdb8d4ef829a351f510ae60d0fc1be7d61bb36c3503cc56a65ce6a19"}
Sep 16 18:37:53.563354 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:53.563305    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" podStartSLOduration=2.563289957 podStartE2EDuration="2.563289957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:37:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:37:53.55987848 +0000 UTC m=+1292.202904514" watchObservedRunningTime="2026-09-16 18:37:53.563289957 +0000 UTC m=+1292.206315996"
Sep 16 18:37:54.342034 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:54.341997    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:54.347878 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:54.347851    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:54.543441 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:54.543412    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:54.544422 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:54.544404    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:37:57.396571 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:57.396529    2580 patch_prober.go:28] interesting pod/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 18:37:57.396991 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:57.396607    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 18:37:57.564505 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:57.564424    2580 generic.go:356] "Generic (PLEG): container finished" podID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerID="d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0" exitCode=0
Sep 16 18:37:57.564796 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:57.564768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" event={"ID":"cb128aa7-05e9-4920-96a2-ffece0144d1c","Type":"ContainerDied","Data":"d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0"}
Sep 16 18:37:57.565332 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:57.565309    2580 scope.go:117] "RemoveContainer" containerID="d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0"
Sep 16 18:37:57.566845 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:57.566797    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:57.566968 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:57.566886    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:57.566968 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:57.566938    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:58.572033 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:58.571997    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" event={"ID":"cb128aa7-05e9-4920-96a2-ffece0144d1c","Type":"ContainerStarted","Data":"6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea"}
Sep 16 18:37:59.259418 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:59.259356    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:37:59.259629 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:59.259594    2580 patch_prober.go:28] interesting pod/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 16 18:37:59.259713 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:37:59.259659    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 16 18:38:00.260095 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:00.260062    2580 patch_prober.go:28] interesting pod/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 16 18:38:00.260502 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:00.260114    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 16 18:38:01.260440 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:01.260399    2580 patch_prober.go:28] interesting pod/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 16 18:38:01.260913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:01.260471    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 16 18:38:02.259650 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:02.259615    2580 patch_prober.go:28] interesting pod/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 16 18:38:02.259827 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:02.259672    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 16 18:38:03.259711 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:03.259678    2580 patch_prober.go:28] interesting pod/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 16 18:38:03.260096 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:03.259733    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 16 18:38:04.330264 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:04.330226    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:38:04.330843 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:04.330813    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:38:04.331793 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:04.331772    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:38:25.584558 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:25.584516    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 18:38:25.584944 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:25.584600    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 18:38:26.277857 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.277822    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"]
Sep 16 18:38:26.283500 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.283473    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.286763 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.286743    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-d3e8be-openshift-default-dockercfg-jfc4z\""
Sep 16 18:38:26.306466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.305527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-workload-certs\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.306466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.305624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-envoy\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.306466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.305704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-podinfo\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.306466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.305786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-token\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.306466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.305852    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-data\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.306466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.305906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istiod-ca-cert\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.306466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.306041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-workload-socket\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.306466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.306085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98tcq\" (UniqueName: \"kubernetes.io/projected/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-kube-api-access-98tcq\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.306466 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.306197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-credential-socket\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.308548 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.308523    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"]
Sep 16 18:38:26.407785 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.407744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-workload-certs\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.408506 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.408483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-envoy\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.408709 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.408692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-podinfo\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.408854 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.408839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-token\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.408966 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.408952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-data\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.409073 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.409060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istiod-ca-cert\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.409225 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.409197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-workload-socket\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.409336 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.409235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98tcq\" (UniqueName: \"kubernetes.io/projected/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-kube-api-access-98tcq\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.409421 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.409334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-credential-socket\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.409700 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.409677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-credential-socket\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.410073 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.410053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-data\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.410195 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.408423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-workload-certs\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.410962 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.410938    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istiod-ca-cert\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.411942 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.411286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-workload-socket\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.415429 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.415408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-envoy\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.416790 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.416766    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-podinfo\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.424745 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.424721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-token\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.424986 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.424966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98tcq\" (UniqueName: \"kubernetes.io/projected/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-kube-api-access-98tcq\") pod \"e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") " pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.596164 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.596091    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:26.908688 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.894072    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"]
Sep 16 18:38:26.908688 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:38:26.895996    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f1bd05_e6bd_48a0_b0ae_134adbe76a8c.slice/crio-aea95b476074d11b9ac3280753bf059ae09ba8e06c7e4f329c98989d694c040a WatchSource:0}: Error finding container aea95b476074d11b9ac3280753bf059ae09ba8e06c7e4f329c98989d694c040a: Status 404 returned error can't find the container with id aea95b476074d11b9ac3280753bf059ae09ba8e06c7e4f329c98989d694c040a
Sep 16 18:38:26.908688 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.899120    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:38:26.908688 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.899299    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:38:26.908688 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:26.899467    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:38:27.753431 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:27.753319    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" event={"ID":"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c","Type":"ContainerStarted","Data":"1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552"}
Sep 16 18:38:27.753431 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:27.753424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" event={"ID":"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c","Type":"ContainerStarted","Data":"aea95b476074d11b9ac3280753bf059ae09ba8e06c7e4f329c98989d694c040a"}
Sep 16 18:38:27.754918 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:27.754895    2580 generic.go:356] "Generic (PLEG): container finished" podID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerID="f86ead7cd4abce6f7ff45253e7b386a596e46e95fb89cb21e14210c05c21d388" exitCode=0
Sep 16 18:38:27.755017 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:27.754933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" event={"ID":"a19c4dae-940b-4159-aeec-1cf2281e479b","Type":"ContainerDied","Data":"f86ead7cd4abce6f7ff45253e7b386a596e46e95fb89cb21e14210c05c21d388"}
Sep 16 18:38:27.755247 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:27.755235    2580 scope.go:117] "RemoveContainer" containerID="f86ead7cd4abce6f7ff45253e7b386a596e46e95fb89cb21e14210c05c21d388"
Sep 16 18:38:27.756355 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:27.756324    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:38:27.756494 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:27.756423    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:38:27.756494 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:27.756475    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:38:27.781947 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:27.781904    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" podStartSLOduration=1.781890138 podStartE2EDuration="1.781890138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:38:27.780353247 +0000 UTC m=+1326.423379289" watchObservedRunningTime="2026-09-16 18:38:27.781890138 +0000 UTC m=+1326.424916178"
Sep 16 18:38:28.596833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:28.596782    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:28.614553 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:28.614505    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:28.762569 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:28.762536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" event={"ID":"a19c4dae-940b-4159-aeec-1cf2281e479b","Type":"ContainerStarted","Data":"717dc437d0c3c3e864a823f390778f67ba67bc952d7e3e19e96819cba445b685"}
Sep 16 18:38:28.762974 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:28.762701    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:28.763649 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:28.763631    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:38:29.342187 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:29.342157    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:38:29.342401 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:29.342341    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 18:38:29.342509 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:29.342413    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 18:38:30.342235 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:30.342198    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 18:38:30.342676 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:30.342257    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 18:38:31.342563 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:31.342523    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 18:38:31.342936 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:31.342590    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 18:38:32.341751 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:32.341714    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 18:38:32.341967 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:32.341789    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 18:38:33.341925 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:33.341889    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 18:38:33.342310 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:33.341953    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 18:38:34.345888 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:34.345842    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:38:34.346279 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:34.346110    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:38:34.346711 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:34.346694    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:38:36.479100 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.479063    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"]
Sep 16 18:38:36.483405 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.483354    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:36.485913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.485889    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-d3e8be-serving-cert\""
Sep 16 18:38:36.499126 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.499100    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"]
Sep 16 18:38:36.622357 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.622319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/494e80cf-e7f9-44bf-964d-58130567f5b7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:36.622540 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.622414    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:36.622540 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.622484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkmjx\" (UniqueName: \"kubernetes.io/projected/494e80cf-e7f9-44bf-964d-58130567f5b7-kube-api-access-jkmjx\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:36.622540 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.622529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:36.723879 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.723844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/494e80cf-e7f9-44bf-964d-58130567f5b7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:36.724025 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.723890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:36.724025 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.723930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkmjx\" (UniqueName: \"kubernetes.io/projected/494e80cf-e7f9-44bf-964d-58130567f5b7-kube-api-access-jkmjx\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:36.724025 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.723964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:36.724131 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:38:36.724070    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-serving-cert: secret "maas-api-e2e-shared-b-w3-d3e8be-serving-cert" not found
Sep 16 18:38:36.724166 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:38:36.724150    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-maas-api-tls podName:494e80cf-e7f9-44bf-964d-58130567f5b7 nodeName:}" failed. No retries permitted until 2026-09-16 18:38:37.224130036 +0000 UTC m=+1335.867156063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-maas-api-tls") pod "maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7" (UID: "494e80cf-e7f9-44bf-964d-58130567f5b7") : secret "maas-api-e2e-shared-b-w3-d3e8be-serving-cert" not found
Sep 16 18:38:36.724669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.724640    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/494e80cf-e7f9-44bf-964d-58130567f5b7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:36.726311 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.726294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:36.736689 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:36.736633    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkmjx\" (UniqueName: \"kubernetes.io/projected/494e80cf-e7f9-44bf-964d-58130567f5b7-kube-api-access-jkmjx\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:37.230846 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:37.230809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:37.233124 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:37.233101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:37.395386 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:37.395335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:37.682555 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:37.682527    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"]
Sep 16 18:38:37.684232 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:38:37.684208    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494e80cf_e7f9_44bf_964d_58130567f5b7.slice/crio-2689a1a21e0559564baf757dd420bd959e18bf912ea8c5b8ab0e10f7699d8c61 WatchSource:0}: Error finding container 2689a1a21e0559564baf757dd420bd959e18bf912ea8c5b8ab0e10f7699d8c61: Status 404 returned error can't find the container with id 2689a1a21e0559564baf757dd420bd959e18bf912ea8c5b8ab0e10f7699d8c61
Sep 16 18:38:37.817789 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:37.817756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7" event={"ID":"494e80cf-e7f9-44bf-964d-58130567f5b7","Type":"ContainerStarted","Data":"2689a1a21e0559564baf757dd420bd959e18bf912ea8c5b8ab0e10f7699d8c61"}
Sep 16 18:38:38.825559 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:38.825470    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7" event={"ID":"494e80cf-e7f9-44bf-964d-58130567f5b7","Type":"ContainerStarted","Data":"d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13"}
Sep 16 18:38:38.825913 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:38.825581    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:38:38.848017 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:38.847969    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7" podStartSLOduration=2.076860664 podStartE2EDuration="2.847956491s" totalImagesPullingTime="771.095827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:38:38.844686829 +0000 UTC m=+1337.487712870" watchObservedRunningTime="2026-09-16 18:38:38.847956491 +0000 UTC m=+1337.490982530"
Sep 16 18:38:44.836098 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:38:44.836019    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:39:04.983697 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:04.983662    2580 generic.go:356] "Generic (PLEG): container finished" podID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerID="1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552" exitCode=0
Sep 16 18:39:04.984097 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:04.983710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" event={"ID":"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c","Type":"ContainerDied","Data":"1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552"}
Sep 16 18:39:04.984139 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:04.984100    2580 scope.go:117] "RemoveContainer" containerID="1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552"
Sep 16 18:39:04.985318 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:04.985286    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:39:04.985401 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:04.985359    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:39:04.985448 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:04.985426    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:39:05.991645 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:05.991611    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" event={"ID":"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c","Type":"ContainerStarted","Data":"332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5"}
Sep 16 18:39:06.596520 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:06.596490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:39:06.596704 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:06.596678    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 16 18:39:06.596760 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:06.596726    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 16 18:39:07.596652 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:07.596619    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 16 18:39:07.597050 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:07.596679    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 16 18:39:08.596836 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:08.596802    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 16 18:39:08.597308 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:08.596869    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 16 18:39:09.597268 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:09.597234    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 16 18:39:09.597783 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:09.597292    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 16 18:39:10.596610 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:10.596572    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 16 18:39:10.596817 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:10.596647    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 16 18:39:11.600060 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:11.600026    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:39:11.600472 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:11.600289    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:39:11.600897 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:11.600877    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:39:44.511763 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:44.511729    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"]
Sep 16 18:39:44.512251 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:44.511933    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr" podUID="cb2b1e4c-0901-4b1c-905f-b89f872cebf2" containerName="maas-api" containerID="cri-o://9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4" gracePeriod=30
Sep 16 18:39:44.756071 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:44.756035    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:39:44.908189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:44.908144    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-metrics-certs\") pod \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") "
Sep 16 18:39:44.909002 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:44.908622    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2wvr\" (UniqueName: \"kubernetes.io/projected/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-kube-api-access-p2wvr\") pod \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") "
Sep 16 18:39:44.909002 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:44.908709    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-openshift-service-ca\") pod \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") "
Sep 16 18:39:44.909002 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:44.908833    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-maas-api-tls\") pod \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\" (UID: \"cb2b1e4c-0901-4b1c-905f-b89f872cebf2\") "
Sep 16 18:39:44.909689 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:44.909652    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cb2b1e4c-0901-4b1c-905f-b89f872cebf2" (UID: "cb2b1e4c-0901-4b1c-905f-b89f872cebf2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:39:44.913834 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:44.913787    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cb2b1e4c-0901-4b1c-905f-b89f872cebf2" (UID: "cb2b1e4c-0901-4b1c-905f-b89f872cebf2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:39:44.913834 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:44.913815    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cb2b1e4c-0901-4b1c-905f-b89f872cebf2" (UID: "cb2b1e4c-0901-4b1c-905f-b89f872cebf2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:39:44.914420 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:44.914361    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-kube-api-access-p2wvr" (OuterVolumeSpecName: "kube-api-access-p2wvr") pod "cb2b1e4c-0901-4b1c-905f-b89f872cebf2" (UID: "cb2b1e4c-0901-4b1c-905f-b89f872cebf2"). InnerVolumeSpecName "kube-api-access-p2wvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:39:45.009853 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.009819    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:39:45.009853 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.009848    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:39:45.009853 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.009860    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2wvr\" (UniqueName: \"kubernetes.io/projected/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-kube-api-access-p2wvr\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:39:45.010100 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.009874    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2b1e4c-0901-4b1c-905f-b89f872cebf2-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:39:45.236289 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.236189    2580 generic.go:356] "Generic (PLEG): container finished" podID="cb2b1e4c-0901-4b1c-905f-b89f872cebf2" containerID="9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4" exitCode=0
Sep 16 18:39:45.236289 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.236233    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"
Sep 16 18:39:45.236289 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.236266    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr" event={"ID":"cb2b1e4c-0901-4b1c-905f-b89f872cebf2","Type":"ContainerDied","Data":"9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4"}
Sep 16 18:39:45.236604 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.236328    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr" event={"ID":"cb2b1e4c-0901-4b1c-905f-b89f872cebf2","Type":"ContainerDied","Data":"fadce8b9a7e3dcd294f7d0c5bfdd53f8df7286d6127f4872aa1d399e0ae9d4d9"}
Sep 16 18:39:45.236604 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.236357    2580 scope.go:117] "RemoveContainer" containerID="9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4"
Sep 16 18:39:45.246332 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.246316    2580 scope.go:117] "RemoveContainer" containerID="9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4"
Sep 16 18:39:45.246633 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:39:45.246614    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4\": container with ID starting with 9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4 not found: ID does not exist" containerID="9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4"
Sep 16 18:39:45.246690 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.246642    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4"} err="failed to get container status \"9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4\": rpc error: code = NotFound desc = could not find container \"9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4\": container with ID starting with 9165f5b09d89de65ce586604dec0f7288fca557dacc6d24b8a8450ef3a17cef4 not found: ID does not exist"
Sep 16 18:39:45.258754 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.258729    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"]
Sep 16 18:39:45.262765 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.262746    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a462d953-58fd48d9d8-qwvjr"]
Sep 16 18:39:45.867206 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:39:45.867170    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb2b1e4c-0901-4b1c-905f-b89f872cebf2" path="/var/lib/kubelet/pods/cb2b1e4c-0901-4b1c-905f-b89f872cebf2/volumes"
Sep 16 18:41:18.238307 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:18.238265    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"]
Sep 16 18:41:18.238852 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:18.238532    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy" containerID="cri-o://6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea" gracePeriod=30
Sep 16 18:41:19.333247 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:19.333212    2580 patch_prober.go:28] interesting pod/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 18:41:19.333635 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:19.333279    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 18:41:23.485637 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.485607    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:41:23.580569 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.580486    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-token\") pod \"cb128aa7-05e9-4920-96a2-ffece0144d1c\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") "
Sep 16 18:41:23.580569 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.580539    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w556g\" (UniqueName: \"kubernetes.io/projected/cb128aa7-05e9-4920-96a2-ffece0144d1c-kube-api-access-w556g\") pod \"cb128aa7-05e9-4920-96a2-ffece0144d1c\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") "
Sep 16 18:41:23.580781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.580578    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-workload-socket\") pod \"cb128aa7-05e9-4920-96a2-ffece0144d1c\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") "
Sep 16 18:41:23.580781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.580618    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb128aa7-05e9-4920-96a2-ffece0144d1c-istiod-ca-cert\") pod \"cb128aa7-05e9-4920-96a2-ffece0144d1c\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") "
Sep 16 18:41:23.580781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.580661    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-podinfo\") pod \"cb128aa7-05e9-4920-96a2-ffece0144d1c\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") "
Sep 16 18:41:23.580781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.580696    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-workload-certs\") pod \"cb128aa7-05e9-4920-96a2-ffece0144d1c\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") "
Sep 16 18:41:23.580781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.580741    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-credential-socket\") pod \"cb128aa7-05e9-4920-96a2-ffece0144d1c\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") "
Sep 16 18:41:23.580781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.580779    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-envoy\") pod \"cb128aa7-05e9-4920-96a2-ffece0144d1c\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") "
Sep 16 18:41:23.581064 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.580818    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-data\") pod \"cb128aa7-05e9-4920-96a2-ffece0144d1c\" (UID: \"cb128aa7-05e9-4920-96a2-ffece0144d1c\") "
Sep 16 18:41:23.581064 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.580841    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb128aa7-05e9-4920-96a2-ffece0144d1c" (UID: "cb128aa7-05e9-4920-96a2-ffece0144d1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:41:23.581163 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.581111    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb128aa7-05e9-4920-96a2-ffece0144d1c" (UID: "cb128aa7-05e9-4920-96a2-ffece0144d1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:41:23.581216 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.581076    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb128aa7-05e9-4920-96a2-ffece0144d1c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb128aa7-05e9-4920-96a2-ffece0144d1c" (UID: "cb128aa7-05e9-4920-96a2-ffece0144d1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:41:23.581272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.581215    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:41:23.581272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.581232    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:41:23.581272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.581236    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb128aa7-05e9-4920-96a2-ffece0144d1c" (UID: "cb128aa7-05e9-4920-96a2-ffece0144d1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:41:23.581416 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.581336    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb128aa7-05e9-4920-96a2-ffece0144d1c" (UID: "cb128aa7-05e9-4920-96a2-ffece0144d1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:41:23.582766 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.582741    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb128aa7-05e9-4920-96a2-ffece0144d1c" (UID: "cb128aa7-05e9-4920-96a2-ffece0144d1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:41:23.582881 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.582811    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb128aa7-05e9-4920-96a2-ffece0144d1c" (UID: "cb128aa7-05e9-4920-96a2-ffece0144d1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:41:23.583084 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.583060    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb128aa7-05e9-4920-96a2-ffece0144d1c" (UID: "cb128aa7-05e9-4920-96a2-ffece0144d1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:41:23.583084 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.583069    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb128aa7-05e9-4920-96a2-ffece0144d1c-kube-api-access-w556g" (OuterVolumeSpecName: "kube-api-access-w556g") pod "cb128aa7-05e9-4920-96a2-ffece0144d1c" (UID: "cb128aa7-05e9-4920-96a2-ffece0144d1c"). InnerVolumeSpecName "kube-api-access-w556g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:41:23.682043 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.682017    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:41:23.682043 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.682038    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w556g\" (UniqueName: \"kubernetes.io/projected/cb128aa7-05e9-4920-96a2-ffece0144d1c-kube-api-access-w556g\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:41:23.682043 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.682048    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb128aa7-05e9-4920-96a2-ffece0144d1c-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:41:23.682232 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.682057    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:41:23.682232 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.682064    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:41:23.682232 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.682072    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:41:23.682232 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.682079    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb128aa7-05e9-4920-96a2-ffece0144d1c-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:41:23.799975 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.799940    2580 generic.go:356] "Generic (PLEG): container finished" podID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerID="6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea" exitCode=0
Sep 16 18:41:23.800143 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.799986    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"
Sep 16 18:41:23.800143 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.800016    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" event={"ID":"cb128aa7-05e9-4920-96a2-ffece0144d1c","Type":"ContainerDied","Data":"6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea"}
Sep 16 18:41:23.800143 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.800102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc" event={"ID":"cb128aa7-05e9-4920-96a2-ffece0144d1c","Type":"ContainerDied","Data":"07de4a0bb29b9be3e73a497a22f4c5aa095fcb805d478c93a38313aec255b811"}
Sep 16 18:41:23.800143 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.800130    2580 scope.go:117] "RemoveContainer" containerID="6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea"
Sep 16 18:41:23.809908 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.809892    2580 scope.go:117] "RemoveContainer" containerID="d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0"
Sep 16 18:41:23.818066 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.818043    2580 scope.go:117] "RemoveContainer" containerID="6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea"
Sep 16 18:41:23.818308 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:41:23.818288    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea\": container with ID starting with 6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea not found: ID does not exist" containerID="6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea"
Sep 16 18:41:23.818406 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.818320    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea"} err="failed to get container status \"6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea\": rpc error: code = NotFound desc = could not find container \"6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea\": container with ID starting with 6b4f1cc1718f7768244f2d27f59458a50a471c2a43caff316fa79fc6efb49dea not found: ID does not exist"
Sep 16 18:41:23.818406 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.818347    2580 scope.go:117] "RemoveContainer" containerID="d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0"
Sep 16 18:41:23.818629 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:41:23.818610    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0\": container with ID starting with d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0 not found: ID does not exist" containerID="d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0"
Sep 16 18:41:23.818669 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.818636    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0"} err="failed to get container status \"d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0\": rpc error: code = NotFound desc = could not find container \"d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0\": container with ID starting with d1225b872e23f904953c10c06d41526d6fcae0c02d5dc1cf15c16bb18b23b2f0 not found: ID does not exist"
Sep 16 18:41:23.844964 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.844937    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"]
Sep 16 18:41:23.852450 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.852428    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a462d953-openshift-default-5c6dfddf5b-nwtnc"]
Sep 16 18:41:23.866487 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:23.866464    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" path="/var/lib/kubelet/pods/cb128aa7-05e9-4920-96a2-ffece0144d1c/volumes"
Sep 16 18:41:24.346927 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.346896    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"]
Sep 16 18:41:24.347279 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.347267    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy"
Sep 16 18:41:24.347323 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.347280    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy"
Sep 16 18:41:24.347323 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.347295    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2b1e4c-0901-4b1c-905f-b89f872cebf2" containerName="maas-api"
Sep 16 18:41:24.347323 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.347301    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2b1e4c-0901-4b1c-905f-b89f872cebf2" containerName="maas-api"
Sep 16 18:41:24.347323 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.347314    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy"
Sep 16 18:41:24.347323 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.347320    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy"
Sep 16 18:41:24.347505 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.347390    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb2b1e4c-0901-4b1c-905f-b89f872cebf2" containerName="maas-api"
Sep 16 18:41:24.347505 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.347399    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy"
Sep 16 18:41:24.347505 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.347406    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb128aa7-05e9-4920-96a2-ffece0144d1c" containerName="istio-proxy"
Sep 16 18:41:24.352131 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.352109    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.362736 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.362718    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a24d09\"/\"embedding-w0-a24d09-kserve-self-signed-certs\""
Sep 16 18:41:24.432094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.432060    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"]
Sep 16 18:41:24.490632 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.490596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-model-cache\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.491010 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.490635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kvt9\" (UniqueName: \"kubernetes.io/projected/a566cc0e-f178-4284-885d-0c5c7f06aba8-kube-api-access-7kvt9\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.491010 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.490724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-home\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.491010 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.490789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-dshm\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.491010 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.490859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-tmp-dir\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.491010 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.490892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a566cc0e-f178-4284-885d-0c5c7f06aba8-tls-certs\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.591985 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.591951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-dshm\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.592136 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.592017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-tmp-dir\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.592136 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.592054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a566cc0e-f178-4284-885d-0c5c7f06aba8-tls-certs\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.592136 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.592083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-model-cache\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.592136 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.592111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kvt9\" (UniqueName: \"kubernetes.io/projected/a566cc0e-f178-4284-885d-0c5c7f06aba8-kube-api-access-7kvt9\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.592353 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.592242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-home\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.592524 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.592499    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-tmp-dir\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.592650 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.592541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-model-cache\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.592650 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.592609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-home\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.594291 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.594271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-dshm\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.594583 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.594567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a566cc0e-f178-4284-885d-0c5c7f06aba8-tls-certs\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.630911 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.630852    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kvt9\" (UniqueName: \"kubernetes.io/projected/a566cc0e-f178-4284-885d-0c5c7f06aba8-kube-api-access-7kvt9\") pod \"embedding-w0-a24d09-kserve-69dfb5989b-9bp27\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") " pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.661742 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.661712    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:24.981938 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:41:24.981906    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda566cc0e_f178_4284_885d_0c5c7f06aba8.slice/crio-4eb163fe5209c4d54d831ac64ad1b060ddf08adf524e399a3539c722d16c4c3b WatchSource:0}: Error finding container 4eb163fe5209c4d54d831ac64ad1b060ddf08adf524e399a3539c722d16c4c3b: Status 404 returned error can't find the container with id 4eb163fe5209c4d54d831ac64ad1b060ddf08adf524e399a3539c722d16c4c3b
Sep 16 18:41:24.982346 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:24.982286    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"]
Sep 16 18:41:25.814576 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:25.814540    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27" event={"ID":"a566cc0e-f178-4284-885d-0c5c7f06aba8","Type":"ContainerStarted","Data":"a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411"}
Sep 16 18:41:25.814944 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:25.814585    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27" event={"ID":"a566cc0e-f178-4284-885d-0c5c7f06aba8","Type":"ContainerStarted","Data":"4eb163fe5209c4d54d831ac64ad1b060ddf08adf524e399a3539c722d16c4c3b"}
Sep 16 18:41:25.855999 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:25.855950    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27" podStartSLOduration=1.855933878 podStartE2EDuration="1.855933878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:41:25.855839758 +0000 UTC m=+1504.498865810" watchObservedRunningTime="2026-09-16 18:41:25.855933878 +0000 UTC m=+1504.498959917"
Sep 16 18:41:34.662654 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:34.662623    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:34.663025 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:34.662917    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:34.674736 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:34.674709    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:34.879212 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:34.879184    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:41:44.245051 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.244976    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"]
Sep 16 18:41:44.248565 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.248548    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.255636 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.255611    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d3e8be\"/\"auth-test-model-d3e8be-kserve-self-signed-certs\""
Sep 16 18:41:44.256486 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.256471    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d3e8be\"/\"openshift-service-ca.crt\""
Sep 16 18:41:44.259471 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.259450    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d3e8be\"/\"kube-root-ca.crt\""
Sep 16 18:41:44.259538 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.259487    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d3e8be\"/\"default-dockercfg-wzmqh\""
Sep 16 18:41:44.270412 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.270389    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"]
Sep 16 18:41:44.278216 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.278187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-home\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.278324 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.278296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bzwq\" (UniqueName: \"kubernetes.io/projected/70766462-cbba-4725-8b51-5566cedea694-kube-api-access-2bzwq\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.278399 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.278331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-tmp-dir\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.278399 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.278383    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-dshm\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.278503 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.278412    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-model-cache\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.278503 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.278437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70766462-cbba-4725-8b51-5566cedea694-tls-certs\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.379621 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.379585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-home\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.379954 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.379930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bzwq\" (UniqueName: \"kubernetes.io/projected/70766462-cbba-4725-8b51-5566cedea694-kube-api-access-2bzwq\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.380092 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.380077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-tmp-dir\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.380199 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.380187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-dshm\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.380313 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.380298    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-model-cache\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.380455 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.380439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70766462-cbba-4725-8b51-5566cedea694-tls-certs\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.381340 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.381317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-home\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.381512 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.381491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-tmp-dir\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.381833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.381805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-model-cache\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.384698 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.384645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70766462-cbba-4725-8b51-5566cedea694-tls-certs\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.385843 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.385791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-dshm\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.397706 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.397676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bzwq\" (UniqueName: \"kubernetes.io/projected/70766462-cbba-4725-8b51-5566cedea694-kube-api-access-2bzwq\") pod \"auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") " pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.559033 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.558735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:44.855793 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.855767    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"]
Sep 16 18:41:44.857954 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:41:44.857923    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70766462_cbba_4725_8b51_5566cedea694.slice/crio-5bb96b3e2e3e025874f7fe5d3a1513998be8e4aec282fcfae5f231dbd85300ef WatchSource:0}: Error finding container 5bb96b3e2e3e025874f7fe5d3a1513998be8e4aec282fcfae5f231dbd85300ef: Status 404 returned error can't find the container with id 5bb96b3e2e3e025874f7fe5d3a1513998be8e4aec282fcfae5f231dbd85300ef
Sep 16 18:41:44.925962 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.925931    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v" event={"ID":"70766462-cbba-4725-8b51-5566cedea694","Type":"ContainerStarted","Data":"972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3"}
Sep 16 18:41:44.926075 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.925977    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v" event={"ID":"70766462-cbba-4725-8b51-5566cedea694","Type":"ContainerStarted","Data":"5bb96b3e2e3e025874f7fe5d3a1513998be8e4aec282fcfae5f231dbd85300ef"}
Sep 16 18:41:44.954186 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:44.954140    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v" podStartSLOduration=0.954125314 podStartE2EDuration="954.125314ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:41:44.948660291 +0000 UTC m=+1523.591686331" watchObservedRunningTime="2026-09-16 18:41:44.954125314 +0000 UTC m=+1523.597151353"
Sep 16 18:41:54.560321 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:54.560278    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:54.560848 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:54.560342    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:54.572696 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:54.572657    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:41:54.994658 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:41:54.994629    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:42:31.442905 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.442868    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"]
Sep 16 18:42:31.447245 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.447223    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:31.449675 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.449649    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-6a7741-serving-cert\""
Sep 16 18:42:31.461849 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.461823    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"]
Sep 16 18:42:31.559664 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.559614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpdxs\" (UniqueName: \"kubernetes.io/projected/47e77246-ede2-4358-8652-3c9b80e33d9f-kube-api-access-gpdxs\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:31.560653 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.560209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-metrics-certs\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:31.560653 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.560285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-maas-api-tls\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:31.560653 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.560361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47e77246-ede2-4358-8652-3c9b80e33d9f-openshift-service-ca\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:31.661850 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.661816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-metrics-certs\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:31.662051 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.661884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-maas-api-tls\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:31.662051 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.661963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47e77246-ede2-4358-8652-3c9b80e33d9f-openshift-service-ca\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:31.662051 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:42:31.662040    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-serving-cert: secret "maas-api-e2e-api-a-6a7741-serving-cert" not found
Sep 16 18:42:31.662661 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.662086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpdxs\" (UniqueName: \"kubernetes.io/projected/47e77246-ede2-4358-8652-3c9b80e33d9f-kube-api-access-gpdxs\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:31.662661 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:42:31.662102    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-maas-api-tls podName:47e77246-ede2-4358-8652-3c9b80e33d9f nodeName:}" failed. No retries permitted until 2026-09-16 18:42:32.162083381 +0000 UTC m=+1570.805109415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-maas-api-tls") pod "maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx" (UID: "47e77246-ede2-4358-8652-3c9b80e33d9f") : secret "maas-api-e2e-api-a-6a7741-serving-cert" not found
Sep 16 18:42:31.662814 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.662793    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47e77246-ede2-4358-8652-3c9b80e33d9f-openshift-service-ca\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:31.664321 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.664292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-metrics-certs\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:31.672615 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:31.672590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpdxs\" (UniqueName: \"kubernetes.io/projected/47e77246-ede2-4358-8652-3c9b80e33d9f-kube-api-access-gpdxs\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:32.167554 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:32.167524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-maas-api-tls\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:32.169917 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:32.169890    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-maas-api-tls\") pod \"maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:32.358015 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:32.357981    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:32.672231 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:32.672201    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"]
Sep 16 18:42:32.673104 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:42:32.673073    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e77246_ede2_4358_8652_3c9b80e33d9f.slice/crio-7a93272b8f3fb9427b07df556c578e16e18d4624034dedd154306dc622ea7bc6 WatchSource:0}: Error finding container 7a93272b8f3fb9427b07df556c578e16e18d4624034dedd154306dc622ea7bc6: Status 404 returned error can't find the container with id 7a93272b8f3fb9427b07df556c578e16e18d4624034dedd154306dc622ea7bc6
Sep 16 18:42:32.674839 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:32.674817    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:42:33.209976 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:33.209939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx" event={"ID":"47e77246-ede2-4358-8652-3c9b80e33d9f","Type":"ContainerStarted","Data":"7a93272b8f3fb9427b07df556c578e16e18d4624034dedd154306dc622ea7bc6"}
Sep 16 18:42:34.216831 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:34.216795    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx" event={"ID":"47e77246-ede2-4358-8652-3c9b80e33d9f","Type":"ContainerStarted","Data":"ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103"}
Sep 16 18:42:34.217219 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:34.216867    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:34.242940 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:34.242889    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx" podStartSLOduration=2.673433155 podStartE2EDuration="3.242874201s" totalImagesPullingTime="569.441046ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:34.240196075 +0000 UTC m=+1572.883222126" watchObservedRunningTime="2026-09-16 18:42:34.242874201 +0000 UTC m=+1572.885900296"
Sep 16 18:42:40.228278 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:40.228248    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:42:57.132223 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.132187    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"]
Sep 16 18:42:57.135730 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.135715    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.140557 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.140523    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-61fa84-openshift-default-dockercfg-djn6g\""
Sep 16 18:42:57.155086 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.155063    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"]
Sep 16 18:42:57.218157 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.218121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a282abf-a00b-474e-ba13-f9aa208dc928-istiod-ca-cert\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.218344 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.218217    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-workload-certs\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.218344 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.218249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-data\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.218499 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.218350    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-podinfo\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.218499 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.218413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-token\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.218499 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.218477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvvfb\" (UniqueName: \"kubernetes.io/projected/1a282abf-a00b-474e-ba13-f9aa208dc928-kube-api-access-wvvfb\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.218654 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.218515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-credential-socket\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.218654 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.218539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-envoy\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.218654 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.218579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-workload-socket\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.320389 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.320061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-podinfo\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.320389 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.320131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-token\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.320389 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.320203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvvfb\" (UniqueName: \"kubernetes.io/projected/1a282abf-a00b-474e-ba13-f9aa208dc928-kube-api-access-wvvfb\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.320389 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.320238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-credential-socket\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.320389 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.320265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-envoy\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.320389 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.320294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-workload-socket\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.320389 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.320399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a282abf-a00b-474e-ba13-f9aa208dc928-istiod-ca-cert\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.320905 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.320457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-workload-certs\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.320905 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.320479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-data\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.320905 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.320898    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-data\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.322004 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.321979    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a282abf-a00b-474e-ba13-f9aa208dc928-istiod-ca-cert\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.322519 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.322495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-workload-socket\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.322874 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.322829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-workload-certs\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.323207 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.323181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-credential-socket\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.327162 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.327139    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-envoy\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.327455 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.327433    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-podinfo\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.332487 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.332465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvvfb\" (UniqueName: \"kubernetes.io/projected/1a282abf-a00b-474e-ba13-f9aa208dc928-kube-api-access-wvvfb\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.334037 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.334016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-token\") pod \"e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") " pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.446941 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.446858    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:57.748758 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.748732    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"]
Sep 16 18:42:57.751214 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:42:57.751184    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a282abf_a00b_474e_ba13_f9aa208dc928.slice/crio-6ab820c3ac9d291c5ee819b01b8047e8f1f5b1382aaa02a739375c48b822f7eb WatchSource:0}: Error finding container 6ab820c3ac9d291c5ee819b01b8047e8f1f5b1382aaa02a739375c48b822f7eb: Status 404 returned error can't find the container with id 6ab820c3ac9d291c5ee819b01b8047e8f1f5b1382aaa02a739375c48b822f7eb
Sep 16 18:42:57.753625 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.753589    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:42:57.753710 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.753662    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:42:57.753710 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:57.753695    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:42:58.361446 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:58.361414    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" event={"ID":"1a282abf-a00b-474e-ba13-f9aa208dc928","Type":"ContainerStarted","Data":"f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc"}
Sep 16 18:42:58.361811 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:58.361471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" event={"ID":"1a282abf-a00b-474e-ba13-f9aa208dc928","Type":"ContainerStarted","Data":"6ab820c3ac9d291c5ee819b01b8047e8f1f5b1382aaa02a739375c48b822f7eb"}
Sep 16 18:42:58.413030 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:58.412983    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" podStartSLOduration=1.412967673 podStartE2EDuration="1.412967673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:58.40892706 +0000 UTC m=+1597.051953110" watchObservedRunningTime="2026-09-16 18:42:58.412967673 +0000 UTC m=+1597.055993713"
Sep 16 18:42:58.447625 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:58.447591    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:58.452487 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:58.452463    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:59.367532 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:59.367502    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:42:59.368350 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:42:59.368329    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:43:25.521912 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:25.521883    2580 generic.go:356] "Generic (PLEG): container finished" podID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerID="f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc" exitCode=0
Sep 16 18:43:25.522252 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:25.521948    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" event={"ID":"1a282abf-a00b-474e-ba13-f9aa208dc928","Type":"ContainerDied","Data":"f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc"}
Sep 16 18:43:25.522416 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:25.522386    2580 scope.go:117] "RemoveContainer" containerID="f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc"
Sep 16 18:43:25.523618 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:25.523591    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:43:25.523687 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:25.523656    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:43:25.523724 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:25.523686    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:43:26.543838 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:26.543807    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" event={"ID":"1a282abf-a00b-474e-ba13-f9aa208dc928","Type":"ContainerStarted","Data":"c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a"}
Sep 16 18:43:27.447035 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:27.447004    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:43:27.448035 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:27.448013    2580 patch_prober.go:28] interesting pod/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 16 18:43:27.448129 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:27.448062    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 16 18:43:28.447628 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:28.447590    2580 patch_prober.go:28] interesting pod/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 16 18:43:28.448015 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:28.447661    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 16 18:43:28.566247 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:28.566212    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"]
Sep 16 18:43:28.579810 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:28.579783    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"]
Sep 16 18:43:29.368387 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:29.368337    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:43:29.447597 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:29.447563    2580 patch_prober.go:28] interesting pod/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 16 18:43:29.447781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:29.447620    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 16 18:43:30.447316 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:30.447274    2580 patch_prober.go:28] interesting pod/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 16 18:43:30.447549 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:30.447336    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 16 18:43:31.448235 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:31.448192    2580 patch_prober.go:28] interesting pod/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 16 18:43:31.448758 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:31.448256    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 16 18:43:32.451906 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:32.451876    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:43:32.452902 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:32.452882    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:43:43.585623 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:43.585562    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27" podUID="a566cc0e-f178-4284-885d-0c5c7f06aba8" containerName="main" containerID="cri-o://a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411" gracePeriod=45
Sep 16 18:43:43.599125 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:43.599093    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq" podUID="333553b5-c7bf-469d-8268-05d194458bf4" containerName="main" containerID="cri-o://458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089" gracePeriod=45
Sep 16 18:43:43.887135 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:43.887112    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:43:43.890500 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:43.890479    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:43:44.020890 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.020860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-tmp-dir\") pod \"a566cc0e-f178-4284-885d-0c5c7f06aba8\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") "
Sep 16 18:43:44.021080 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.020897    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-model-cache\") pod \"a566cc0e-f178-4284-885d-0c5c7f06aba8\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") "
Sep 16 18:43:44.021080 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.020916    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-home\") pod \"a566cc0e-f178-4284-885d-0c5c7f06aba8\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") "
Sep 16 18:43:44.021080 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.020940    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlp5x\" (UniqueName: \"kubernetes.io/projected/333553b5-c7bf-469d-8268-05d194458bf4-kube-api-access-qlp5x\") pod \"333553b5-c7bf-469d-8268-05d194458bf4\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") "
Sep 16 18:43:44.021080 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.020979    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-home\") pod \"333553b5-c7bf-469d-8268-05d194458bf4\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") "
Sep 16 18:43:44.021080 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021002    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-dshm\") pod \"a566cc0e-f178-4284-885d-0c5c7f06aba8\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") "
Sep 16 18:43:44.021080 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021040    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kvt9\" (UniqueName: \"kubernetes.io/projected/a566cc0e-f178-4284-885d-0c5c7f06aba8-kube-api-access-7kvt9\") pod \"a566cc0e-f178-4284-885d-0c5c7f06aba8\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") "
Sep 16 18:43:44.021454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021084    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-dshm\") pod \"333553b5-c7bf-469d-8268-05d194458bf4\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") "
Sep 16 18:43:44.021454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021127    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-model-cache\") pod \"333553b5-c7bf-469d-8268-05d194458bf4\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") "
Sep 16 18:43:44.021454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021171    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a566cc0e-f178-4284-885d-0c5c7f06aba8" (UID: "a566cc0e-f178-4284-885d-0c5c7f06aba8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:43:44.021454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021197    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-home" (OuterVolumeSpecName: "home") pod "a566cc0e-f178-4284-885d-0c5c7f06aba8" (UID: "a566cc0e-f178-4284-885d-0c5c7f06aba8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:43:44.021454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021208    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-model-cache" (OuterVolumeSpecName: "model-cache") pod "a566cc0e-f178-4284-885d-0c5c7f06aba8" (UID: "a566cc0e-f178-4284-885d-0c5c7f06aba8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:43:44.021454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021237    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333553b5-c7bf-469d-8268-05d194458bf4-tls-certs\") pod \"333553b5-c7bf-469d-8268-05d194458bf4\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") "
Sep 16 18:43:44.021454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021260    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-home" (OuterVolumeSpecName: "home") pod "333553b5-c7bf-469d-8268-05d194458bf4" (UID: "333553b5-c7bf-469d-8268-05d194458bf4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:43:44.021454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021310    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a566cc0e-f178-4284-885d-0c5c7f06aba8-tls-certs\") pod \"a566cc0e-f178-4284-885d-0c5c7f06aba8\" (UID: \"a566cc0e-f178-4284-885d-0c5c7f06aba8\") "
Sep 16 18:43:44.021454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021334    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-model-cache" (OuterVolumeSpecName: "model-cache") pod "333553b5-c7bf-469d-8268-05d194458bf4" (UID: "333553b5-c7bf-469d-8268-05d194458bf4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:43:44.021454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021361    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-tmp-dir\") pod \"333553b5-c7bf-469d-8268-05d194458bf4\" (UID: \"333553b5-c7bf-469d-8268-05d194458bf4\") "
Sep 16 18:43:44.021951 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021711    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "333553b5-c7bf-469d-8268-05d194458bf4" (UID: "333553b5-c7bf-469d-8268-05d194458bf4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:43:44.021951 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021888    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.021951 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021907    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.021951 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021921    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.021951 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021933    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.021951 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021945    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.022254 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.021957    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.023454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.023423    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-dshm" (OuterVolumeSpecName: "dshm") pod "a566cc0e-f178-4284-885d-0c5c7f06aba8" (UID: "a566cc0e-f178-4284-885d-0c5c7f06aba8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:43:44.023574 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.023508    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a566cc0e-f178-4284-885d-0c5c7f06aba8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a566cc0e-f178-4284-885d-0c5c7f06aba8" (UID: "a566cc0e-f178-4284-885d-0c5c7f06aba8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:43:44.023700 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.023675    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/333553b5-c7bf-469d-8268-05d194458bf4-kube-api-access-qlp5x" (OuterVolumeSpecName: "kube-api-access-qlp5x") pod "333553b5-c7bf-469d-8268-05d194458bf4" (UID: "333553b5-c7bf-469d-8268-05d194458bf4"). InnerVolumeSpecName "kube-api-access-qlp5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:43:44.023785 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.023733    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-dshm" (OuterVolumeSpecName: "dshm") pod "333553b5-c7bf-469d-8268-05d194458bf4" (UID: "333553b5-c7bf-469d-8268-05d194458bf4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:43:44.023824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.023778    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/333553b5-c7bf-469d-8268-05d194458bf4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "333553b5-c7bf-469d-8268-05d194458bf4" (UID: "333553b5-c7bf-469d-8268-05d194458bf4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:43:44.023914 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.023898    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a566cc0e-f178-4284-885d-0c5c7f06aba8-kube-api-access-7kvt9" (OuterVolumeSpecName: "kube-api-access-7kvt9") pod "a566cc0e-f178-4284-885d-0c5c7f06aba8" (UID: "a566cc0e-f178-4284-885d-0c5c7f06aba8"). InnerVolumeSpecName "kube-api-access-7kvt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:43:44.122592 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.122511    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333553b5-c7bf-469d-8268-05d194458bf4-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.122592 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.122537    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a566cc0e-f178-4284-885d-0c5c7f06aba8-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.122592 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.122546    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlp5x\" (UniqueName: \"kubernetes.io/projected/333553b5-c7bf-469d-8268-05d194458bf4-kube-api-access-qlp5x\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.122592 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.122557    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a566cc0e-f178-4284-885d-0c5c7f06aba8-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.122592 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.122565    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kvt9\" (UniqueName: \"kubernetes.io/projected/a566cc0e-f178-4284-885d-0c5c7f06aba8-kube-api-access-7kvt9\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.122592 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.122573    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/333553b5-c7bf-469d-8268-05d194458bf4-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.321527 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.321107    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"]
Sep 16 18:43:44.322420 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.322038    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q" podUID="f48df287-c9e3-4eca-8db3-b50ee3210d16" containerName="maas-api" containerID="cri-o://d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469" gracePeriod=30
Sep 16 18:43:44.568387 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.568350    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:43:44.628777 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.628745    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5255\" (UniqueName: \"kubernetes.io/projected/f48df287-c9e3-4eca-8db3-b50ee3210d16-kube-api-access-c5255\") pod \"f48df287-c9e3-4eca-8db3-b50ee3210d16\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") "
Sep 16 18:43:44.629256 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.628860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-metrics-certs\") pod \"f48df287-c9e3-4eca-8db3-b50ee3210d16\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") "
Sep 16 18:43:44.629256 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.628894    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48df287-c9e3-4eca-8db3-b50ee3210d16-openshift-service-ca\") pod \"f48df287-c9e3-4eca-8db3-b50ee3210d16\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") "
Sep 16 18:43:44.629256 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.628929    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-maas-api-tls\") pod \"f48df287-c9e3-4eca-8db3-b50ee3210d16\" (UID: \"f48df287-c9e3-4eca-8db3-b50ee3210d16\") "
Sep 16 18:43:44.629468 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.629280    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f48df287-c9e3-4eca-8db3-b50ee3210d16-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f48df287-c9e3-4eca-8db3-b50ee3210d16" (UID: "f48df287-c9e3-4eca-8db3-b50ee3210d16"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:43:44.631357 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.631330    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f48df287-c9e3-4eca-8db3-b50ee3210d16" (UID: "f48df287-c9e3-4eca-8db3-b50ee3210d16"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:43:44.631494 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.631465    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f48df287-c9e3-4eca-8db3-b50ee3210d16" (UID: "f48df287-c9e3-4eca-8db3-b50ee3210d16"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:43:44.631555 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.631506    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f48df287-c9e3-4eca-8db3-b50ee3210d16-kube-api-access-c5255" (OuterVolumeSpecName: "kube-api-access-c5255") pod "f48df287-c9e3-4eca-8db3-b50ee3210d16" (UID: "f48df287-c9e3-4eca-8db3-b50ee3210d16"). InnerVolumeSpecName "kube-api-access-c5255". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:43:44.652517 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.652487    2580 generic.go:356] "Generic (PLEG): container finished" podID="f48df287-c9e3-4eca-8db3-b50ee3210d16" containerID="d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469" exitCode=0
Sep 16 18:43:44.652638 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.652538    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"
Sep 16 18:43:44.652638 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.652570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q" event={"ID":"f48df287-c9e3-4eca-8db3-b50ee3210d16","Type":"ContainerDied","Data":"d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469"}
Sep 16 18:43:44.652638 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.652632    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q" event={"ID":"f48df287-c9e3-4eca-8db3-b50ee3210d16","Type":"ContainerDied","Data":"11f91a4983bc6db43c0799ab2ae0671c878b3cffb92d7646a9248122f893d186"}
Sep 16 18:43:44.652910 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.652662    2580 scope.go:117] "RemoveContainer" containerID="d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469"
Sep 16 18:43:44.654500 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.654475    2580 generic.go:356] "Generic (PLEG): container finished" podID="a566cc0e-f178-4284-885d-0c5c7f06aba8" containerID="a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411" exitCode=0
Sep 16 18:43:44.654585 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.654523    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"
Sep 16 18:43:44.654585 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.654550    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27" event={"ID":"a566cc0e-f178-4284-885d-0c5c7f06aba8","Type":"ContainerDied","Data":"a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411"}
Sep 16 18:43:44.654700 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.654586    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27" event={"ID":"a566cc0e-f178-4284-885d-0c5c7f06aba8","Type":"ContainerDied","Data":"4eb163fe5209c4d54d831ac64ad1b060ddf08adf524e399a3539c722d16c4c3b"}
Sep 16 18:43:44.656440 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.656399    2580 generic.go:356] "Generic (PLEG): container finished" podID="333553b5-c7bf-469d-8268-05d194458bf4" containerID="458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089" exitCode=0
Sep 16 18:43:44.656550 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.656486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq" event={"ID":"333553b5-c7bf-469d-8268-05d194458bf4","Type":"ContainerDied","Data":"458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089"}
Sep 16 18:43:44.656550 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.656514    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq" event={"ID":"333553b5-c7bf-469d-8268-05d194458bf4","Type":"ContainerDied","Data":"17de53c3da05e0f110d3b6daae01d5242a4aa879a910fa777439c9966417c19a"}
Sep 16 18:43:44.656775 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.656731    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"
Sep 16 18:43:44.664584 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.664569    2580 scope.go:117] "RemoveContainer" containerID="d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469"
Sep 16 18:43:44.664890 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:43:44.664851    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469\": container with ID starting with d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469 not found: ID does not exist" containerID="d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469"
Sep 16 18:43:44.664961 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.664895    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469"} err="failed to get container status \"d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469\": rpc error: code = NotFound desc = could not find container \"d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469\": container with ID starting with d95db3b0a5582acae83196d924d3f1d9a845e025a9713b961f8df80645837469 not found: ID does not exist"
Sep 16 18:43:44.664961 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.664911    2580 scope.go:117] "RemoveContainer" containerID="a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411"
Sep 16 18:43:44.674904 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.674887    2580 scope.go:117] "RemoveContainer" containerID="a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411"
Sep 16 18:43:44.675164 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:43:44.675147    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411\": container with ID starting with a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411 not found: ID does not exist" containerID="a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411"
Sep 16 18:43:44.675227 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.675170    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411"} err="failed to get container status \"a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411\": rpc error: code = NotFound desc = could not find container \"a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411\": container with ID starting with a08d7d9377a188b02354b1e68e5fb37db3734aec1058e84ca683ef5723295411 not found: ID does not exist"
Sep 16 18:43:44.675227 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.675184    2580 scope.go:117] "RemoveContainer" containerID="458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089"
Sep 16 18:43:44.683139 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.683118    2580 scope.go:117] "RemoveContainer" containerID="458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089"
Sep 16 18:43:44.683440 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:43:44.683418    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089\": container with ID starting with 458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089 not found: ID does not exist" containerID="458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089"
Sep 16 18:43:44.683522 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.683443    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089"} err="failed to get container status \"458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089\": rpc error: code = NotFound desc = could not find container \"458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089\": container with ID starting with 458377d6e14a86344a1d6dcdbd6c078e8199a131c5b34fdcd112c93d38747089 not found: ID does not exist"
Sep 16 18:43:44.702515 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.702458    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"]
Sep 16 18:43:44.709392 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.709356    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a24d09-ddb5cc585-n9g4q"]
Sep 16 18:43:44.723480 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.723454    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"]
Sep 16 18:43:44.730346 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.730318    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5255\" (UniqueName: \"kubernetes.io/projected/f48df287-c9e3-4eca-8db3-b50ee3210d16-kube-api-access-c5255\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.730486 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.730350    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.730486 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.730388    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48df287-c9e3-4eca-8db3-b50ee3210d16-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.730486 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.730402    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f48df287-c9e3-4eca-8db3-b50ee3210d16-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:44.732234 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.732215    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a24d09/embedding-w0-a24d09-kserve-69dfb5989b-9bp27"]
Sep 16 18:43:44.743983 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.743960    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"]
Sep 16 18:43:44.749535 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:44.749510    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a24d09/premium-w0-a24d09-kserve-f8dc7b7dd-gxrlq"]
Sep 16 18:43:45.868522 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:45.868489    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="333553b5-c7bf-469d-8268-05d194458bf4" path="/var/lib/kubelet/pods/333553b5-c7bf-469d-8268-05d194458bf4/volumes"
Sep 16 18:43:45.868907 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:45.868893    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a566cc0e-f178-4284-885d-0c5c7f06aba8" path="/var/lib/kubelet/pods/a566cc0e-f178-4284-885d-0c5c7f06aba8/volumes"
Sep 16 18:43:45.869232 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:45.869218    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f48df287-c9e3-4eca-8db3-b50ee3210d16" path="/var/lib/kubelet/pods/f48df287-c9e3-4eca-8db3-b50ee3210d16/volumes"
Sep 16 18:43:50.774292 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:50.774260    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"]
Sep 16 18:43:50.774761 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:50.774598    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx" podUID="47e77246-ede2-4358-8652-3c9b80e33d9f" containerName="maas-api" containerID="cri-o://ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103" gracePeriod=30
Sep 16 18:43:51.016750 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.016724    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:43:51.100679 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.100650    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-metrics-certs\") pod \"47e77246-ede2-4358-8652-3c9b80e33d9f\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") "
Sep 16 18:43:51.100851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.100747    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-maas-api-tls\") pod \"47e77246-ede2-4358-8652-3c9b80e33d9f\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") "
Sep 16 18:43:51.100851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.100779    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47e77246-ede2-4358-8652-3c9b80e33d9f-openshift-service-ca\") pod \"47e77246-ede2-4358-8652-3c9b80e33d9f\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") "
Sep 16 18:43:51.100987 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.100846    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpdxs\" (UniqueName: \"kubernetes.io/projected/47e77246-ede2-4358-8652-3c9b80e33d9f-kube-api-access-gpdxs\") pod \"47e77246-ede2-4358-8652-3c9b80e33d9f\" (UID: \"47e77246-ede2-4358-8652-3c9b80e33d9f\") "
Sep 16 18:43:51.101392 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.101142    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47e77246-ede2-4358-8652-3c9b80e33d9f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "47e77246-ede2-4358-8652-3c9b80e33d9f" (UID: "47e77246-ede2-4358-8652-3c9b80e33d9f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:43:51.101392 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.101385    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47e77246-ede2-4358-8652-3c9b80e33d9f-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:51.103167 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.103144    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "47e77246-ede2-4358-8652-3c9b80e33d9f" (UID: "47e77246-ede2-4358-8652-3c9b80e33d9f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:43:51.103286 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.103205    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "47e77246-ede2-4358-8652-3c9b80e33d9f" (UID: "47e77246-ede2-4358-8652-3c9b80e33d9f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:43:51.103606 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.103577    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47e77246-ede2-4358-8652-3c9b80e33d9f-kube-api-access-gpdxs" (OuterVolumeSpecName: "kube-api-access-gpdxs") pod "47e77246-ede2-4358-8652-3c9b80e33d9f" (UID: "47e77246-ede2-4358-8652-3c9b80e33d9f"). InnerVolumeSpecName "kube-api-access-gpdxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:43:51.205390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.202239    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:51.205390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.202276    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47e77246-ede2-4358-8652-3c9b80e33d9f-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:51.205390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.202291    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpdxs\" (UniqueName: \"kubernetes.io/projected/47e77246-ede2-4358-8652-3c9b80e33d9f-kube-api-access-gpdxs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:43:51.713124 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.713089    2580 generic.go:356] "Generic (PLEG): container finished" podID="47e77246-ede2-4358-8652-3c9b80e33d9f" containerID="ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103" exitCode=0
Sep 16 18:43:51.713329 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.713163    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"
Sep 16 18:43:51.713329 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.713199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx" event={"ID":"47e77246-ede2-4358-8652-3c9b80e33d9f","Type":"ContainerDied","Data":"ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103"}
Sep 16 18:43:51.713329 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.713254    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx" event={"ID":"47e77246-ede2-4358-8652-3c9b80e33d9f","Type":"ContainerDied","Data":"7a93272b8f3fb9427b07df556c578e16e18d4624034dedd154306dc622ea7bc6"}
Sep 16 18:43:51.713329 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.713282    2580 scope.go:117] "RemoveContainer" containerID="ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103"
Sep 16 18:43:51.722873 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.722844    2580 scope.go:117] "RemoveContainer" containerID="ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103"
Sep 16 18:43:51.723074 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:43:51.723055    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103\": container with ID starting with ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103 not found: ID does not exist" containerID="ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103"
Sep 16 18:43:51.723117 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.723081    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103"} err="failed to get container status \"ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103\": rpc error: code = NotFound desc = could not find container \"ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103\": container with ID starting with ed9f01ffd8bece72172787f2b85840b005fa479eacaf74a3adf4b7baae5c3103 not found: ID does not exist"
Sep 16 18:43:51.734781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.734759    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"]
Sep 16 18:43:51.739693 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.739671    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6a7741-5fcbc77c7c-gjzbx"]
Sep 16 18:43:51.867606 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:43:51.867575    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47e77246-ede2-4358-8652-3c9b80e33d9f" path="/var/lib/kubelet/pods/47e77246-ede2-4358-8652-3c9b80e33d9f/volumes"
Sep 16 18:44:21.349271 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:21.349236    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"]
Sep 16 18:44:21.349811 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:21.349533    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerName="istio-proxy" containerID="cri-o://c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a" gracePeriod=30
Sep 16 18:44:26.602899 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.602874    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:44:26.757603 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.757527    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvvfb\" (UniqueName: \"kubernetes.io/projected/1a282abf-a00b-474e-ba13-f9aa208dc928-kube-api-access-wvvfb\") pod \"1a282abf-a00b-474e-ba13-f9aa208dc928\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") "
Sep 16 18:44:26.757603 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.757579    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-workload-socket\") pod \"1a282abf-a00b-474e-ba13-f9aa208dc928\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") "
Sep 16 18:44:26.757789 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.757610    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-data\") pod \"1a282abf-a00b-474e-ba13-f9aa208dc928\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") "
Sep 16 18:44:26.757826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.757790    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a282abf-a00b-474e-ba13-f9aa208dc928-istiod-ca-cert\") pod \"1a282abf-a00b-474e-ba13-f9aa208dc928\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") "
Sep 16 18:44:26.757826 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.757822    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-podinfo\") pod \"1a282abf-a00b-474e-ba13-f9aa208dc928\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") "
Sep 16 18:44:26.757908 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.757864    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-token\") pod \"1a282abf-a00b-474e-ba13-f9aa208dc928\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") "
Sep 16 18:44:26.757908 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.757878    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a282abf-a00b-474e-ba13-f9aa208dc928" (UID: "1a282abf-a00b-474e-ba13-f9aa208dc928"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:44:26.757908 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.757894    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-credential-socket\") pod \"1a282abf-a00b-474e-ba13-f9aa208dc928\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") "
Sep 16 18:44:26.757908 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.757890    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a282abf-a00b-474e-ba13-f9aa208dc928" (UID: "1a282abf-a00b-474e-ba13-f9aa208dc928"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:44:26.758108 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.757991    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-envoy\") pod \"1a282abf-a00b-474e-ba13-f9aa208dc928\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") "
Sep 16 18:44:26.758108 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.758089    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-workload-certs\") pod \"1a282abf-a00b-474e-ba13-f9aa208dc928\" (UID: \"1a282abf-a00b-474e-ba13-f9aa208dc928\") "
Sep 16 18:44:26.758382 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.758192    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a282abf-a00b-474e-ba13-f9aa208dc928" (UID: "1a282abf-a00b-474e-ba13-f9aa208dc928"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:44:26.758382 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.758207    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a282abf-a00b-474e-ba13-f9aa208dc928-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a282abf-a00b-474e-ba13-f9aa208dc928" (UID: "1a282abf-a00b-474e-ba13-f9aa208dc928"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:44:26.758501 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.758405    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a282abf-a00b-474e-ba13-f9aa208dc928" (UID: "1a282abf-a00b-474e-ba13-f9aa208dc928"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:44:26.758564 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.758530    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:26.758564 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.758549    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:26.758683 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.758574    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a282abf-a00b-474e-ba13-f9aa208dc928-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:26.758683 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.758589    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:26.758683 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.758602    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:26.759922 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.759897    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a282abf-a00b-474e-ba13-f9aa208dc928-kube-api-access-wvvfb" (OuterVolumeSpecName: "kube-api-access-wvvfb") pod "1a282abf-a00b-474e-ba13-f9aa208dc928" (UID: "1a282abf-a00b-474e-ba13-f9aa208dc928"). InnerVolumeSpecName "kube-api-access-wvvfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:44:26.760061 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.760038    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a282abf-a00b-474e-ba13-f9aa208dc928" (UID: "1a282abf-a00b-474e-ba13-f9aa208dc928"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:44:26.760102 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.760071    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a282abf-a00b-474e-ba13-f9aa208dc928" (UID: "1a282abf-a00b-474e-ba13-f9aa208dc928"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:44:26.760138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.760113    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a282abf-a00b-474e-ba13-f9aa208dc928" (UID: "1a282abf-a00b-474e-ba13-f9aa208dc928"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:44:26.859711 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.859683    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:26.859711 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.859707    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:26.859711 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.859717    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvvfb\" (UniqueName: \"kubernetes.io/projected/1a282abf-a00b-474e-ba13-f9aa208dc928-kube-api-access-wvvfb\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:26.859890 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.859726    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a282abf-a00b-474e-ba13-f9aa208dc928-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:26.920229 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.920198    2580 generic.go:356] "Generic (PLEG): container finished" podID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerID="c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a" exitCode=0
Sep 16 18:44:26.920406 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.920250    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"
Sep 16 18:44:26.920406 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.920277    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" event={"ID":"1a282abf-a00b-474e-ba13-f9aa208dc928","Type":"ContainerDied","Data":"c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a"}
Sep 16 18:44:26.920406 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.920336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb" event={"ID":"1a282abf-a00b-474e-ba13-f9aa208dc928","Type":"ContainerDied","Data":"6ab820c3ac9d291c5ee819b01b8047e8f1f5b1382aaa02a739375c48b822f7eb"}
Sep 16 18:44:26.921173 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.920389    2580 scope.go:117] "RemoveContainer" containerID="c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a"
Sep 16 18:44:26.931763 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.931745    2580 scope.go:117] "RemoveContainer" containerID="f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc"
Sep 16 18:44:26.940008 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.939974    2580 scope.go:117] "RemoveContainer" containerID="c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a"
Sep 16 18:44:26.940303 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:44:26.940278    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a\": container with ID starting with c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a not found: ID does not exist" containerID="c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a"
Sep 16 18:44:26.940439 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.940315    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a"} err="failed to get container status \"c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a\": rpc error: code = NotFound desc = could not find container \"c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a\": container with ID starting with c0043ce94068ae01a8d5260f0bcb6d7bdb637c1163d343cbfc3dd65dfc3a663a not found: ID does not exist"
Sep 16 18:44:26.940439 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.940339    2580 scope.go:117] "RemoveContainer" containerID="f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc"
Sep 16 18:44:26.940674 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:44:26.940652    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc\": container with ID starting with f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc not found: ID does not exist" containerID="f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc"
Sep 16 18:44:26.940761 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.940682    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc"} err="failed to get container status \"f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc\": rpc error: code = NotFound desc = could not find container \"f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc\": container with ID starting with f93f70934a0015fe12a8425f742692917e7465f25f3d10c40d37406e9cbcc3dc not found: ID does not exist"
Sep 16 18:44:26.943347 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.943327    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"]
Sep 16 18:44:26.947400 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:26.947381    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-61fa84-openshift-default-7c9d48895d-pfbsb"]
Sep 16 18:44:27.867220 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:27.867188    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" path="/var/lib/kubelet/pods/1a282abf-a00b-474e-ba13-f9aa208dc928/volumes"
Sep 16 18:44:32.395203 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.395170    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"]
Sep 16 18:44:32.395674 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.395386    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk" podUID="6248ccee-e7ca-4c44-baf7-2f0f507d7936" containerName="maas-api" containerID="cri-o://8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a" gracePeriod=30
Sep 16 18:44:32.646302 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.646234    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:44:32.824769 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.824721    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6248ccee-e7ca-4c44-baf7-2f0f507d7936-maas-api-tls\") pod \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") "
Sep 16 18:44:32.825435 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.825415    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6248ccee-e7ca-4c44-baf7-2f0f507d7936-metrics-certs\") pod \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") "
Sep 16 18:44:32.826023 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.826005    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6248ccee-e7ca-4c44-baf7-2f0f507d7936-openshift-service-ca\") pod \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") "
Sep 16 18:44:32.826604 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.826476    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6248ccee-e7ca-4c44-baf7-2f0f507d7936-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6248ccee-e7ca-4c44-baf7-2f0f507d7936" (UID: "6248ccee-e7ca-4c44-baf7-2f0f507d7936"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:44:32.827008 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.826556    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvfwt\" (UniqueName: \"kubernetes.io/projected/6248ccee-e7ca-4c44-baf7-2f0f507d7936-kube-api-access-cvfwt\") pod \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\" (UID: \"6248ccee-e7ca-4c44-baf7-2f0f507d7936\") "
Sep 16 18:44:32.827550 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.827531    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6248ccee-e7ca-4c44-baf7-2f0f507d7936-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:32.829549 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.829522    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6248ccee-e7ca-4c44-baf7-2f0f507d7936-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6248ccee-e7ca-4c44-baf7-2f0f507d7936" (UID: "6248ccee-e7ca-4c44-baf7-2f0f507d7936"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:44:32.829970 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.829937    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6248ccee-e7ca-4c44-baf7-2f0f507d7936-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6248ccee-e7ca-4c44-baf7-2f0f507d7936" (UID: "6248ccee-e7ca-4c44-baf7-2f0f507d7936"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:44:32.830724 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.830699    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6248ccee-e7ca-4c44-baf7-2f0f507d7936-kube-api-access-cvfwt" (OuterVolumeSpecName: "kube-api-access-cvfwt") pod "6248ccee-e7ca-4c44-baf7-2f0f507d7936" (UID: "6248ccee-e7ca-4c44-baf7-2f0f507d7936"). InnerVolumeSpecName "kube-api-access-cvfwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:44:32.928721 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.928637    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6248ccee-e7ca-4c44-baf7-2f0f507d7936-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:32.928721 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.928666    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6248ccee-e7ca-4c44-baf7-2f0f507d7936-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:32.928721 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.928675    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvfwt\" (UniqueName: \"kubernetes.io/projected/6248ccee-e7ca-4c44-baf7-2f0f507d7936-kube-api-access-cvfwt\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:32.956806 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.956774    2580 generic.go:356] "Generic (PLEG): container finished" podID="6248ccee-e7ca-4c44-baf7-2f0f507d7936" containerID="8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a" exitCode=0
Sep 16 18:44:32.956936 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.956809    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk" event={"ID":"6248ccee-e7ca-4c44-baf7-2f0f507d7936","Type":"ContainerDied","Data":"8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a"}
Sep 16 18:44:32.956936 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.956863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk" event={"ID":"6248ccee-e7ca-4c44-baf7-2f0f507d7936","Type":"ContainerDied","Data":"6ed3c2c1ffa154cfb6a00bd96d2d072ef269464d2daa213957c81eb00b660394"}
Sep 16 18:44:32.956936 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.956886    2580 scope.go:117] "RemoveContainer" containerID="8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a"
Sep 16 18:44:32.956936 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.956821    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"
Sep 16 18:44:32.966784 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.966766    2580 scope.go:117] "RemoveContainer" containerID="8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a"
Sep 16 18:44:32.967051 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:44:32.967034    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a\": container with ID starting with 8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a not found: ID does not exist" containerID="8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a"
Sep 16 18:44:32.967115 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:32.967064    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a"} err="failed to get container status \"8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a\": rpc error: code = NotFound desc = could not find container \"8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a\": container with ID starting with 8da8537467ab62de12eabd1bad810bd09f9489d7b4996286b53c7f706b2e620a not found: ID does not exist"
Sep 16 18:44:33.001642 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:33.001618    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"]
Sep 16 18:44:33.014097 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:33.014074    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad6826-98454b9df-m9gxk"]
Sep 16 18:44:33.867734 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:33.867704    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6248ccee-e7ca-4c44-baf7-2f0f507d7936" path="/var/lib/kubelet/pods/6248ccee-e7ca-4c44-baf7-2f0f507d7936/volumes"
Sep 16 18:44:54.267620 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.267438    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"]
Sep 16 18:44:54.268488 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.268429    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn" podUID="6be09580-b2fd-4690-bda3-111de556a3a6" containerName="maas-api" containerID="cri-o://314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be" gracePeriod=30
Sep 16 18:44:54.310587 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:44:54.310556    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be09580_b2fd_4690_bda3_111de556a3a6.slice/crio-conmon-314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be09580_b2fd_4690_bda3_111de556a3a6.slice/crio-314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be.scope\": RecentStats: unable to find data in memory cache]"
Sep 16 18:44:54.521344 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.521287    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:44:54.642592 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.642560    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-metrics-certs\") pod \"6be09580-b2fd-4690-bda3-111de556a3a6\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") "
Sep 16 18:44:54.642781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.642606    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkr8f\" (UniqueName: \"kubernetes.io/projected/6be09580-b2fd-4690-bda3-111de556a3a6-kube-api-access-jkr8f\") pod \"6be09580-b2fd-4690-bda3-111de556a3a6\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") "
Sep 16 18:44:54.642781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.642653    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6be09580-b2fd-4690-bda3-111de556a3a6-openshift-service-ca\") pod \"6be09580-b2fd-4690-bda3-111de556a3a6\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") "
Sep 16 18:44:54.642781 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.642743    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-maas-api-tls\") pod \"6be09580-b2fd-4690-bda3-111de556a3a6\" (UID: \"6be09580-b2fd-4690-bda3-111de556a3a6\") "
Sep 16 18:44:54.643082 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.643051    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6be09580-b2fd-4690-bda3-111de556a3a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6be09580-b2fd-4690-bda3-111de556a3a6" (UID: "6be09580-b2fd-4690-bda3-111de556a3a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:44:54.644650 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.644623    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6be09580-b2fd-4690-bda3-111de556a3a6" (UID: "6be09580-b2fd-4690-bda3-111de556a3a6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:44:54.644778 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.644691    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6be09580-b2fd-4690-bda3-111de556a3a6" (UID: "6be09580-b2fd-4690-bda3-111de556a3a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:44:54.644778 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.644757    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6be09580-b2fd-4690-bda3-111de556a3a6-kube-api-access-jkr8f" (OuterVolumeSpecName: "kube-api-access-jkr8f") pod "6be09580-b2fd-4690-bda3-111de556a3a6" (UID: "6be09580-b2fd-4690-bda3-111de556a3a6"). InnerVolumeSpecName "kube-api-access-jkr8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:44:54.743866 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.743827    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:54.743866 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.743863    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6be09580-b2fd-4690-bda3-111de556a3a6-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:54.744081 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.743876    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkr8f\" (UniqueName: \"kubernetes.io/projected/6be09580-b2fd-4690-bda3-111de556a3a6-kube-api-access-jkr8f\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:54.744081 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:54.743889    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6be09580-b2fd-4690-bda3-111de556a3a6-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:44:55.090011 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:55.089981    2580 generic.go:356] "Generic (PLEG): container finished" podID="6be09580-b2fd-4690-bda3-111de556a3a6" containerID="314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be" exitCode=0
Sep 16 18:44:55.090210 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:55.090031    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"
Sep 16 18:44:55.090210 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:55.090061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn" event={"ID":"6be09580-b2fd-4690-bda3-111de556a3a6","Type":"ContainerDied","Data":"314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be"}
Sep 16 18:44:55.090210 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:55.090115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn" event={"ID":"6be09580-b2fd-4690-bda3-111de556a3a6","Type":"ContainerDied","Data":"4f9c9ffcc0c3ae5cde931a2aeb8fbb7f7ac1fb1115cf5cefeb6c94440e1ec574"}
Sep 16 18:44:55.090210 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:55.090139    2580 scope.go:117] "RemoveContainer" containerID="314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be"
Sep 16 18:44:55.099649 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:55.099633    2580 scope.go:117] "RemoveContainer" containerID="314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be"
Sep 16 18:44:55.099906 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:44:55.099886    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be\": container with ID starting with 314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be not found: ID does not exist" containerID="314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be"
Sep 16 18:44:55.099956 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:55.099915    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be"} err="failed to get container status \"314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be\": rpc error: code = NotFound desc = could not find container \"314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be\": container with ID starting with 314ce2499cf9677943910ca739f2548675ad86f18d2d0133a28c71680c2e93be not found: ID does not exist"
Sep 16 18:44:55.113165 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:55.113144    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"]
Sep 16 18:44:55.118107 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:55.118085    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cf62d1-5d84cdf45c-2dgfn"]
Sep 16 18:44:55.867034 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:44:55.867002    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6be09580-b2fd-4690-bda3-111de556a3a6" path="/var/lib/kubelet/pods/6be09580-b2fd-4690-bda3-111de556a3a6/volumes"
Sep 16 18:45:00.166171 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166137    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-972df0-29826405-sg4m7"]
Sep 16 18:45:00.166571 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166550    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerName="istio-proxy"
Sep 16 18:45:00.166571 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166563    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerName="istio-proxy"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166574    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e77246-ede2-4358-8652-3c9b80e33d9f" containerName="maas-api"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166580    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e77246-ede2-4358-8652-3c9b80e33d9f" containerName="maas-api"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166590    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f48df287-c9e3-4eca-8db3-b50ee3210d16" containerName="maas-api"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166596    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f48df287-c9e3-4eca-8db3-b50ee3210d16" containerName="maas-api"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166603    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a566cc0e-f178-4284-885d-0c5c7f06aba8" containerName="main"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166609    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a566cc0e-f178-4284-885d-0c5c7f06aba8" containerName="main"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166615    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="333553b5-c7bf-469d-8268-05d194458bf4" containerName="main"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166619    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="333553b5-c7bf-469d-8268-05d194458bf4" containerName="main"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166625    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6248ccee-e7ca-4c44-baf7-2f0f507d7936" containerName="maas-api"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166630    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6248ccee-e7ca-4c44-baf7-2f0f507d7936" containerName="maas-api"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166635    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerName="istio-proxy"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166639    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerName="istio-proxy"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166646    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6be09580-b2fd-4690-bda3-111de556a3a6" containerName="maas-api"
Sep 16 18:45:00.166648 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166651    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6be09580-b2fd-4690-bda3-111de556a3a6" containerName="maas-api"
Sep 16 18:45:00.167059 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166706    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f48df287-c9e3-4eca-8db3-b50ee3210d16" containerName="maas-api"
Sep 16 18:45:00.167059 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166715    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6be09580-b2fd-4690-bda3-111de556a3a6" containerName="maas-api"
Sep 16 18:45:00.167059 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166720    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerName="istio-proxy"
Sep 16 18:45:00.167059 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166726    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="47e77246-ede2-4358-8652-3c9b80e33d9f" containerName="maas-api"
Sep 16 18:45:00.167059 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166731    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6248ccee-e7ca-4c44-baf7-2f0f507d7936" containerName="maas-api"
Sep 16 18:45:00.167059 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166736    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a566cc0e-f178-4284-885d-0c5c7f06aba8" containerName="main"
Sep 16 18:45:00.167059 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166741    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a282abf-a00b-474e-ba13-f9aa208dc928" containerName="istio-proxy"
Sep 16 18:45:00.167059 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.166746    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="333553b5-c7bf-469d-8268-05d194458bf4" containerName="main"
Sep 16 18:45:00.171266 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.171239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-972df0-29826405-sg4m7"
Sep 16 18:45:00.177972 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.177951    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lfw6p\""
Sep 16 18:45:00.182547 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.182527    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-972df0-29826405-sg4m7"
Sep 16 18:45:00.199225 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.198899    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-972df0-29826405-sg4m7"]
Sep 16 18:45:00.482151 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:00.482122    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-972df0-29826405-sg4m7"]
Sep 16 18:45:00.482272 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:45:00.482172    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod948ee50e_ba90_41a0_a5a5_4ce04e734c4e.slice/crio-03daed49d1966120f0b3f0e602259677e120024a9acfebb503a93922a113141a WatchSource:0}: Error finding container 03daed49d1966120f0b3f0e602259677e120024a9acfebb503a93922a113141a: Status 404 returned error can't find the container with id 03daed49d1966120f0b3f0e602259677e120024a9acfebb503a93922a113141a
Sep 16 18:45:01.124813 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:01.124778    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-972df0-29826405-sg4m7" event={"ID":"948ee50e-ba90-41a0-a5a5-4ce04e734c4e","Type":"ContainerStarted","Data":"03daed49d1966120f0b3f0e602259677e120024a9acfebb503a93922a113141a"}
Sep 16 18:45:02.094061 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:02.094027    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"]
Sep 16 18:45:02.094546 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:02.094268    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy" containerID="cri-o://9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b" gracePeriod=30
Sep 16 18:45:04.144892 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:04.144854    2580 generic.go:356] "Generic (PLEG): container finished" podID="948ee50e-ba90-41a0-a5a5-4ce04e734c4e" containerID="48d1bc9c7f36949bec5e60b648fcad42eabca7fa23467c188fd8576a82f6c48f" exitCode=0
Sep 16 18:45:04.144892 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:04.144895    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-972df0-29826405-sg4m7" event={"ID":"948ee50e-ba90-41a0-a5a5-4ce04e734c4e","Type":"ContainerDied","Data":"48d1bc9c7f36949bec5e60b648fcad42eabca7fa23467c188fd8576a82f6c48f"}
Sep 16 18:45:04.920496 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:04.920462    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 18:45:04.920664 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:04.920519    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 18:45:05.288772 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:05.288748    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-972df0-29826405-sg4m7"
Sep 16 18:45:06.161439 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:06.161328    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-972df0-29826405-sg4m7"
Sep 16 18:45:06.162148 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:06.161438    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-972df0-29826405-sg4m7" event={"ID":"948ee50e-ba90-41a0-a5a5-4ce04e734c4e","Type":"ContainerDied","Data":"03daed49d1966120f0b3f0e602259677e120024a9acfebb503a93922a113141a"}
Sep 16 18:45:06.162479 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:06.162461    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03daed49d1966120f0b3f0e602259677e120024a9acfebb503a93922a113141a"
Sep 16 18:45:07.346073 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.346049    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:45:07.479647 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.479566    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-credential-socket\") pod \"eb00e099-486d-4954-b41a-72b24d8802af\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") "
Sep 16 18:45:07.479647 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.479602    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb00e099-486d-4954-b41a-72b24d8802af-istiod-ca-cert\") pod \"eb00e099-486d-4954-b41a-72b24d8802af\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") "
Sep 16 18:45:07.479855 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.479651    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-workload-certs\") pod \"eb00e099-486d-4954-b41a-72b24d8802af\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") "
Sep 16 18:45:07.479855 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.479693    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-workload-socket\") pod \"eb00e099-486d-4954-b41a-72b24d8802af\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") "
Sep 16 18:45:07.479855 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.479713    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-istio-data\") pod \"eb00e099-486d-4954-b41a-72b24d8802af\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") "
Sep 16 18:45:07.479855 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.479736    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb00e099-486d-4954-b41a-72b24d8802af-istio-token\") pod \"eb00e099-486d-4954-b41a-72b24d8802af\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") "
Sep 16 18:45:07.479855 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.479799    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb00e099-486d-4954-b41a-72b24d8802af-istio-podinfo\") pod \"eb00e099-486d-4954-b41a-72b24d8802af\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") "
Sep 16 18:45:07.479855 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.479845    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-istio-envoy\") pod \"eb00e099-486d-4954-b41a-72b24d8802af\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") "
Sep 16 18:45:07.480154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.479864    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb00e099-486d-4954-b41a-72b24d8802af" (UID: "eb00e099-486d-4954-b41a-72b24d8802af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:45:07.480154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.479890    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5w5j\" (UniqueName: \"kubernetes.io/projected/eb00e099-486d-4954-b41a-72b24d8802af-kube-api-access-v5w5j\") pod \"eb00e099-486d-4954-b41a-72b24d8802af\" (UID: \"eb00e099-486d-4954-b41a-72b24d8802af\") "
Sep 16 18:45:07.480154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.479971    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb00e099-486d-4954-b41a-72b24d8802af" (UID: "eb00e099-486d-4954-b41a-72b24d8802af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:45:07.480154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.479987    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb00e099-486d-4954-b41a-72b24d8802af" (UID: "eb00e099-486d-4954-b41a-72b24d8802af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:45:07.480154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.480063    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb00e099-486d-4954-b41a-72b24d8802af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb00e099-486d-4954-b41a-72b24d8802af" (UID: "eb00e099-486d-4954-b41a-72b24d8802af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:45:07.480433 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.480154    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb00e099-486d-4954-b41a-72b24d8802af" (UID: "eb00e099-486d-4954-b41a-72b24d8802af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:45:07.480433 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.480281    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:07.480433 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.480300    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:07.480433 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.480312    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:07.480433 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.480322    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:07.480433 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.480334    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb00e099-486d-4954-b41a-72b24d8802af-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:07.482026 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.481994    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb00e099-486d-4954-b41a-72b24d8802af" (UID: "eb00e099-486d-4954-b41a-72b24d8802af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:45:07.482026 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.482020    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb00e099-486d-4954-b41a-72b24d8802af-kube-api-access-v5w5j" (OuterVolumeSpecName: "kube-api-access-v5w5j") pod "eb00e099-486d-4954-b41a-72b24d8802af" (UID: "eb00e099-486d-4954-b41a-72b24d8802af"). InnerVolumeSpecName "kube-api-access-v5w5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:45:07.482265 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.482247    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb00e099-486d-4954-b41a-72b24d8802af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb00e099-486d-4954-b41a-72b24d8802af" (UID: "eb00e099-486d-4954-b41a-72b24d8802af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:45:07.482317 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.482247    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb00e099-486d-4954-b41a-72b24d8802af-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb00e099-486d-4954-b41a-72b24d8802af" (UID: "eb00e099-486d-4954-b41a-72b24d8802af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:45:07.581837 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.581803    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb00e099-486d-4954-b41a-72b24d8802af-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:07.581837 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.581830    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb00e099-486d-4954-b41a-72b24d8802af-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:07.581837 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.581838    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb00e099-486d-4954-b41a-72b24d8802af-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:07.582054 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:07.581848    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5w5j\" (UniqueName: \"kubernetes.io/projected/eb00e099-486d-4954-b41a-72b24d8802af-kube-api-access-v5w5j\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:08.173712 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:08.173628    2580 generic.go:356] "Generic (PLEG): container finished" podID="eb00e099-486d-4954-b41a-72b24d8802af" containerID="9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b" exitCode=0
Sep 16 18:45:08.173712 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:08.173698    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"
Sep 16 18:45:08.173888 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:08.173709    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" event={"ID":"eb00e099-486d-4954-b41a-72b24d8802af","Type":"ContainerDied","Data":"9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b"}
Sep 16 18:45:08.173888 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:08.173789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2" event={"ID":"eb00e099-486d-4954-b41a-72b24d8802af","Type":"ContainerDied","Data":"29cfd14516d2ec9f5be16d6d0a36123f3e9d75bc382632bcd138d0c437f9bbdf"}
Sep 16 18:45:08.173888 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:08.173811    2580 scope.go:117] "RemoveContainer" containerID="9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b"
Sep 16 18:45:08.182878 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:08.182860    2580 scope.go:117] "RemoveContainer" containerID="73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67"
Sep 16 18:45:08.190943 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:08.190925    2580 scope.go:117] "RemoveContainer" containerID="9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b"
Sep 16 18:45:08.191211 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:45:08.191189    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b\": container with ID starting with 9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b not found: ID does not exist" containerID="9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b"
Sep 16 18:45:08.191257 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:08.191224    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b"} err="failed to get container status \"9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b\": rpc error: code = NotFound desc = could not find container \"9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b\": container with ID starting with 9bdfd2d989515b3ab81a64fbc119b0441fa6438c7e6d80083a58c599e4335c7b not found: ID does not exist"
Sep 16 18:45:08.191257 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:08.191248    2580 scope.go:117] "RemoveContainer" containerID="73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67"
Sep 16 18:45:08.191528 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:45:08.191510    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67\": container with ID starting with 73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67 not found: ID does not exist" containerID="73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67"
Sep 16 18:45:08.191570 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:08.191534    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67"} err="failed to get container status \"73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67\": rpc error: code = NotFound desc = could not find container \"73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67\": container with ID starting with 73169fd5e7902e1822175014be7688ff2749b07ec1d1ecc2d0c64128ed6ded67 not found: ID does not exist"
Sep 16 18:45:08.206709 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:08.206682    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"]
Sep 16 18:45:08.247784 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:08.247761    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-cf62d1-openshift-default-78cdc75b6d-8xkg2"]
Sep 16 18:45:09.867321 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:09.867289    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb00e099-486d-4954-b41a-72b24d8802af" path="/var/lib/kubelet/pods/eb00e099-486d-4954-b41a-72b24d8802af/volumes"
Sep 16 18:45:12.548095 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:12.548061    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"]
Sep 16 18:45:12.548527 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:12.548305    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerName="istio-proxy" containerID="cri-o://26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55" gracePeriod=30
Sep 16 18:45:17.801265 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.801241    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:45:17.870764 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.870732    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-token\") pod \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") "
Sep 16 18:45:17.870937 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.870784    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-data\") pod \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") "
Sep 16 18:45:17.870937 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.870811    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-workload-socket\") pod \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") "
Sep 16 18:45:17.870937 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.870826    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istiod-ca-cert\") pod \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") "
Sep 16 18:45:17.870937 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.870841    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tdzq\" (UniqueName: \"kubernetes.io/projected/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-kube-api-access-8tdzq\") pod \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") "
Sep 16 18:45:17.870937 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.870862    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-envoy\") pod \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") "
Sep 16 18:45:17.870937 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.870905    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-credential-socket\") pod \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") "
Sep 16 18:45:17.871253 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.870942    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-podinfo\") pod \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") "
Sep 16 18:45:17.871253 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.870966    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-workload-certs\") pod \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\" (UID: \"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00\") "
Sep 16 18:45:17.871253 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.871164    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" (UID: "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:45:17.871253 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.871177    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-data" (OuterVolumeSpecName: "istio-data") pod "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" (UID: "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:45:17.871492 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.871309    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:17.871492 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.871328    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:17.871492 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.871336    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" (UID: "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:45:17.871492 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.871359    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" (UID: "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:45:17.871693 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.871511    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" (UID: "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:45:17.873018 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.872990    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" (UID: "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:45:17.873115 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.873022    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" (UID: "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:45:17.873115 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.873046    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-token" (OuterVolumeSpecName: "istio-token") pod "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" (UID: "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:45:17.873115 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.873103    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-kube-api-access-8tdzq" (OuterVolumeSpecName: "kube-api-access-8tdzq") pod "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" (UID: "843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00"). InnerVolumeSpecName "kube-api-access-8tdzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:45:17.972196 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.972159    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:17.972196 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.972193    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tdzq\" (UniqueName: \"kubernetes.io/projected/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-kube-api-access-8tdzq\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:17.972470 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.972208    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:17.972470 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.972222    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:17.972470 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.972235    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:17.972470 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.972247    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:17.972470 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:17.972259    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:45:18.233940 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:18.233858    2580 generic.go:356] "Generic (PLEG): container finished" podID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerID="26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55" exitCode=0
Sep 16 18:45:18.233940 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:18.233923    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"
Sep 16 18:45:18.234140 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:18.233942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" event={"ID":"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00","Type":"ContainerDied","Data":"26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55"}
Sep 16 18:45:18.234140 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:18.233999    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd" event={"ID":"843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00","Type":"ContainerDied","Data":"65ee0e8ae412c6aece572bf2243bfe48bd0d89dcd59564561da96c3802d8cc97"}
Sep 16 18:45:18.234140 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:18.234023    2580 scope.go:117] "RemoveContainer" containerID="26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55"
Sep 16 18:45:18.243896 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:18.243876    2580 scope.go:117] "RemoveContainer" containerID="5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d"
Sep 16 18:45:18.253484 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:18.253463    2580 scope.go:117] "RemoveContainer" containerID="26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55"
Sep 16 18:45:18.253812 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:45:18.253782    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55\": container with ID starting with 26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55 not found: ID does not exist" containerID="26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55"
Sep 16 18:45:18.253911 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:18.253824    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55"} err="failed to get container status \"26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55\": rpc error: code = NotFound desc = could not find container \"26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55\": container with ID starting with 26da638510d89e89f1ee025ccc9d5da08f44ea21af123060499dc71523510b55 not found: ID does not exist"
Sep 16 18:45:18.253911 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:18.253848    2580 scope.go:117] "RemoveContainer" containerID="5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d"
Sep 16 18:45:18.254126 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:45:18.254108    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d\": container with ID starting with 5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d not found: ID does not exist" containerID="5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d"
Sep 16 18:45:18.254171 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:18.254133    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d"} err="failed to get container status \"5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d\": rpc error: code = NotFound desc = could not find container \"5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d\": container with ID starting with 5e8aebe2633c0994175b871e85e19ae2692d6111193eff9e8f354bce4bc1f68d not found: ID does not exist"
Sep 16 18:45:18.269101 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:18.269077    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"]
Sep 16 18:45:18.282829 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:18.282803    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-6942a4-openshift-default-6cfdd99b6d-rq8fd"]
Sep 16 18:45:19.867230 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:19.867196    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" path="/var/lib/kubelet/pods/843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00/volumes"
Sep 16 18:45:49.924048 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:45:49.924010    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"]
Sep 16 18:46:04.942438 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:04.942355    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v" podUID="70766462-cbba-4725-8b51-5566cedea694" containerName="main" containerID="cri-o://972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3" gracePeriod=45
Sep 16 18:46:04.984416 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:04.984354    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v" podUID="70766462-cbba-4725-8b51-5566cedea694" containerName="main" probeResult="failure" output="Get \"https://10.134.0.71:8000/ready\": dial tcp 10.134.0.71:8000: connect: connection refused"
Sep 16 18:46:05.201886 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.201802    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:46:05.341339 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.341307    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-model-cache\") pod \"70766462-cbba-4725-8b51-5566cedea694\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") "
Sep 16 18:46:05.341534 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.341405    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bzwq\" (UniqueName: \"kubernetes.io/projected/70766462-cbba-4725-8b51-5566cedea694-kube-api-access-2bzwq\") pod \"70766462-cbba-4725-8b51-5566cedea694\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") "
Sep 16 18:46:05.341534 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.341445    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70766462-cbba-4725-8b51-5566cedea694-tls-certs\") pod \"70766462-cbba-4725-8b51-5566cedea694\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") "
Sep 16 18:46:05.341534 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.341462    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-home\") pod \"70766462-cbba-4725-8b51-5566cedea694\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") "
Sep 16 18:46:05.341534 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.341483    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-tmp-dir\") pod \"70766462-cbba-4725-8b51-5566cedea694\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") "
Sep 16 18:46:05.341534 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.341527    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-dshm\") pod \"70766462-cbba-4725-8b51-5566cedea694\" (UID: \"70766462-cbba-4725-8b51-5566cedea694\") "
Sep 16 18:46:05.341803 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.341610    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-model-cache" (OuterVolumeSpecName: "model-cache") pod "70766462-cbba-4725-8b51-5566cedea694" (UID: "70766462-cbba-4725-8b51-5566cedea694"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:46:05.341803 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.341684    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-home" (OuterVolumeSpecName: "home") pod "70766462-cbba-4725-8b51-5566cedea694" (UID: "70766462-cbba-4725-8b51-5566cedea694"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:46:05.341803 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.341780    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "70766462-cbba-4725-8b51-5566cedea694" (UID: "70766462-cbba-4725-8b51-5566cedea694"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:46:05.341963 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.341889    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:46:05.341963 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.341902    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:46:05.341963 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.341910    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:46:05.343682 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.343660    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70766462-cbba-4725-8b51-5566cedea694-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "70766462-cbba-4725-8b51-5566cedea694" (UID: "70766462-cbba-4725-8b51-5566cedea694"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:46:05.343790 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.343772    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-dshm" (OuterVolumeSpecName: "dshm") pod "70766462-cbba-4725-8b51-5566cedea694" (UID: "70766462-cbba-4725-8b51-5566cedea694"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:46:05.343831 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.343779    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70766462-cbba-4725-8b51-5566cedea694-kube-api-access-2bzwq" (OuterVolumeSpecName: "kube-api-access-2bzwq") pod "70766462-cbba-4725-8b51-5566cedea694" (UID: "70766462-cbba-4725-8b51-5566cedea694"). InnerVolumeSpecName "kube-api-access-2bzwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:46:05.442390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.442340    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bzwq\" (UniqueName: \"kubernetes.io/projected/70766462-cbba-4725-8b51-5566cedea694-kube-api-access-2bzwq\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:46:05.442390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.442384    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70766462-cbba-4725-8b51-5566cedea694-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:46:05.442390 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.442396    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70766462-cbba-4725-8b51-5566cedea694-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:46:05.507179 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.507098    2580 generic.go:356] "Generic (PLEG): container finished" podID="70766462-cbba-4725-8b51-5566cedea694" containerID="972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3" exitCode=0
Sep 16 18:46:05.507179 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.507143    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"
Sep 16 18:46:05.507179 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.507152    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v" event={"ID":"70766462-cbba-4725-8b51-5566cedea694","Type":"ContainerDied","Data":"972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3"}
Sep 16 18:46:05.507409 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.507192    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v" event={"ID":"70766462-cbba-4725-8b51-5566cedea694","Type":"ContainerDied","Data":"5bb96b3e2e3e025874f7fe5d3a1513998be8e4aec282fcfae5f231dbd85300ef"}
Sep 16 18:46:05.507409 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.507213    2580 scope.go:117] "RemoveContainer" containerID="972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3"
Sep 16 18:46:05.516187 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.516168    2580 scope.go:117] "RemoveContainer" containerID="972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3"
Sep 16 18:46:05.516430 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:46:05.516412    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3\": container with ID starting with 972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3 not found: ID does not exist" containerID="972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3"
Sep 16 18:46:05.516505 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.516443    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3"} err="failed to get container status \"972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3\": rpc error: code = NotFound desc = could not find container \"972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3\": container with ID starting with 972e398fbb75cc4f3780f0fddf55dabb3d5b3e299de03265bb6b7dd89b5976b3 not found: ID does not exist"
Sep 16 18:46:05.529000 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.528979    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"]
Sep 16 18:46:05.532705 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.532670    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d3e8be/auth-test-model-d3e8be-kserve-7d7cd46f87-9v95v"]
Sep 16 18:46:05.866109 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:05.866078    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70766462-cbba-4725-8b51-5566cedea694" path="/var/lib/kubelet/pods/70766462-cbba-4725-8b51-5566cedea694/volumes"
Sep 16 18:46:51.904564 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904521    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7709-d982a8"]
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904908    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerName="istio-proxy"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904921    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerName="istio-proxy"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904936    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904941    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904954    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70766462-cbba-4725-8b51-5566cedea694" containerName="main"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904959    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="70766462-cbba-4725-8b51-5566cedea694" containerName="main"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904967    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904972    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904980    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerName="istio-proxy"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904985    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerName="istio-proxy"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904991    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="948ee50e-ba90-41a0-a5a5-4ce04e734c4e" containerName="cleanup"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.904995    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="948ee50e-ba90-41a0-a5a5-4ce04e734c4e" containerName="cleanup"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.905053    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.905061    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="70766462-cbba-4725-8b51-5566cedea694" containerName="main"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.905067    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerName="istio-proxy"
Sep 16 18:46:51.905094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.905073    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="948ee50e-ba90-41a0-a5a5-4ce04e734c4e" containerName="cleanup"
Sep 16 18:46:51.908192 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.908168    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7709-d982a8"
Sep 16 18:46:51.911666 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.911623    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xhq6g\""
Sep 16 18:46:51.913927 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.913895    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7709-d982a8"]
Sep 16 18:46:51.960256 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:51.960212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr6nt\" (UniqueName: \"kubernetes.io/projected/28dc674d-06b4-4b98-9cad-b1675f19c294-kube-api-access-gr6nt\") pod \"test-curl-7709-d982a8\" (UID: \"28dc674d-06b4-4b98-9cad-b1675f19c294\") " pod="opendatahub/test-curl-7709-d982a8"
Sep 16 18:46:52.061482 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:52.061444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr6nt\" (UniqueName: \"kubernetes.io/projected/28dc674d-06b4-4b98-9cad-b1675f19c294-kube-api-access-gr6nt\") pod \"test-curl-7709-d982a8\" (UID: \"28dc674d-06b4-4b98-9cad-b1675f19c294\") " pod="opendatahub/test-curl-7709-d982a8"
Sep 16 18:46:52.070557 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:52.070530    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr6nt\" (UniqueName: \"kubernetes.io/projected/28dc674d-06b4-4b98-9cad-b1675f19c294-kube-api-access-gr6nt\") pod \"test-curl-7709-d982a8\" (UID: \"28dc674d-06b4-4b98-9cad-b1675f19c294\") " pod="opendatahub/test-curl-7709-d982a8"
Sep 16 18:46:52.219994 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:52.219907    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7709-d982a8"
Sep 16 18:46:52.487950 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:52.487923    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7709-d982a8"]
Sep 16 18:46:52.489744 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:46:52.489716    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28dc674d_06b4_4b98_9cad_b1675f19c294.slice/crio-f7ce4bb06264f550486a7f701b2eb287319be7c65e865962d1bde7d44cc2fd11 WatchSource:0}: Error finding container f7ce4bb06264f550486a7f701b2eb287319be7c65e865962d1bde7d44cc2fd11: Status 404 returned error can't find the container with id f7ce4bb06264f550486a7f701b2eb287319be7c65e865962d1bde7d44cc2fd11
Sep 16 18:46:52.772837 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:52.772736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7709-d982a8" event={"ID":"28dc674d-06b4-4b98-9cad-b1675f19c294","Type":"ContainerStarted","Data":"8e13a721f8d167f26b417f17f51b279d8d604b968d71e49cbab30525bccee0ee"}
Sep 16 18:46:52.772837 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:52.772781    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7709-d982a8" event={"ID":"28dc674d-06b4-4b98-9cad-b1675f19c294","Type":"ContainerStarted","Data":"f7ce4bb06264f550486a7f701b2eb287319be7c65e865962d1bde7d44cc2fd11"}
Sep 16 18:46:52.788811 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:52.788751    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7709-d982a8" podStartSLOduration=1.7887321649999999 podStartE2EDuration="1.788732165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:46:52.788264965 +0000 UTC m=+1831.431291006" watchObservedRunningTime="2026-09-16 18:46:52.788732165 +0000 UTC m=+1831.431758207"
Sep 16 18:46:53.411843 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.411803    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7709-d982a8"]
Sep 16 18:46:53.415333 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.415307    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7709-d982a8"]
Sep 16 18:46:53.559275 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.559193    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7709-5b8f16"]
Sep 16 18:46:53.559576 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.559563    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28dc674d-06b4-4b98-9cad-b1675f19c294" containerName="test-curl-7709-d982a8"
Sep 16 18:46:53.559625 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.559578    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28dc674d-06b4-4b98-9cad-b1675f19c294" containerName="test-curl-7709-d982a8"
Sep 16 18:46:53.559664 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.559635    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb00e099-486d-4954-b41a-72b24d8802af" containerName="istio-proxy"
Sep 16 18:46:53.559664 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.559643    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="843b1a82-0c4e-4d2e-9c4a-1f1a1d444f00" containerName="istio-proxy"
Sep 16 18:46:53.559664 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.559649    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="28dc674d-06b4-4b98-9cad-b1675f19c294" containerName="test-curl-7709-d982a8"
Sep 16 18:46:53.562616 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.562599    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7709-5b8f16"
Sep 16 18:46:53.579448 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.579414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7709-5b8f16"]
Sep 16 18:46:53.677061 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.677003    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wflfz\" (UniqueName: \"kubernetes.io/projected/42bd177b-2496-49d6-87a6-8abdb9ae650c-kube-api-access-wflfz\") pod \"test-curl-7709-5b8f16\" (UID: \"42bd177b-2496-49d6-87a6-8abdb9ae650c\") " pod="opendatahub/test-curl-7709-5b8f16"
Sep 16 18:46:53.777896 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:46:53.777867    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7709-d982a8" container="test-curl-7709-d982a8"
Sep 16 18:46:53.778227 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.778198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wflfz\" (UniqueName: \"kubernetes.io/projected/42bd177b-2496-49d6-87a6-8abdb9ae650c-kube-api-access-wflfz\") pod \"test-curl-7709-5b8f16\" (UID: \"42bd177b-2496-49d6-87a6-8abdb9ae650c\") " pod="opendatahub/test-curl-7709-5b8f16"
Sep 16 18:46:53.787570 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.787548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wflfz\" (UniqueName: \"kubernetes.io/projected/42bd177b-2496-49d6-87a6-8abdb9ae650c-kube-api-access-wflfz\") pod \"test-curl-7709-5b8f16\" (UID: \"42bd177b-2496-49d6-87a6-8abdb9ae650c\") " pod="opendatahub/test-curl-7709-5b8f16"
Sep 16 18:46:53.872027 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:53.871999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7709-5b8f16"
Sep 16 18:46:54.144019 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:54.143991    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7709-5b8f16"]
Sep 16 18:46:54.145314 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:46:54.145288    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42bd177b_2496_49d6_87a6_8abdb9ae650c.slice/crio-510fafffd9a32b67851f2a2cb0514dd9d66e84e7ab4c715138bb8b02afcf06f9 WatchSource:0}: Error finding container 510fafffd9a32b67851f2a2cb0514dd9d66e84e7ab4c715138bb8b02afcf06f9: Status 404 returned error can't find the container with id 510fafffd9a32b67851f2a2cb0514dd9d66e84e7ab4c715138bb8b02afcf06f9
Sep 16 18:46:54.784333 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:54.784295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7709-5b8f16" event={"ID":"42bd177b-2496-49d6-87a6-8abdb9ae650c","Type":"ContainerStarted","Data":"5cff81563fc8bacf385da31d61d9896618b4ffe1ac4dc9347a34efefc0027f8a"}
Sep 16 18:46:54.784333 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:54.784349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7709-5b8f16" event={"ID":"42bd177b-2496-49d6-87a6-8abdb9ae650c","Type":"ContainerStarted","Data":"510fafffd9a32b67851f2a2cb0514dd9d66e84e7ab4c715138bb8b02afcf06f9"}
Sep 16 18:46:54.784863 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:54.784518    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7709-d982a8" podUID="28dc674d-06b4-4b98-9cad-b1675f19c294" containerName="test-curl-7709-d982a8" containerID="cri-o://8e13a721f8d167f26b417f17f51b279d8d604b968d71e49cbab30525bccee0ee" gracePeriod=2
Sep 16 18:46:54.800528 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:54.800480    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7709-5b8f16" podStartSLOduration=1.800464953 podStartE2EDuration="1.800464953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:46:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:46:54.798968026 +0000 UTC m=+1833.441994067" watchObservedRunningTime="2026-09-16 18:46:54.800464953 +0000 UTC m=+1833.443490992"
Sep 16 18:46:55.374199 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:55.374158    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7709-5b8f16"]
Sep 16 18:46:55.378612 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:55.378578    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7709-5b8f16"]
Sep 16 18:46:55.789595 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:46:55.789559    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7709-5b8f16" container="test-curl-7709-5b8f16"
Sep 16 18:46:56.795522 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:56.795466    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7709-5b8f16" podUID="42bd177b-2496-49d6-87a6-8abdb9ae650c" containerName="test-curl-7709-5b8f16" containerID="cri-o://5cff81563fc8bacf385da31d61d9896618b4ffe1ac4dc9347a34efefc0027f8a" gracePeriod=2
Sep 16 18:46:56.972124 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:56.972098    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7709-d982a8"
Sep 16 18:46:57.107711 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:57.107667    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr6nt\" (UniqueName: \"kubernetes.io/projected/28dc674d-06b4-4b98-9cad-b1675f19c294-kube-api-access-gr6nt\") pod \"28dc674d-06b4-4b98-9cad-b1675f19c294\" (UID: \"28dc674d-06b4-4b98-9cad-b1675f19c294\") "
Sep 16 18:46:57.109742 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:57.109719    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28dc674d-06b4-4b98-9cad-b1675f19c294-kube-api-access-gr6nt" (OuterVolumeSpecName: "kube-api-access-gr6nt") pod "28dc674d-06b4-4b98-9cad-b1675f19c294" (UID: "28dc674d-06b4-4b98-9cad-b1675f19c294"). InnerVolumeSpecName "kube-api-access-gr6nt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:46:57.208599 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:57.208560    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr6nt\" (UniqueName: \"kubernetes.io/projected/28dc674d-06b4-4b98-9cad-b1675f19c294-kube-api-access-gr6nt\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:46:57.801807 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:57.801771    2580 generic.go:356] "Generic (PLEG): container finished" podID="28dc674d-06b4-4b98-9cad-b1675f19c294" containerID="8e13a721f8d167f26b417f17f51b279d8d604b968d71e49cbab30525bccee0ee" exitCode=137
Sep 16 18:46:57.802248 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:57.801819    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7709-d982a8"
Sep 16 18:46:57.802248 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:57.801877    2580 scope.go:117] "RemoveContainer" containerID="8e13a721f8d167f26b417f17f51b279d8d604b968d71e49cbab30525bccee0ee"
Sep 16 18:46:57.810732 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:57.810714    2580 scope.go:117] "RemoveContainer" containerID="8e13a721f8d167f26b417f17f51b279d8d604b968d71e49cbab30525bccee0ee"
Sep 16 18:46:57.811010 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:46:57.810992    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e13a721f8d167f26b417f17f51b279d8d604b968d71e49cbab30525bccee0ee\": container with ID starting with 8e13a721f8d167f26b417f17f51b279d8d604b968d71e49cbab30525bccee0ee not found: ID does not exist" containerID="8e13a721f8d167f26b417f17f51b279d8d604b968d71e49cbab30525bccee0ee"
Sep 16 18:46:57.811051 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:57.811022    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e13a721f8d167f26b417f17f51b279d8d604b968d71e49cbab30525bccee0ee"} err="failed to get container status \"8e13a721f8d167f26b417f17f51b279d8d604b968d71e49cbab30525bccee0ee\": rpc error: code = NotFound desc = could not find container \"8e13a721f8d167f26b417f17f51b279d8d604b968d71e49cbab30525bccee0ee\": container with ID starting with 8e13a721f8d167f26b417f17f51b279d8d604b968d71e49cbab30525bccee0ee not found: ID does not exist"
Sep 16 18:46:57.813652 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:46:57.813628    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7709-d982a8\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="28dc674d-06b4-4b98-9cad-b1675f19c294" pod="opendatahub/test-curl-7709-d982a8"
Sep 16 18:46:57.866746 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:57.866713    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28dc674d-06b4-4b98-9cad-b1675f19c294" path="/var/lib/kubelet/pods/28dc674d-06b4-4b98-9cad-b1675f19c294/volumes"
Sep 16 18:46:58.976982 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:58.976955    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7709-5b8f16"
Sep 16 18:46:59.126900 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:59.126866    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wflfz\" (UniqueName: \"kubernetes.io/projected/42bd177b-2496-49d6-87a6-8abdb9ae650c-kube-api-access-wflfz\") pod \"42bd177b-2496-49d6-87a6-8abdb9ae650c\" (UID: \"42bd177b-2496-49d6-87a6-8abdb9ae650c\") "
Sep 16 18:46:59.128914 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:59.128884    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42bd177b-2496-49d6-87a6-8abdb9ae650c-kube-api-access-wflfz" (OuterVolumeSpecName: "kube-api-access-wflfz") pod "42bd177b-2496-49d6-87a6-8abdb9ae650c" (UID: "42bd177b-2496-49d6-87a6-8abdb9ae650c"). InnerVolumeSpecName "kube-api-access-wflfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:46:59.227814 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:59.227773    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wflfz\" (UniqueName: \"kubernetes.io/projected/42bd177b-2496-49d6-87a6-8abdb9ae650c-kube-api-access-wflfz\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:46:59.816140 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:59.816102    2580 generic.go:356] "Generic (PLEG): container finished" podID="42bd177b-2496-49d6-87a6-8abdb9ae650c" containerID="5cff81563fc8bacf385da31d61d9896618b4ffe1ac4dc9347a34efefc0027f8a" exitCode=137
Sep 16 18:46:59.816316 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:59.816148    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7709-5b8f16"
Sep 16 18:46:59.816316 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:59.816172    2580 scope.go:117] "RemoveContainer" containerID="5cff81563fc8bacf385da31d61d9896618b4ffe1ac4dc9347a34efefc0027f8a"
Sep 16 18:46:59.825405 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:59.825382    2580 scope.go:117] "RemoveContainer" containerID="5cff81563fc8bacf385da31d61d9896618b4ffe1ac4dc9347a34efefc0027f8a"
Sep 16 18:46:59.825678 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:46:59.825662    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cff81563fc8bacf385da31d61d9896618b4ffe1ac4dc9347a34efefc0027f8a\": container with ID starting with 5cff81563fc8bacf385da31d61d9896618b4ffe1ac4dc9347a34efefc0027f8a not found: ID does not exist" containerID="5cff81563fc8bacf385da31d61d9896618b4ffe1ac4dc9347a34efefc0027f8a"
Sep 16 18:46:59.825726 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:59.825685    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cff81563fc8bacf385da31d61d9896618b4ffe1ac4dc9347a34efefc0027f8a"} err="failed to get container status \"5cff81563fc8bacf385da31d61d9896618b4ffe1ac4dc9347a34efefc0027f8a\": rpc error: code = NotFound desc = could not find container \"5cff81563fc8bacf385da31d61d9896618b4ffe1ac4dc9347a34efefc0027f8a\": container with ID starting with 5cff81563fc8bacf385da31d61d9896618b4ffe1ac4dc9347a34efefc0027f8a not found: ID does not exist"
Sep 16 18:46:59.826109 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:46:59.826085    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7709-5b8f16\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="42bd177b-2496-49d6-87a6-8abdb9ae650c" pod="opendatahub/test-curl-7709-5b8f16"
Sep 16 18:46:59.871273 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:46:59.871239    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42bd177b-2496-49d6-87a6-8abdb9ae650c" path="/var/lib/kubelet/pods/42bd177b-2496-49d6-87a6-8abdb9ae650c/volumes"
Sep 16 18:48:58.155471 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.155440    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"]
Sep 16 18:48:58.157940 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.155961    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42bd177b-2496-49d6-87a6-8abdb9ae650c" containerName="test-curl-7709-5b8f16"
Sep 16 18:48:58.157940 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.155979    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="42bd177b-2496-49d6-87a6-8abdb9ae650c" containerName="test-curl-7709-5b8f16"
Sep 16 18:48:58.157940 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.156097    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="42bd177b-2496-49d6-87a6-8abdb9ae650c" containerName="test-curl-7709-5b8f16"
Sep 16 18:48:58.159144 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.159127    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.162199 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.162176    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-c90bd2-openshift-default-dockercfg-hzz6m\""
Sep 16 18:48:58.177276 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.177252    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"]
Sep 16 18:48:58.255510 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.255485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-podinfo\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.255627 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.255517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-envoy\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.255627 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.255536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-credential-socket\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.255703 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.255640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l52gx\" (UniqueName: \"kubernetes.io/projected/846ff291-7d6c-496e-959c-1ee3c3f54ab2-kube-api-access-l52gx\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.255703 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.255676    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-workload-socket\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.255703 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.255695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-workload-certs\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.255802 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.255753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-token\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.255802 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.255770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istiod-ca-cert\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.255802 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.255786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-data\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.356574 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.356539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l52gx\" (UniqueName: \"kubernetes.io/projected/846ff291-7d6c-496e-959c-1ee3c3f54ab2-kube-api-access-l52gx\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.356775 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.356581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-workload-socket\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.356775 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.356612    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-workload-certs\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.356775 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.356649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-token\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.356775 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.356673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istiod-ca-cert\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.356775 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.356699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-data\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.356775 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.356766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-podinfo\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.357154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.356795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-envoy\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.357154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.356816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-credential-socket\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.357154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.357008    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-workload-socket\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.357154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.357054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-workload-certs\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.357154 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.357128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-data\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.357318 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.357165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-credential-socket\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.357421 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.357355    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istiod-ca-cert\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.359045 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.359029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-envoy\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.359265 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.359249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-podinfo\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.368303 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.368286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-token\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.370128 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.370106    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l52gx\" (UniqueName: \"kubernetes.io/projected/846ff291-7d6c-496e-959c-1ee3c3f54ab2-kube-api-access-l52gx\") pod \"e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") " pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.469691 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.469615    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:58.759074 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.759043    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"]
Sep 16 18:48:58.760850 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:48:58.760821    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846ff291_7d6c_496e_959c_1ee3c3f54ab2.slice/crio-611f27378f4b7bcb28cc167b4ac216fcd6844ef5bd37fa0734fb872e32d0c848 WatchSource:0}: Error finding container 611f27378f4b7bcb28cc167b4ac216fcd6844ef5bd37fa0734fb872e32d0c848: Status 404 returned error can't find the container with id 611f27378f4b7bcb28cc167b4ac216fcd6844ef5bd37fa0734fb872e32d0c848
Sep 16 18:48:58.762992 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.762960    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:48:58.763067 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.763027    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:48:58.763106 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:58.763088    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:48:59.457975 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:59.457942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" event={"ID":"846ff291-7d6c-496e-959c-1ee3c3f54ab2","Type":"ContainerStarted","Data":"8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b"}
Sep 16 18:48:59.458419 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:59.457998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" event={"ID":"846ff291-7d6c-496e-959c-1ee3c3f54ab2","Type":"ContainerStarted","Data":"611f27378f4b7bcb28cc167b4ac216fcd6844ef5bd37fa0734fb872e32d0c848"}
Sep 16 18:48:59.470747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:59.470725    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:59.475798 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:59.475775    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:48:59.587004 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:48:59.586949    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" podStartSLOduration=1.5869305759999999 podStartE2EDuration="1.586930576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:48:59.585038688 +0000 UTC m=+1958.228064730" watchObservedRunningTime="2026-09-16 18:48:59.586930576 +0000 UTC m=+1958.229956617"
Sep 16 18:49:00.469642 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:00.469610    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:49:00.470620 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:00.470597    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:49:16.511559 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:16.511515    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 18:49:16.512006 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:16.511593    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 18:49:18.573186 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:18.573083    2580 generic.go:356] "Generic (PLEG): container finished" podID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerID="8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b" exitCode=0
Sep 16 18:49:18.573186 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:18.573155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" event={"ID":"846ff291-7d6c-496e-959c-1ee3c3f54ab2","Type":"ContainerDied","Data":"8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b"}
Sep 16 18:49:18.573647 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:18.573618    2580 scope.go:117] "RemoveContainer" containerID="8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b"
Sep 16 18:49:18.574769 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:18.574741    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:49:18.574853 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:18.574822    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:49:18.574891 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:18.574867    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:49:19.582193 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:19.582153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" event={"ID":"846ff291-7d6c-496e-959c-1ee3c3f54ab2","Type":"ContainerStarted","Data":"629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b"}
Sep 16 18:49:20.470271 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:20.470234    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:49:20.470488 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:20.470466    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 16 18:49:20.470541 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:20.470515    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 16 18:49:21.470284 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:21.470245    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 16 18:49:21.470712 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:21.470308    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 16 18:49:22.470639 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:22.470604    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 16 18:49:22.471042 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:22.470672    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 16 18:49:23.470422 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:23.470383    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 16 18:49:23.470631 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:23.470447    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 16 18:49:24.473918 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:24.473884    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:49:24.474316 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:24.474154    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:49:24.474963 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:49:24.474941    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:50:18.764436 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.764400    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"]
Sep 16 18:50:18.768688 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.768663    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.771120 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.771098    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-ebbe9a-openshift-default-dockercfg-2ndts\""
Sep 16 18:50:18.781412 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.781387    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"]
Sep 16 18:50:18.781659 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.781640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-envoy\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.781741 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.781727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-podinfo\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.781799 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.781787    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-token\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.781849 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.781805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9rhl\" (UniqueName: \"kubernetes.io/projected/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-kube-api-access-j9rhl\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.781849 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.781827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.781949 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.781924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-workload-socket\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.781986 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.781974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-workload-certs\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.782038 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.782023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-data\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.782079 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.782068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-credential-socket\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.882864 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.882822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-podinfo\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.883103 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.882893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-token\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.883103 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.883062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9rhl\" (UniqueName: \"kubernetes.io/projected/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-kube-api-access-j9rhl\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.883226 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.883114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.883226 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.883154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-workload-socket\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.883226 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.883182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-workload-certs\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.883485 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.883259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-data\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.883485 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.883313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-credential-socket\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.883485 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.883358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-envoy\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.883760 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.883697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-workload-socket\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.883890 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.883793    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-workload-certs\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.883890 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.883841    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-data\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.883890 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.883855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-credential-socket\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.884007 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.883974    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.885642 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.885622    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-envoy\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.885746 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.885697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-podinfo\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.891155 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.891125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-token\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:18.891297 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:18.891275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9rhl\" (UniqueName: \"kubernetes.io/projected/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-kube-api-access-j9rhl\") pod \"e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") " pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:19.081719 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:19.081637    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:19.364434 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:19.364402    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"]
Sep 16 18:50:19.365471 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:50:19.365437    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0904a237_32c3_4d88_b8b6_a3883dfb4dc0.slice/crio-5d43c21b96f6b3f7d0bd32136195f7912c70bff71fb5e1188b3910ab52e66836 WatchSource:0}: Error finding container 5d43c21b96f6b3f7d0bd32136195f7912c70bff71fb5e1188b3910ab52e66836: Status 404 returned error can't find the container with id 5d43c21b96f6b3f7d0bd32136195f7912c70bff71fb5e1188b3910ab52e66836
Sep 16 18:50:19.367734 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:19.367700    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:50:19.367828 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:19.367767    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:50:19.367828 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:19.367794    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:50:19.918618 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:19.918588    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" event={"ID":"0904a237-32c3-4d88-b8b6-a3883dfb4dc0","Type":"ContainerStarted","Data":"234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87"}
Sep 16 18:50:19.918992 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:19.918636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" event={"ID":"0904a237-32c3-4d88-b8b6-a3883dfb4dc0","Type":"ContainerStarted","Data":"5d43c21b96f6b3f7d0bd32136195f7912c70bff71fb5e1188b3910ab52e66836"}
Sep 16 18:50:19.943331 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:19.943283    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" podStartSLOduration=1.943267676 podStartE2EDuration="1.943267676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:50:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:50:19.940162582 +0000 UTC m=+2038.583188622" watchObservedRunningTime="2026-09-16 18:50:19.943267676 +0000 UTC m=+2038.586293795"
Sep 16 18:50:20.081940 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:20.081908    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:20.087048 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:20.087024    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:20.925887 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:20.925848    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:20.926934 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:20.926909    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:25.165901 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.165863    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"]
Sep 16 18:50:25.169751 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.169728    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.173393 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.173340    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-ebbe9a-serving-cert\""
Sep 16 18:50:25.183660 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.183634    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"]
Sep 16 18:50:25.242769 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.242736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fb69388-3740-4e13-a3df-91f526e28df3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.242927 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.242786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fb69388-3740-4e13-a3df-91f526e28df3-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.242927 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.242810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb69388-3740-4e13-a3df-91f526e28df3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.243009 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.242918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7g5d\" (UniqueName: \"kubernetes.io/projected/9fb69388-3740-4e13-a3df-91f526e28df3-kube-api-access-z7g5d\") pod \"maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.344932 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.343913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fb69388-3740-4e13-a3df-91f526e28df3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.344932 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.344001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fb69388-3740-4e13-a3df-91f526e28df3-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.344932 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.344041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb69388-3740-4e13-a3df-91f526e28df3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.344932 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.344143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7g5d\" (UniqueName: \"kubernetes.io/projected/9fb69388-3740-4e13-a3df-91f526e28df3-kube-api-access-z7g5d\") pod \"maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.346036 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.346007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb69388-3740-4e13-a3df-91f526e28df3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.348575 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.348548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fb69388-3740-4e13-a3df-91f526e28df3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.350162 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.350135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fb69388-3740-4e13-a3df-91f526e28df3-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.359006 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.358963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7g5d\" (UniqueName: \"kubernetes.io/projected/9fb69388-3740-4e13-a3df-91f526e28df3-kube-api-access-z7g5d\") pod \"maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.480593 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.480502    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:25.759484 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.759451    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"]
Sep 16 18:50:25.760497 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:50:25.760473    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb69388_3740_4e13_a3df_91f526e28df3.slice/crio-451a8a84e20560c948bbd7b336fea7d5db3d0e24f9090e073bfa1bfa7f5ddb3b WatchSource:0}: Error finding container 451a8a84e20560c948bbd7b336fea7d5db3d0e24f9090e073bfa1bfa7f5ddb3b: Status 404 returned error can't find the container with id 451a8a84e20560c948bbd7b336fea7d5db3d0e24f9090e073bfa1bfa7f5ddb3b
Sep 16 18:50:25.761941 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.761923    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:50:25.963395 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:25.961070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw" event={"ID":"9fb69388-3740-4e13-a3df-91f526e28df3","Type":"ContainerStarted","Data":"451a8a84e20560c948bbd7b336fea7d5db3d0e24f9090e073bfa1bfa7f5ddb3b"}
Sep 16 18:50:26.967188 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:26.967150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw" event={"ID":"9fb69388-3740-4e13-a3df-91f526e28df3","Type":"ContainerStarted","Data":"858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150"}
Sep 16 18:50:26.967612 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:26.967264    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:26.987423 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:26.987381    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw" podStartSLOduration=1.620226117 podStartE2EDuration="1.987350222s" totalImagesPullingTime="367.124105ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:50:26.986050541 +0000 UTC m=+2045.629076580" watchObservedRunningTime="2026-09-16 18:50:26.987350222 +0000 UTC m=+2045.630376261"
Sep 16 18:50:32.977837 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:32.977808    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:50:40.053246 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:40.053212    2580 generic.go:356] "Generic (PLEG): container finished" podID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerID="234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87" exitCode=0
Sep 16 18:50:40.053716 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:40.053283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" event={"ID":"0904a237-32c3-4d88-b8b6-a3883dfb4dc0","Type":"ContainerDied","Data":"234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87"}
Sep 16 18:50:40.053773 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:40.053722    2580 scope.go:117] "RemoveContainer" containerID="234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87"
Sep 16 18:50:40.054938 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:40.054907    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:50:40.055041 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:40.054988    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:50:40.055103 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:40.055038    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:50:41.060867 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:41.060836    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" event={"ID":"0904a237-32c3-4d88-b8b6-a3883dfb4dc0","Type":"ContainerStarted","Data":"8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c"}
Sep 16 18:50:41.082670 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:41.082642    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:41.082928 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:41.082906    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 16 18:50:41.082987 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:41.082959    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 16 18:50:42.082097 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:42.082063    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 16 18:50:42.082505 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:42.082112    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 16 18:50:43.082813 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:43.082778    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 16 18:50:43.083189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:43.082833    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 16 18:50:44.082297 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:44.082217    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 16 18:50:44.082297 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:44.082269    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 16 18:50:45.082560 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:45.082525    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 16 18:50:45.082959 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:45.082578    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 16 18:50:46.082588 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:46.082553    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 16 18:50:46.082985 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:46.082611    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 16 18:50:47.085896 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:47.085862    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:47.086287 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:47.086091    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:50:47.086833 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:50:47.086816    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:51:03.642288 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:03.642255    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"]
Sep 16 18:51:03.642829 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:03.642516    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw" podUID="9fb69388-3740-4e13-a3df-91f526e28df3" containerName="maas-api" containerID="cri-o://858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150" gracePeriod=30
Sep 16 18:51:03.885969 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:03.885945    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:51:03.923580 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:03.923501    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb69388-3740-4e13-a3df-91f526e28df3-openshift-service-ca\") pod \"9fb69388-3740-4e13-a3df-91f526e28df3\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") "
Sep 16 18:51:03.923580 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:03.923543    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7g5d\" (UniqueName: \"kubernetes.io/projected/9fb69388-3740-4e13-a3df-91f526e28df3-kube-api-access-z7g5d\") pod \"9fb69388-3740-4e13-a3df-91f526e28df3\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") "
Sep 16 18:51:03.923803 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:03.923640    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fb69388-3740-4e13-a3df-91f526e28df3-maas-api-tls\") pod \"9fb69388-3740-4e13-a3df-91f526e28df3\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") "
Sep 16 18:51:03.923803 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:03.923759    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fb69388-3740-4e13-a3df-91f526e28df3-metrics-certs\") pod \"9fb69388-3740-4e13-a3df-91f526e28df3\" (UID: \"9fb69388-3740-4e13-a3df-91f526e28df3\") "
Sep 16 18:51:03.923989 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:03.923951    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fb69388-3740-4e13-a3df-91f526e28df3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9fb69388-3740-4e13-a3df-91f526e28df3" (UID: "9fb69388-3740-4e13-a3df-91f526e28df3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:51:03.924237 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:03.924216    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fb69388-3740-4e13-a3df-91f526e28df3-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:03.925882 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:03.925841    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb69388-3740-4e13-a3df-91f526e28df3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9fb69388-3740-4e13-a3df-91f526e28df3" (UID: "9fb69388-3740-4e13-a3df-91f526e28df3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:51:03.926210 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:03.926182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb69388-3740-4e13-a3df-91f526e28df3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9fb69388-3740-4e13-a3df-91f526e28df3" (UID: "9fb69388-3740-4e13-a3df-91f526e28df3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:51:03.926210 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:03.926195    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb69388-3740-4e13-a3df-91f526e28df3-kube-api-access-z7g5d" (OuterVolumeSpecName: "kube-api-access-z7g5d") pod "9fb69388-3740-4e13-a3df-91f526e28df3" (UID: "9fb69388-3740-4e13-a3df-91f526e28df3"). InnerVolumeSpecName "kube-api-access-z7g5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:51:04.025900 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:04.025859    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7g5d\" (UniqueName: \"kubernetes.io/projected/9fb69388-3740-4e13-a3df-91f526e28df3-kube-api-access-z7g5d\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:04.025900 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:04.025901    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fb69388-3740-4e13-a3df-91f526e28df3-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:04.025900 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:04.025915    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fb69388-3740-4e13-a3df-91f526e28df3-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:04.199018 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:04.198923    2580 generic.go:356] "Generic (PLEG): container finished" podID="9fb69388-3740-4e13-a3df-91f526e28df3" containerID="858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150" exitCode=0
Sep 16 18:51:04.199018 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:04.198975    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"
Sep 16 18:51:04.199214 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:04.199020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw" event={"ID":"9fb69388-3740-4e13-a3df-91f526e28df3","Type":"ContainerDied","Data":"858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150"}
Sep 16 18:51:04.199214 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:04.199089    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw" event={"ID":"9fb69388-3740-4e13-a3df-91f526e28df3","Type":"ContainerDied","Data":"451a8a84e20560c948bbd7b336fea7d5db3d0e24f9090e073bfa1bfa7f5ddb3b"}
Sep 16 18:51:04.199214 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:04.199125    2580 scope.go:117] "RemoveContainer" containerID="858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150"
Sep 16 18:51:04.209198 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:04.209186    2580 scope.go:117] "RemoveContainer" containerID="858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150"
Sep 16 18:51:04.209462 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:51:04.209442    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150\": container with ID starting with 858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150 not found: ID does not exist" containerID="858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150"
Sep 16 18:51:04.209520 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:04.209470    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150"} err="failed to get container status \"858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150\": rpc error: code = NotFound desc = could not find container \"858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150\": container with ID starting with 858b5f8d3e7d5b9557748b0673b39bb7ef1832f132a90da76b428061b1328150 not found: ID does not exist"
Sep 16 18:51:04.222075 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:04.222043    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"]
Sep 16 18:51:04.225884 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:04.225862    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ebbe9a-7d6cbd8f49-wsdsw"]
Sep 16 18:51:05.867226 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:05.867188    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb69388-3740-4e13-a3df-91f526e28df3" path="/var/lib/kubelet/pods/9fb69388-3740-4e13-a3df-91f526e28df3/volumes"
Sep 16 18:51:10.676916 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:10.676884    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"]
Sep 16 18:51:10.677408 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:10.677101    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy" containerID="cri-o://8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c" gracePeriod=30
Sep 16 18:51:15.927053 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:15.927027    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:51:16.048623 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.048531    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istiod-ca-cert\") pod \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") "
Sep 16 18:51:16.048623 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.048583    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-credential-socket\") pod \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") "
Sep 16 18:51:16.048870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.048693    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-token\") pod \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") "
Sep 16 18:51:16.048870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.048735    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-podinfo\") pod \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") "
Sep 16 18:51:16.048870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.048763    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-workload-socket\") pod \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") "
Sep 16 18:51:16.048870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.048831    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-envoy\") pod \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") "
Sep 16 18:51:16.048870 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.048854    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-data\") pod \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") "
Sep 16 18:51:16.049125 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.048886    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9rhl\" (UniqueName: \"kubernetes.io/projected/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-kube-api-access-j9rhl\") pod \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") "
Sep 16 18:51:16.049125 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.048910    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0904a237-32c3-4d88-b8b6-a3883dfb4dc0" (UID: "0904a237-32c3-4d88-b8b6-a3883dfb4dc0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:51:16.049125 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.048919    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-workload-certs\") pod \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\" (UID: \"0904a237-32c3-4d88-b8b6-a3883dfb4dc0\") "
Sep 16 18:51:16.049125 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.048953    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0904a237-32c3-4d88-b8b6-a3883dfb4dc0" (UID: "0904a237-32c3-4d88-b8b6-a3883dfb4dc0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:51:16.049317 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.049128    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0904a237-32c3-4d88-b8b6-a3883dfb4dc0" (UID: "0904a237-32c3-4d88-b8b6-a3883dfb4dc0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:51:16.049317 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.049212    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0904a237-32c3-4d88-b8b6-a3883dfb4dc0" (UID: "0904a237-32c3-4d88-b8b6-a3883dfb4dc0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:51:16.049317 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.049233    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-data" (OuterVolumeSpecName: "istio-data") pod "0904a237-32c3-4d88-b8b6-a3883dfb4dc0" (UID: "0904a237-32c3-4d88-b8b6-a3883dfb4dc0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:51:16.049500 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.049408    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:16.049500 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.049429    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:16.049500 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.049442    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:16.049500 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.049454    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:16.049500 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.049466    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:16.051009 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.050975    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0904a237-32c3-4d88-b8b6-a3883dfb4dc0" (UID: "0904a237-32c3-4d88-b8b6-a3883dfb4dc0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:51:16.051108 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.051033    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-kube-api-access-j9rhl" (OuterVolumeSpecName: "kube-api-access-j9rhl") pod "0904a237-32c3-4d88-b8b6-a3883dfb4dc0" (UID: "0904a237-32c3-4d88-b8b6-a3883dfb4dc0"). InnerVolumeSpecName "kube-api-access-j9rhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:51:16.051297 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.051278    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0904a237-32c3-4d88-b8b6-a3883dfb4dc0" (UID: "0904a237-32c3-4d88-b8b6-a3883dfb4dc0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:51:16.051387 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.051294    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-token" (OuterVolumeSpecName: "istio-token") pod "0904a237-32c3-4d88-b8b6-a3883dfb4dc0" (UID: "0904a237-32c3-4d88-b8b6-a3883dfb4dc0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:51:16.150192 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.150154    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:16.150192 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.150193    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:16.150425 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.150208    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9rhl\" (UniqueName: \"kubernetes.io/projected/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-kube-api-access-j9rhl\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:16.150425 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.150223    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0904a237-32c3-4d88-b8b6-a3883dfb4dc0-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:51:16.277136 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.277101    2580 generic.go:356] "Generic (PLEG): container finished" podID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerID="8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c" exitCode=0
Sep 16 18:51:16.277276 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.277148    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"
Sep 16 18:51:16.277276 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.277192    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" event={"ID":"0904a237-32c3-4d88-b8b6-a3883dfb4dc0","Type":"ContainerDied","Data":"8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c"}
Sep 16 18:51:16.277276 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.277251    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx" event={"ID":"0904a237-32c3-4d88-b8b6-a3883dfb4dc0","Type":"ContainerDied","Data":"5d43c21b96f6b3f7d0bd32136195f7912c70bff71fb5e1188b3910ab52e66836"}
Sep 16 18:51:16.277421 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.277279    2580 scope.go:117] "RemoveContainer" containerID="8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c"
Sep 16 18:51:16.294953 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.294928    2580 scope.go:117] "RemoveContainer" containerID="234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87"
Sep 16 18:51:16.303871 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.303841    2580 scope.go:117] "RemoveContainer" containerID="8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c"
Sep 16 18:51:16.304164 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:51:16.304144    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c\": container with ID starting with 8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c not found: ID does not exist" containerID="8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c"
Sep 16 18:51:16.304223 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.304172    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c"} err="failed to get container status \"8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c\": rpc error: code = NotFound desc = could not find container \"8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c\": container with ID starting with 8b0bc2b7c0e7897d94e94d87dc9fdee395aa08d3c5c1d7f3758d171886f7755c not found: ID does not exist"
Sep 16 18:51:16.304223 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.304190    2580 scope.go:117] "RemoveContainer" containerID="234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87"
Sep 16 18:51:16.304439 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:51:16.304423    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87\": container with ID starting with 234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87 not found: ID does not exist" containerID="234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87"
Sep 16 18:51:16.304495 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.304443    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87"} err="failed to get container status \"234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87\": rpc error: code = NotFound desc = could not find container \"234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87\": container with ID starting with 234b47e5645e59e2b79a574d079ff0dcc5f369038ef22ade2d4e652d1d8c6b87 not found: ID does not exist"
Sep 16 18:51:16.305314 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.305296    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"]
Sep 16 18:51:16.313177 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:16.313156    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ebbe9a-openshift-default-75c8f58cf6-zhtbx"]
Sep 16 18:51:17.867378 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:51:17.867332    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" path="/var/lib/kubelet/pods/0904a237-32c3-4d88-b8b6-a3883dfb4dc0/volumes"
Sep 16 18:52:38.357237 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:38.357155    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"]
Sep 16 18:52:38.357756 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:38.357422    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy" containerID="cri-o://629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b" gracePeriod=30
Sep 16 18:52:39.476411 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:39.476360    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 18:52:39.476787 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:39.476444    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 18:52:43.607619 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.607593    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:52:43.724659 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.724585    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-workload-certs\") pod \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") "
Sep 16 18:52:43.724659 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.724625    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istiod-ca-cert\") pod \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") "
Sep 16 18:52:43.724873 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.724673    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l52gx\" (UniqueName: \"kubernetes.io/projected/846ff291-7d6c-496e-959c-1ee3c3f54ab2-kube-api-access-l52gx\") pod \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") "
Sep 16 18:52:43.724873 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.724694    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-envoy\") pod \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") "
Sep 16 18:52:43.724873 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.724713    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-workload-socket\") pod \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") "
Sep 16 18:52:43.724873 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.724801    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-data\") pod \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") "
Sep 16 18:52:43.724873 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.724838    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-podinfo\") pod \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") "
Sep 16 18:52:43.724873 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.724842    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "846ff291-7d6c-496e-959c-1ee3c3f54ab2" (UID: "846ff291-7d6c-496e-959c-1ee3c3f54ab2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:52:43.724873 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.724870    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-credential-socket\") pod \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") "
Sep 16 18:52:43.725244 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.724903    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-token\") pod \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\" (UID: \"846ff291-7d6c-496e-959c-1ee3c3f54ab2\") "
Sep 16 18:52:43.725244 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.725072    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "846ff291-7d6c-496e-959c-1ee3c3f54ab2" (UID: "846ff291-7d6c-496e-959c-1ee3c3f54ab2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:52:43.725244 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.725092    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "846ff291-7d6c-496e-959c-1ee3c3f54ab2" (UID: "846ff291-7d6c-496e-959c-1ee3c3f54ab2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:52:43.725244 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.725110    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "846ff291-7d6c-496e-959c-1ee3c3f54ab2" (UID: "846ff291-7d6c-496e-959c-1ee3c3f54ab2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:52:43.725492 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.725294    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:52:43.725492 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.725314    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:52:43.725492 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.725327    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:52:43.725492 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.725339    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:52:43.725700 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.725511    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-data" (OuterVolumeSpecName: "istio-data") pod "846ff291-7d6c-496e-959c-1ee3c3f54ab2" (UID: "846ff291-7d6c-496e-959c-1ee3c3f54ab2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:52:43.726850 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.726828    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "846ff291-7d6c-496e-959c-1ee3c3f54ab2" (UID: "846ff291-7d6c-496e-959c-1ee3c3f54ab2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:52:43.726967 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.726950    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "846ff291-7d6c-496e-959c-1ee3c3f54ab2" (UID: "846ff291-7d6c-496e-959c-1ee3c3f54ab2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:52:43.727032 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.726981    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846ff291-7d6c-496e-959c-1ee3c3f54ab2-kube-api-access-l52gx" (OuterVolumeSpecName: "kube-api-access-l52gx") pod "846ff291-7d6c-496e-959c-1ee3c3f54ab2" (UID: "846ff291-7d6c-496e-959c-1ee3c3f54ab2"). InnerVolumeSpecName "kube-api-access-l52gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:52:43.727082 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.727033    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-token" (OuterVolumeSpecName: "istio-token") pod "846ff291-7d6c-496e-959c-1ee3c3f54ab2" (UID: "846ff291-7d6c-496e-959c-1ee3c3f54ab2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:52:43.761340 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.761312    2580 generic.go:356] "Generic (PLEG): container finished" podID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerID="629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b" exitCode=0
Sep 16 18:52:43.761460 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.761355    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"
Sep 16 18:52:43.761460 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.761396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" event={"ID":"846ff291-7d6c-496e-959c-1ee3c3f54ab2","Type":"ContainerDied","Data":"629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b"}
Sep 16 18:52:43.761460 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.761450    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg" event={"ID":"846ff291-7d6c-496e-959c-1ee3c3f54ab2","Type":"ContainerDied","Data":"611f27378f4b7bcb28cc167b4ac216fcd6844ef5bd37fa0734fb872e32d0c848"}
Sep 16 18:52:43.761562 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.761473    2580 scope.go:117] "RemoveContainer" containerID="629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b"
Sep 16 18:52:43.770785 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.770766    2580 scope.go:117] "RemoveContainer" containerID="8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b"
Sep 16 18:52:43.778779 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.778763    2580 scope.go:117] "RemoveContainer" containerID="629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b"
Sep 16 18:52:43.779023 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:52:43.779005    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b\": container with ID starting with 629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b not found: ID does not exist" containerID="629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b"
Sep 16 18:52:43.779088 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.779032    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b"} err="failed to get container status \"629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b\": rpc error: code = NotFound desc = could not find container \"629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b\": container with ID starting with 629deaf8936883ae9fa20992dfaeecb360fa8a8472be0a7545e0bde0c9cc8a1b not found: ID does not exist"
Sep 16 18:52:43.779088 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.779048    2580 scope.go:117] "RemoveContainer" containerID="8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b"
Sep 16 18:52:43.779296 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:52:43.779281    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b\": container with ID starting with 8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b not found: ID does not exist" containerID="8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b"
Sep 16 18:52:43.779335 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.779300    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b"} err="failed to get container status \"8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b\": rpc error: code = NotFound desc = could not find container \"8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b\": container with ID starting with 8e8114acaec860f3567b659cb24c64e2d88912f5203b7315d87aeb46c27ffa9b not found: ID does not exist"
Sep 16 18:52:43.783660 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.783638    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"]
Sep 16 18:52:43.787302 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.787283    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-c90bd2-openshift-default-f4cdd6568-7q2zg"]
Sep 16 18:52:43.826227 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.826207    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:52:43.826227 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.826227    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:52:43.826354 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.826235    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:52:43.826354 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.826243    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l52gx\" (UniqueName: \"kubernetes.io/projected/846ff291-7d6c-496e-959c-1ee3c3f54ab2-kube-api-access-l52gx\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:52:43.826354 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.826251    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/846ff291-7d6c-496e-959c-1ee3c3f54ab2-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:52:43.865837 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:43.865812    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" path="/var/lib/kubelet/pods/846ff291-7d6c-496e-959c-1ee3c3f54ab2/volumes"
Sep 16 18:52:49.267086 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:49.267053    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-972df0-29826405-sg4m7"]
Sep 16 18:52:49.270737 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:49.270714    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-972df0-29826405-sg4m7"]
Sep 16 18:52:49.866849 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:49.866815    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="948ee50e-ba90-41a0-a5a5-4ce04e734c4e" path="/var/lib/kubelet/pods/948ee50e-ba90-41a0-a5a5-4ce04e734c4e/volumes"
Sep 16 18:52:56.650291 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:56.650258    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"]
Sep 16 18:52:56.650702 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:52:56.650497    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy" containerID="cri-o://717dc437d0c3c3e864a823f390778f67ba67bc952d7e3e19e96819cba445b685" gracePeriod=30
Sep 16 18:53:01.864894 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.864851    2580 generic.go:356] "Generic (PLEG): container finished" podID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerID="717dc437d0c3c3e864a823f390778f67ba67bc952d7e3e19e96819cba445b685" exitCode=0
Sep 16 18:53:01.873983 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.873952    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" event={"ID":"a19c4dae-940b-4159-aeec-1cf2281e479b","Type":"ContainerDied","Data":"717dc437d0c3c3e864a823f390778f67ba67bc952d7e3e19e96819cba445b685"}
Sep 16 18:53:01.874143 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.873997    2580 scope.go:117] "RemoveContainer" containerID="f86ead7cd4abce6f7ff45253e7b386a596e46e95fb89cb21e14210c05c21d388"
Sep 16 18:53:01.896454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.896431    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:53:01.988570 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.988490    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-podinfo\") pod \"a19c4dae-940b-4159-aeec-1cf2281e479b\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") "
Sep 16 18:53:01.988570 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.988530    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-envoy\") pod \"a19c4dae-940b-4159-aeec-1cf2281e479b\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") "
Sep 16 18:53:01.988570 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.988553    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-workload-certs\") pod \"a19c4dae-940b-4159-aeec-1cf2281e479b\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") "
Sep 16 18:53:01.988839 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.988679    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-token\") pod \"a19c4dae-940b-4159-aeec-1cf2281e479b\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") "
Sep 16 18:53:01.988899 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.988851    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a19c4dae-940b-4159-aeec-1cf2281e479b" (UID: "a19c4dae-940b-4159-aeec-1cf2281e479b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:53:01.988899 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.988856    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-data\") pod \"a19c4dae-940b-4159-aeec-1cf2281e479b\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") "
Sep 16 18:53:01.989006 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.988948    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-workload-socket\") pod \"a19c4dae-940b-4159-aeec-1cf2281e479b\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") "
Sep 16 18:53:01.989006 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.988989    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnz6d\" (UniqueName: \"kubernetes.io/projected/a19c4dae-940b-4159-aeec-1cf2281e479b-kube-api-access-gnz6d\") pod \"a19c4dae-940b-4159-aeec-1cf2281e479b\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") "
Sep 16 18:53:01.989115 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.989081    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-data" (OuterVolumeSpecName: "istio-data") pod "a19c4dae-940b-4159-aeec-1cf2281e479b" (UID: "a19c4dae-940b-4159-aeec-1cf2281e479b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:53:01.989115 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.989091    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a19c4dae-940b-4159-aeec-1cf2281e479b-istiod-ca-cert\") pod \"a19c4dae-940b-4159-aeec-1cf2281e479b\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") "
Sep 16 18:53:01.989238 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.989119    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-credential-socket\") pod \"a19c4dae-940b-4159-aeec-1cf2281e479b\" (UID: \"a19c4dae-940b-4159-aeec-1cf2281e479b\") "
Sep 16 18:53:01.989238 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.989208    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a19c4dae-940b-4159-aeec-1cf2281e479b" (UID: "a19c4dae-940b-4159-aeec-1cf2281e479b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:53:01.989470 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.989408    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a19c4dae-940b-4159-aeec-1cf2281e479b" (UID: "a19c4dae-940b-4159-aeec-1cf2281e479b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:53:01.989470 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.989439    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a19c4dae-940b-4159-aeec-1cf2281e479b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a19c4dae-940b-4159-aeec-1cf2281e479b" (UID: "a19c4dae-940b-4159-aeec-1cf2281e479b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:53:01.989644 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.989574    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:01.989644 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.989592    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:01.989644 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.989606    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:01.989644 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.989617    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a19c4dae-940b-4159-aeec-1cf2281e479b-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:01.989644 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.989629    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:01.990949 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.990915    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a19c4dae-940b-4159-aeec-1cf2281e479b" (UID: "a19c4dae-940b-4159-aeec-1cf2281e479b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:53:01.990949 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.990918    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-token" (OuterVolumeSpecName: "istio-token") pod "a19c4dae-940b-4159-aeec-1cf2281e479b" (UID: "a19c4dae-940b-4159-aeec-1cf2281e479b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:53:01.991086 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.991038    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a19c4dae-940b-4159-aeec-1cf2281e479b-kube-api-access-gnz6d" (OuterVolumeSpecName: "kube-api-access-gnz6d") pod "a19c4dae-940b-4159-aeec-1cf2281e479b" (UID: "a19c4dae-940b-4159-aeec-1cf2281e479b"). InnerVolumeSpecName "kube-api-access-gnz6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:53:01.991149 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:01.991114    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a19c4dae-940b-4159-aeec-1cf2281e479b" (UID: "a19c4dae-940b-4159-aeec-1cf2281e479b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:53:02.091056 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:02.091017    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:02.091056 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:02.091049    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:02.091056 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:02.091059    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a19c4dae-940b-4159-aeec-1cf2281e479b-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:02.091299 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:02.091067    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnz6d\" (UniqueName: \"kubernetes.io/projected/a19c4dae-940b-4159-aeec-1cf2281e479b-kube-api-access-gnz6d\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:02.872244 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:02.872212    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"
Sep 16 18:53:02.872695 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:02.872246    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26" event={"ID":"a19c4dae-940b-4159-aeec-1cf2281e479b","Type":"ContainerDied","Data":"46868f93bdb8d4ef829a351f510ae60d0fc1be7d61bb36c3503cc56a65ce6a19"}
Sep 16 18:53:02.872695 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:02.872293    2580 scope.go:117] "RemoveContainer" containerID="717dc437d0c3c3e864a823f390778f67ba67bc952d7e3e19e96819cba445b685"
Sep 16 18:53:02.907637 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:02.907610    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"]
Sep 16 18:53:02.913717 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:02.913691    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-972df0-openshift-default-c8dfc654d-8cv26"]
Sep 16 18:53:03.867304 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:03.867263    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" path="/var/lib/kubelet/pods/a19c4dae-940b-4159-aeec-1cf2281e479b/volumes"
Sep 16 18:53:07.499646 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.499616    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"]
Sep 16 18:53:07.500075 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.499934    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7" podUID="494e80cf-e7f9-44bf-964d-58130567f5b7" containerName="maas-api" containerID="cri-o://d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13" gracePeriod=30
Sep 16 18:53:07.745710 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.745684    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:53:07.844077 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.844049    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkmjx\" (UniqueName: \"kubernetes.io/projected/494e80cf-e7f9-44bf-964d-58130567f5b7-kube-api-access-jkmjx\") pod \"494e80cf-e7f9-44bf-964d-58130567f5b7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") "
Sep 16 18:53:07.844233 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.844108    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/494e80cf-e7f9-44bf-964d-58130567f5b7-openshift-service-ca\") pod \"494e80cf-e7f9-44bf-964d-58130567f5b7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") "
Sep 16 18:53:07.844233 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.844187    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-metrics-certs\") pod \"494e80cf-e7f9-44bf-964d-58130567f5b7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") "
Sep 16 18:53:07.844418 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.844391    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-maas-api-tls\") pod \"494e80cf-e7f9-44bf-964d-58130567f5b7\" (UID: \"494e80cf-e7f9-44bf-964d-58130567f5b7\") "
Sep 16 18:53:07.844576 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.844546    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/494e80cf-e7f9-44bf-964d-58130567f5b7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "494e80cf-e7f9-44bf-964d-58130567f5b7" (UID: "494e80cf-e7f9-44bf-964d-58130567f5b7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:53:07.844780 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.844761    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/494e80cf-e7f9-44bf-964d-58130567f5b7-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:07.846404 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.846352    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "494e80cf-e7f9-44bf-964d-58130567f5b7" (UID: "494e80cf-e7f9-44bf-964d-58130567f5b7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:53:07.846404 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.846394    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/494e80cf-e7f9-44bf-964d-58130567f5b7-kube-api-access-jkmjx" (OuterVolumeSpecName: "kube-api-access-jkmjx") pod "494e80cf-e7f9-44bf-964d-58130567f5b7" (UID: "494e80cf-e7f9-44bf-964d-58130567f5b7"). InnerVolumeSpecName "kube-api-access-jkmjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:53:07.846744 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.846725    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "494e80cf-e7f9-44bf-964d-58130567f5b7" (UID: "494e80cf-e7f9-44bf-964d-58130567f5b7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:53:07.902208 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.902172    2580 generic.go:356] "Generic (PLEG): container finished" podID="494e80cf-e7f9-44bf-964d-58130567f5b7" containerID="d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13" exitCode=0
Sep 16 18:53:07.902402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.902212    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"
Sep 16 18:53:07.902402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.902266    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7" event={"ID":"494e80cf-e7f9-44bf-964d-58130567f5b7","Type":"ContainerDied","Data":"d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13"}
Sep 16 18:53:07.902402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.902333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7" event={"ID":"494e80cf-e7f9-44bf-964d-58130567f5b7","Type":"ContainerDied","Data":"2689a1a21e0559564baf757dd420bd959e18bf912ea8c5b8ab0e10f7699d8c61"}
Sep 16 18:53:07.902402 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.902377    2580 scope.go:117] "RemoveContainer" containerID="d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13"
Sep 16 18:53:07.913152 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.913131    2580 scope.go:117] "RemoveContainer" containerID="d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13"
Sep 16 18:53:07.913484 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:53:07.913465    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13\": container with ID starting with d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13 not found: ID does not exist" containerID="d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13"
Sep 16 18:53:07.913564 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.913495    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13"} err="failed to get container status \"d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13\": rpc error: code = NotFound desc = could not find container \"d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13\": container with ID starting with d44bc93f4a11cb3bcd06c890615a7776d6f8266d24cd38cde2812536cc8b8e13 not found: ID does not exist"
Sep 16 18:53:07.920930 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.920902    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"]
Sep 16 18:53:07.923757 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.923733    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d3e8be-78dcc46b8c-p4pd7"]
Sep 16 18:53:07.945979 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.945948    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkmjx\" (UniqueName: \"kubernetes.io/projected/494e80cf-e7f9-44bf-964d-58130567f5b7-kube-api-access-jkmjx\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:07.945979 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.945977    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:07.946127 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:07.945991    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/494e80cf-e7f9-44bf-964d-58130567f5b7-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:09.866753 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:09.866721    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="494e80cf-e7f9-44bf-964d-58130567f5b7" path="/var/lib/kubelet/pods/494e80cf-e7f9-44bf-964d-58130567f5b7/volumes"
Sep 16 18:53:14.967659 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:14.967616    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"]
Sep 16 18:53:14.968113 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:14.967887    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerName="istio-proxy" containerID="cri-o://332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5" gracePeriod=30
Sep 16 18:53:18.931334 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:18.931295    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-qr7tb"]
Sep 16 18:53:18.932271 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:18.932220    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f8c84ff76-qr7tb" podUID="10d01e5b-dc13-4a6e-a0dc-9093f6c7212f" containerName="manager" containerID="cri-o://a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a" gracePeriod=30
Sep 16 18:53:19.162490 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.162466    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:53:19.243286 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.243216    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxhmm\" (UniqueName: \"kubernetes.io/projected/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-kube-api-access-jxhmm\") pod \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") "
Sep 16 18:53:19.243286 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.243281    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-metrics-certs\") pod \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") "
Sep 16 18:53:19.243480 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.243351    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-webhook-cert\") pod \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\" (UID: \"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f\") "
Sep 16 18:53:19.245291 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.245261    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "10d01e5b-dc13-4a6e-a0dc-9093f6c7212f" (UID: "10d01e5b-dc13-4a6e-a0dc-9093f6c7212f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:53:19.245291 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.245261    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-kube-api-access-jxhmm" (OuterVolumeSpecName: "kube-api-access-jxhmm") pod "10d01e5b-dc13-4a6e-a0dc-9093f6c7212f" (UID: "10d01e5b-dc13-4a6e-a0dc-9093f6c7212f"). InnerVolumeSpecName "kube-api-access-jxhmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:53:19.245469 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.245330    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "10d01e5b-dc13-4a6e-a0dc-9093f6c7212f" (UID: "10d01e5b-dc13-4a6e-a0dc-9093f6c7212f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:53:19.343960 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.343930    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:19.343960 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.343954    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-webhook-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:19.343960 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.343965    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxhmm\" (UniqueName: \"kubernetes.io/projected/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f-kube-api-access-jxhmm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:19.969716 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.969684    2580 generic.go:356] "Generic (PLEG): container finished" podID="10d01e5b-dc13-4a6e-a0dc-9093f6c7212f" containerID="a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a" exitCode=0
Sep 16 18:53:19.970162 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.969724    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f8c84ff76-qr7tb"
Sep 16 18:53:19.970162 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.969769    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f8c84ff76-qr7tb" event={"ID":"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f","Type":"ContainerDied","Data":"a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a"}
Sep 16 18:53:19.970162 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.969829    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f8c84ff76-qr7tb" event={"ID":"10d01e5b-dc13-4a6e-a0dc-9093f6c7212f","Type":"ContainerDied","Data":"bf947fa02aae0543dab8693e2e926b4d4d64a1bb62d724e1a670e0c2ecb63de2"}
Sep 16 18:53:19.970162 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.969863    2580 scope.go:117] "RemoveContainer" containerID="a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a"
Sep 16 18:53:19.980130 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.980113    2580 scope.go:117] "RemoveContainer" containerID="a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a"
Sep 16 18:53:19.980413 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:53:19.980391    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a\": container with ID starting with a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a not found: ID does not exist" containerID="a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a"
Sep 16 18:53:19.980499 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.980419    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a"} err="failed to get container status \"a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a\": rpc error: code = NotFound desc = could not find container \"a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a\": container with ID starting with a60a9d0e0371e2026be6e7d5876bbd5f0ddf8826ed70a4097c352325cd456f5a not found: ID does not exist"
Sep 16 18:53:19.986469 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.986442    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-qr7tb"]
Sep 16 18:53:19.990381 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:19.990349    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-qr7tb"]
Sep 16 18:53:20.213525 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.213500    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:53:20.252027 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252002    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-data\") pod \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") "
Sep 16 18:53:20.252189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252032    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-credential-socket\") pod \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") "
Sep 16 18:53:20.252189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252068    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-workload-certs\") pod \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") "
Sep 16 18:53:20.252189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252103    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-envoy\") pod \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") "
Sep 16 18:53:20.252189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252123    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98tcq\" (UniqueName: \"kubernetes.io/projected/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-kube-api-access-98tcq\") pod \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") "
Sep 16 18:53:20.252189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252156    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istiod-ca-cert\") pod \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") "
Sep 16 18:53:20.252189 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252181    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-workload-socket\") pod \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") "
Sep 16 18:53:20.252545 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252211    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-token\") pod \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") "
Sep 16 18:53:20.252545 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252236    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-podinfo\") pod \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\" (UID: \"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c\") "
Sep 16 18:53:20.252545 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252281    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" (UID: "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:53:20.252545 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252292    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-data" (OuterVolumeSpecName: "istio-data") pod "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" (UID: "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:53:20.252545 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252352    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" (UID: "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:53:20.252545 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252528    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" (UID: "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:53:20.252808 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252559    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-data\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:20.252808 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252582    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-credential-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:20.252808 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252596    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-workload-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:20.252808 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.252696    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" (UID: "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:53:20.254539 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.254508    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" (UID: "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:53:20.254711 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.254611    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-kube-api-access-98tcq" (OuterVolumeSpecName: "kube-api-access-98tcq") pod "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" (UID: "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c"). InnerVolumeSpecName "kube-api-access-98tcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:53:20.254839 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.254750    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" (UID: "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:53:20.254839 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.254764    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-token" (OuterVolumeSpecName: "istio-token") pod "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" (UID: "55f1bd05-e6bd-48a0-b0ae-134adbe76a8c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:53:20.353038 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.353004    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-envoy\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:20.353038 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.353031    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98tcq\" (UniqueName: \"kubernetes.io/projected/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-kube-api-access-98tcq\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:20.353038 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.353041    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istiod-ca-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:20.353261 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.353050    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-workload-socket\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:20.353261 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.353057    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-token\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:20.353261 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.353065    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c-istio-podinfo\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:53:20.977333 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.977298    2580 generic.go:356] "Generic (PLEG): container finished" podID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerID="332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5" exitCode=0
Sep 16 18:53:20.977824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.977342    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"
Sep 16 18:53:20.977824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.977345    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" event={"ID":"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c","Type":"ContainerDied","Data":"332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5"}
Sep 16 18:53:20.977824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.977437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s" event={"ID":"55f1bd05-e6bd-48a0-b0ae-134adbe76a8c","Type":"ContainerDied","Data":"aea95b476074d11b9ac3280753bf059ae09ba8e06c7e4f329c98989d694c040a"}
Sep 16 18:53:20.977824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.977476    2580 scope.go:117] "RemoveContainer" containerID="332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5"
Sep 16 18:53:20.988530 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.988512    2580 scope.go:117] "RemoveContainer" containerID="1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552"
Sep 16 18:53:20.997758 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.997732    2580 scope.go:117] "RemoveContainer" containerID="332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5"
Sep 16 18:53:20.998032 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:53:20.998012    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5\": container with ID starting with 332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5 not found: ID does not exist" containerID="332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5"
Sep 16 18:53:20.998090 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.998040    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5"} err="failed to get container status \"332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5\": rpc error: code = NotFound desc = could not find container \"332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5\": container with ID starting with 332330ff0a6ac9d07fc5caaf9fc3ad22f938c0369cfadbf224e994d339bd74c5 not found: ID does not exist"
Sep 16 18:53:20.998090 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.998054    2580 scope.go:117] "RemoveContainer" containerID="1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552"
Sep 16 18:53:20.998352 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:53:20.998335    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552\": container with ID starting with 1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552 not found: ID does not exist" containerID="1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552"
Sep 16 18:53:20.998443 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.998360    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552"} err="failed to get container status \"1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552\": rpc error: code = NotFound desc = could not find container \"1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552\": container with ID starting with 1fe47353032f8c3d3391e50039690d58d7c8ceef288767afc5f419f41a647552 not found: ID does not exist"
Sep 16 18:53:20.999387 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:20.999349    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"]
Sep 16 18:53:21.003416 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:21.003397    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d3e8be-openshift-default-dd46d8db4-d2j6s"]
Sep 16 18:53:21.866712 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:21.866679    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d01e5b-dc13-4a6e-a0dc-9093f6c7212f" path="/var/lib/kubelet/pods/10d01e5b-dc13-4a6e-a0dc-9093f6c7212f/volumes"
Sep 16 18:53:21.867138 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:21.867117    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" path="/var/lib/kubelet/pods/55f1bd05-e6bd-48a0-b0ae-134adbe76a8c/volumes"
Sep 16 18:53:22.173294 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:53:22.169489    2580 scope.go:117] "RemoveContainer" containerID="48d1bc9c7f36949bec5e60b648fcad42eabca7fa23467c188fd8576a82f6c48f"
Sep 16 18:54:20.833046 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833014    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-5sd9h"]
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833328    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerName="istio-proxy"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833339    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerName="istio-proxy"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833349    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833355    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833362    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerName="istio-proxy"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833383    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerName="istio-proxy"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833393    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833400    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833412    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833420    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833434    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="494e80cf-e7f9-44bf-964d-58130567f5b7" containerName="maas-api"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833439    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="494e80cf-e7f9-44bf-964d-58130567f5b7" containerName="maas-api"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833447    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb69388-3740-4e13-a3df-91f526e28df3" containerName="maas-api"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833451    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb69388-3740-4e13-a3df-91f526e28df3" containerName="maas-api"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833458    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d01e5b-dc13-4a6e-a0dc-9093f6c7212f" containerName="manager"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833463    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d01e5b-dc13-4a6e-a0dc-9093f6c7212f" containerName="manager"
Sep 16 18:54:20.833518 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833526    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d01e5b-dc13-4a6e-a0dc-9093f6c7212f" containerName="manager"
Sep 16 18:54:20.834022 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833533    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerName="istio-proxy"
Sep 16 18:54:20.834022 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833539    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy"
Sep 16 18:54:20.834022 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833544    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy"
Sep 16 18:54:20.834022 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833552    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy"
Sep 16 18:54:20.834022 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833558    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="55f1bd05-e6bd-48a0-b0ae-134adbe76a8c" containerName="istio-proxy"
Sep 16 18:54:20.834022 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833565    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy"
Sep 16 18:54:20.834022 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833570    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy"
Sep 16 18:54:20.834022 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833575    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="494e80cf-e7f9-44bf-964d-58130567f5b7" containerName="maas-api"
Sep 16 18:54:20.834022 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833581    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fb69388-3740-4e13-a3df-91f526e28df3" containerName="maas-api"
Sep 16 18:54:20.834022 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.833585    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy"
Sep 16 18:54:20.836291 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.836263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:20.839485 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.839462    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 18:54:20.839612 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.839488    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 18:54:20.839612 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.839559    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 18:54:20.839612 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.839465    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qfs4j\""
Sep 16 18:54:20.846234 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.846214    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-5sd9h"]
Sep 16 18:54:20.864091 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.864056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800fabcf-7f8b-418c-a68f-7552e2dedb29-webhook-cert\") pod \"maas-controller-5f8c84ff76-5sd9h\" (UID: \"800fabcf-7f8b-418c-a68f-7552e2dedb29\") " pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:20.864217 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.864123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/800fabcf-7f8b-418c-a68f-7552e2dedb29-metrics-certs\") pod \"maas-controller-5f8c84ff76-5sd9h\" (UID: \"800fabcf-7f8b-418c-a68f-7552e2dedb29\") " pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:20.864217 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.864194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7cld\" (UniqueName: \"kubernetes.io/projected/800fabcf-7f8b-418c-a68f-7552e2dedb29-kube-api-access-w7cld\") pod \"maas-controller-5f8c84ff76-5sd9h\" (UID: \"800fabcf-7f8b-418c-a68f-7552e2dedb29\") " pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:20.965146 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.965104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7cld\" (UniqueName: \"kubernetes.io/projected/800fabcf-7f8b-418c-a68f-7552e2dedb29-kube-api-access-w7cld\") pod \"maas-controller-5f8c84ff76-5sd9h\" (UID: \"800fabcf-7f8b-418c-a68f-7552e2dedb29\") " pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:20.965337 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.965180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800fabcf-7f8b-418c-a68f-7552e2dedb29-webhook-cert\") pod \"maas-controller-5f8c84ff76-5sd9h\" (UID: \"800fabcf-7f8b-418c-a68f-7552e2dedb29\") " pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:20.965337 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.965215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/800fabcf-7f8b-418c-a68f-7552e2dedb29-metrics-certs\") pod \"maas-controller-5f8c84ff76-5sd9h\" (UID: \"800fabcf-7f8b-418c-a68f-7552e2dedb29\") " pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:20.967670 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.967642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800fabcf-7f8b-418c-a68f-7552e2dedb29-webhook-cert\") pod \"maas-controller-5f8c84ff76-5sd9h\" (UID: \"800fabcf-7f8b-418c-a68f-7552e2dedb29\") " pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:20.967782 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.967762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/800fabcf-7f8b-418c-a68f-7552e2dedb29-metrics-certs\") pod \"maas-controller-5f8c84ff76-5sd9h\" (UID: \"800fabcf-7f8b-418c-a68f-7552e2dedb29\") " pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:20.980325 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:20.980298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7cld\" (UniqueName: \"kubernetes.io/projected/800fabcf-7f8b-418c-a68f-7552e2dedb29-kube-api-access-w7cld\") pod \"maas-controller-5f8c84ff76-5sd9h\" (UID: \"800fabcf-7f8b-418c-a68f-7552e2dedb29\") " pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:21.148169 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:21.148090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:21.419555 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:21.419529    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-5sd9h"]
Sep 16 18:54:21.421032 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:54:21.421005    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800fabcf_7f8b_418c_a68f_7552e2dedb29.slice/crio-71ba629d47da1268fa83b1f068c38ac93d8b61e4bdb1b1cc8e3e18897f21b02c WatchSource:0}: Error finding container 71ba629d47da1268fa83b1f068c38ac93d8b61e4bdb1b1cc8e3e18897f21b02c: Status 404 returned error can't find the container with id 71ba629d47da1268fa83b1f068c38ac93d8b61e4bdb1b1cc8e3e18897f21b02c
Sep 16 18:54:21.919236 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:21.919217    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 18:54:22.292260 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:22.292170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f8c84ff76-5sd9h" event={"ID":"800fabcf-7f8b-418c-a68f-7552e2dedb29","Type":"ContainerStarted","Data":"3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440"}
Sep 16 18:54:22.292260 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:22.292227    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f8c84ff76-5sd9h" event={"ID":"800fabcf-7f8b-418c-a68f-7552e2dedb29","Type":"ContainerStarted","Data":"71ba629d47da1268fa83b1f068c38ac93d8b61e4bdb1b1cc8e3e18897f21b02c"}
Sep 16 18:54:22.292260 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:22.292256    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:22.309223 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:22.309150    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f8c84ff76-5sd9h" podStartSLOduration=1.8147240930000001 podStartE2EDuration="2.309123278s" totalImagesPullingTime="494.399185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:54:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:54:22.308942019 +0000 UTC m=+2280.951968060" watchObservedRunningTime="2026-09-16 18:54:22.309123278 +0000 UTC m=+2280.952149318"
Sep 16 18:54:33.305409 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:33.305377    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:40.507922 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:40.507889    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-5sd9h"]
Sep 16 18:54:40.508410 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:40.508085    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f8c84ff76-5sd9h" podUID="800fabcf-7f8b-418c-a68f-7552e2dedb29" containerName="manager" containerID="cri-o://3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440" gracePeriod=30
Sep 16 18:54:40.744540 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:40.744517    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:40.829724 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:40.829649    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7cld\" (UniqueName: \"kubernetes.io/projected/800fabcf-7f8b-418c-a68f-7552e2dedb29-kube-api-access-w7cld\") pod \"800fabcf-7f8b-418c-a68f-7552e2dedb29\" (UID: \"800fabcf-7f8b-418c-a68f-7552e2dedb29\") "
Sep 16 18:54:40.829867 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:40.829731    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/800fabcf-7f8b-418c-a68f-7552e2dedb29-metrics-certs\") pod \"800fabcf-7f8b-418c-a68f-7552e2dedb29\" (UID: \"800fabcf-7f8b-418c-a68f-7552e2dedb29\") "
Sep 16 18:54:40.829867 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:40.829758    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800fabcf-7f8b-418c-a68f-7552e2dedb29-webhook-cert\") pod \"800fabcf-7f8b-418c-a68f-7552e2dedb29\" (UID: \"800fabcf-7f8b-418c-a68f-7552e2dedb29\") "
Sep 16 18:54:40.831627 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:40.831597    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/800fabcf-7f8b-418c-a68f-7552e2dedb29-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "800fabcf-7f8b-418c-a68f-7552e2dedb29" (UID: "800fabcf-7f8b-418c-a68f-7552e2dedb29"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:54:40.831761 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:40.831685    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/800fabcf-7f8b-418c-a68f-7552e2dedb29-kube-api-access-w7cld" (OuterVolumeSpecName: "kube-api-access-w7cld") pod "800fabcf-7f8b-418c-a68f-7552e2dedb29" (UID: "800fabcf-7f8b-418c-a68f-7552e2dedb29"). InnerVolumeSpecName "kube-api-access-w7cld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:54:40.831761 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:40.831704    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/800fabcf-7f8b-418c-a68f-7552e2dedb29-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "800fabcf-7f8b-418c-a68f-7552e2dedb29" (UID: "800fabcf-7f8b-418c-a68f-7552e2dedb29"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:54:40.930960 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:40.930932    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800fabcf-7f8b-418c-a68f-7552e2dedb29-webhook-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:54:40.930960 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:40.930958    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7cld\" (UniqueName: \"kubernetes.io/projected/800fabcf-7f8b-418c-a68f-7552e2dedb29-kube-api-access-w7cld\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:54:40.931146 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:40.930968    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/800fabcf-7f8b-418c-a68f-7552e2dedb29-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:54:41.393903 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:41.393868    2580 generic.go:356] "Generic (PLEG): container finished" podID="800fabcf-7f8b-418c-a68f-7552e2dedb29" containerID="3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440" exitCode=0
Sep 16 18:54:41.394108 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:41.393911    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f8c84ff76-5sd9h"
Sep 16 18:54:41.394108 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:41.393951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f8c84ff76-5sd9h" event={"ID":"800fabcf-7f8b-418c-a68f-7552e2dedb29","Type":"ContainerDied","Data":"3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440"}
Sep 16 18:54:41.394108 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:41.394007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f8c84ff76-5sd9h" event={"ID":"800fabcf-7f8b-418c-a68f-7552e2dedb29","Type":"ContainerDied","Data":"71ba629d47da1268fa83b1f068c38ac93d8b61e4bdb1b1cc8e3e18897f21b02c"}
Sep 16 18:54:41.394108 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:41.394036    2580 scope.go:117] "RemoveContainer" containerID="3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440"
Sep 16 18:54:41.404993 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:41.404973    2580 scope.go:117] "RemoveContainer" containerID="3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440"
Sep 16 18:54:41.405460 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:54:41.405438    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440\": container with ID starting with 3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440 not found: ID does not exist" containerID="3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440"
Sep 16 18:54:41.405530 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:41.405469    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440"} err="failed to get container status \"3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440\": rpc error: code = NotFound desc = could not find container \"3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440\": container with ID starting with 3923420a976724b72f35fa15d7398723c9c3a08e6c579c38ffca184c7185a440 not found: ID does not exist"
Sep 16 18:54:41.418977 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:41.418945    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-5sd9h"]
Sep 16 18:54:41.427251 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:41.427229    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-5sd9h"]
Sep 16 18:54:41.869027 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:41.868983    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="800fabcf-7f8b-418c-a68f-7552e2dedb29" path="/var/lib/kubelet/pods/800fabcf-7f8b-418c-a68f-7552e2dedb29/volumes"
Sep 16 18:54:42.403460 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.403426    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-4cz6w"]
Sep 16 18:54:42.403752 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.403739    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy"
Sep 16 18:54:42.403792 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.403753    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="846ff291-7d6c-496e-959c-1ee3c3f54ab2" containerName="istio-proxy"
Sep 16 18:54:42.403792 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.403762    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy"
Sep 16 18:54:42.403792 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.403768    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a19c4dae-940b-4159-aeec-1cf2281e479b" containerName="istio-proxy"
Sep 16 18:54:42.403792 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.403776    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy"
Sep 16 18:54:42.403792 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.403781    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0904a237-32c3-4d88-b8b6-a3883dfb4dc0" containerName="istio-proxy"
Sep 16 18:54:42.403792 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.403793    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="800fabcf-7f8b-418c-a68f-7552e2dedb29" containerName="manager"
Sep 16 18:54:42.403973 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.403798    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="800fabcf-7f8b-418c-a68f-7552e2dedb29" containerName="manager"
Sep 16 18:54:42.403973 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.403846    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="800fabcf-7f8b-418c-a68f-7552e2dedb29" containerName="manager"
Sep 16 18:54:42.407931 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.407909    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:54:42.411047 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.411025    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 18:54:42.411047 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.411037    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 18:54:42.411217 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.411039    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 18:54:42.411217 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.411025    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qfs4j\""
Sep 16 18:54:42.416381 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.416348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-4cz6w"]
Sep 16 18:54:42.542229 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.542195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgwlx\" (UniqueName: \"kubernetes.io/projected/584d2899-44b5-4e6e-ab5d-1140e115a2e4-kube-api-access-vgwlx\") pod \"maas-controller-5f8c84ff76-4cz6w\" (UID: \"584d2899-44b5-4e6e-ab5d-1140e115a2e4\") " pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:54:42.542459 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.542257    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/584d2899-44b5-4e6e-ab5d-1140e115a2e4-webhook-cert\") pod \"maas-controller-5f8c84ff76-4cz6w\" (UID: \"584d2899-44b5-4e6e-ab5d-1140e115a2e4\") " pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:54:42.542459 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.542316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/584d2899-44b5-4e6e-ab5d-1140e115a2e4-metrics-certs\") pod \"maas-controller-5f8c84ff76-4cz6w\" (UID: \"584d2899-44b5-4e6e-ab5d-1140e115a2e4\") " pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:54:42.643827 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.643789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgwlx\" (UniqueName: \"kubernetes.io/projected/584d2899-44b5-4e6e-ab5d-1140e115a2e4-kube-api-access-vgwlx\") pod \"maas-controller-5f8c84ff76-4cz6w\" (UID: \"584d2899-44b5-4e6e-ab5d-1140e115a2e4\") " pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:54:42.643987 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.643939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/584d2899-44b5-4e6e-ab5d-1140e115a2e4-webhook-cert\") pod \"maas-controller-5f8c84ff76-4cz6w\" (UID: \"584d2899-44b5-4e6e-ab5d-1140e115a2e4\") " pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:54:42.643987 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.643975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/584d2899-44b5-4e6e-ab5d-1140e115a2e4-metrics-certs\") pod \"maas-controller-5f8c84ff76-4cz6w\" (UID: \"584d2899-44b5-4e6e-ab5d-1140e115a2e4\") " pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:54:42.646327 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.646303    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/584d2899-44b5-4e6e-ab5d-1140e115a2e4-metrics-certs\") pod \"maas-controller-5f8c84ff76-4cz6w\" (UID: \"584d2899-44b5-4e6e-ab5d-1140e115a2e4\") " pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:54:42.646477 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.646418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/584d2899-44b5-4e6e-ab5d-1140e115a2e4-webhook-cert\") pod \"maas-controller-5f8c84ff76-4cz6w\" (UID: \"584d2899-44b5-4e6e-ab5d-1140e115a2e4\") " pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:54:42.651243 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.651220    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgwlx\" (UniqueName: \"kubernetes.io/projected/584d2899-44b5-4e6e-ab5d-1140e115a2e4-kube-api-access-vgwlx\") pod \"maas-controller-5f8c84ff76-4cz6w\" (UID: \"584d2899-44b5-4e6e-ab5d-1140e115a2e4\") " pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:54:42.718593 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.718506    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:54:42.991607 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:42.991405    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f8c84ff76-4cz6w"]
Sep 16 18:54:42.994137 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:54:42.994108    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod584d2899_44b5_4e6e_ab5d_1140e115a2e4.slice/crio-1add2d51b4cff6777387c2c7fe8453c3d55249833fff55254622a64a2976f160 WatchSource:0}: Error finding container 1add2d51b4cff6777387c2c7fe8453c3d55249833fff55254622a64a2976f160: Status 404 returned error can't find the container with id 1add2d51b4cff6777387c2c7fe8453c3d55249833fff55254622a64a2976f160
Sep 16 18:54:43.407422 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:43.407393    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f8c84ff76-4cz6w" event={"ID":"584d2899-44b5-4e6e-ab5d-1140e115a2e4","Type":"ContainerStarted","Data":"1add2d51b4cff6777387c2c7fe8453c3d55249833fff55254622a64a2976f160"}
Sep 16 18:54:44.414342 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:44.414310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f8c84ff76-4cz6w" event={"ID":"584d2899-44b5-4e6e-ab5d-1140e115a2e4","Type":"ContainerStarted","Data":"34b642ccdfc2139f3cb3033d381ba467e737213fdaaed477803ce8847a1af01c"}
Sep 16 18:54:44.414747 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:44.414409    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:54:44.434247 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:44.434198    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f8c84ff76-4cz6w" podStartSLOduration=2.056247272 podStartE2EDuration="2.434182041s" totalImagesPullingTime="377.934769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:54:44.432066049 +0000 UTC m=+2303.075092088" watchObservedRunningTime="2026-09-16 18:54:44.434182041 +0000 UTC m=+2303.077208081"
Sep 16 18:54:55.422130 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:54:55.422096    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f8c84ff76-4cz6w"
Sep 16 18:58:22.331128 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.331049    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"]
Sep 16 18:58:22.334095 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.334077    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.348317 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.348292    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"]
Sep 16 18:58:22.400779 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.400748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3acb3d6e-28b7-433f-9fdf-3790bf42e749-maas-api-tls\") pod \"maas-api-7589f5744d-tpwpx\" (UID: \"3acb3d6e-28b7-433f-9fdf-3790bf42e749\") " pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.400931 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.400800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml6fd\" (UniqueName: \"kubernetes.io/projected/3acb3d6e-28b7-433f-9fdf-3790bf42e749-kube-api-access-ml6fd\") pod \"maas-api-7589f5744d-tpwpx\" (UID: \"3acb3d6e-28b7-433f-9fdf-3790bf42e749\") " pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.400931 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.400864    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3acb3d6e-28b7-433f-9fdf-3790bf42e749-openshift-service-ca\") pod \"maas-api-7589f5744d-tpwpx\" (UID: \"3acb3d6e-28b7-433f-9fdf-3790bf42e749\") " pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.400931 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.400925    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3acb3d6e-28b7-433f-9fdf-3790bf42e749-metrics-certs\") pod \"maas-api-7589f5744d-tpwpx\" (UID: \"3acb3d6e-28b7-433f-9fdf-3790bf42e749\") " pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.502220 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.502191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3acb3d6e-28b7-433f-9fdf-3790bf42e749-openshift-service-ca\") pod \"maas-api-7589f5744d-tpwpx\" (UID: \"3acb3d6e-28b7-433f-9fdf-3790bf42e749\") " pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.502425 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.502237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3acb3d6e-28b7-433f-9fdf-3790bf42e749-metrics-certs\") pod \"maas-api-7589f5744d-tpwpx\" (UID: \"3acb3d6e-28b7-433f-9fdf-3790bf42e749\") " pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.502425 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.502302    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3acb3d6e-28b7-433f-9fdf-3790bf42e749-maas-api-tls\") pod \"maas-api-7589f5744d-tpwpx\" (UID: \"3acb3d6e-28b7-433f-9fdf-3790bf42e749\") " pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.502556 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.502445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6fd\" (UniqueName: \"kubernetes.io/projected/3acb3d6e-28b7-433f-9fdf-3790bf42e749-kube-api-access-ml6fd\") pod \"maas-api-7589f5744d-tpwpx\" (UID: \"3acb3d6e-28b7-433f-9fdf-3790bf42e749\") " pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.502961 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.502940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3acb3d6e-28b7-433f-9fdf-3790bf42e749-openshift-service-ca\") pod \"maas-api-7589f5744d-tpwpx\" (UID: \"3acb3d6e-28b7-433f-9fdf-3790bf42e749\") " pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.504685 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.504659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3acb3d6e-28b7-433f-9fdf-3790bf42e749-maas-api-tls\") pod \"maas-api-7589f5744d-tpwpx\" (UID: \"3acb3d6e-28b7-433f-9fdf-3790bf42e749\") " pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.504775 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.504709    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3acb3d6e-28b7-433f-9fdf-3790bf42e749-metrics-certs\") pod \"maas-api-7589f5744d-tpwpx\" (UID: \"3acb3d6e-28b7-433f-9fdf-3790bf42e749\") " pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.511612 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.511587    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml6fd\" (UniqueName: \"kubernetes.io/projected/3acb3d6e-28b7-433f-9fdf-3790bf42e749-kube-api-access-ml6fd\") pod \"maas-api-7589f5744d-tpwpx\" (UID: \"3acb3d6e-28b7-433f-9fdf-3790bf42e749\") " pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.644195 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.644161    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:22.935467 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.933551    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"]
Sep 16 18:58:22.936716 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:22.936693    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:58:23.503447 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:23.503409    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx" event={"ID":"3acb3d6e-28b7-433f-9fdf-3790bf42e749","Type":"ContainerStarted","Data":"e917d24de6eae507a8888ee623622908da30572f8ebae951d6d4359bd3bc5ec5"}
Sep 16 18:58:23.503823 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:23.503465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx" event={"ID":"3acb3d6e-28b7-433f-9fdf-3790bf42e749","Type":"ContainerStarted","Data":"ad5d5102c394c80a537b1f3c8243a98327600d67b7887745d3cc2e3014233fc0"}
Sep 16 18:58:23.503823 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:23.503527    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:23.523594 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:23.523546    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx" podStartSLOduration=1.123265399 podStartE2EDuration="1.523530102s" totalImagesPullingTime="400.264703ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:58:23.520795974 +0000 UTC m=+2522.163822043" watchObservedRunningTime="2026-09-16 18:58:23.523530102 +0000 UTC m=+2522.166556139"
Sep 16 18:58:29.513864 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:29.513837    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7589f5744d-tpwpx"
Sep 16 18:58:37.347124 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:37.347087    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"]
Sep 16 18:58:37.347570 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:37.347273    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5" podUID="207c9e1e-531d-45a9-adb3-5b1de58bb261" containerName="maas-api" containerID="cri-o://90d5f5edabf26f9bcd44e0bc718bf5c2ebb351d9501502b399c1850447037e9c" gracePeriod=30
Sep 16 18:58:38.581094 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.581058    2580 generic.go:356] "Generic (PLEG): container finished" podID="207c9e1e-531d-45a9-adb3-5b1de58bb261" containerID="90d5f5edabf26f9bcd44e0bc718bf5c2ebb351d9501502b399c1850447037e9c" exitCode=0
Sep 16 18:58:38.581441 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.581096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5" event={"ID":"207c9e1e-531d-45a9-adb3-5b1de58bb261","Type":"ContainerDied","Data":"90d5f5edabf26f9bcd44e0bc718bf5c2ebb351d9501502b399c1850447037e9c"}
Sep 16 18:58:38.581441 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.581149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5" event={"ID":"207c9e1e-531d-45a9-adb3-5b1de58bb261","Type":"ContainerDied","Data":"8ba32d7c379cd0a40eb117b5fe31d7de748a868cdc6e7e131f5e1893067ac1a7"}
Sep 16 18:58:38.581441 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.581164    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ba32d7c379cd0a40eb117b5fe31d7de748a868cdc6e7e131f5e1893067ac1a7"
Sep 16 18:58:38.586396 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.586379    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:58:38.746587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.746477    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/207c9e1e-531d-45a9-adb3-5b1de58bb261-metrics-certs\") pod \"207c9e1e-531d-45a9-adb3-5b1de58bb261\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") "
Sep 16 18:58:38.746587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.746541    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/207c9e1e-531d-45a9-adb3-5b1de58bb261-openshift-service-ca\") pod \"207c9e1e-531d-45a9-adb3-5b1de58bb261\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") "
Sep 16 18:58:38.746587 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.746571    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w75tm\" (UniqueName: \"kubernetes.io/projected/207c9e1e-531d-45a9-adb3-5b1de58bb261-kube-api-access-w75tm\") pod \"207c9e1e-531d-45a9-adb3-5b1de58bb261\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") "
Sep 16 18:58:38.746883 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.746644    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/207c9e1e-531d-45a9-adb3-5b1de58bb261-maas-api-tls\") pod \"207c9e1e-531d-45a9-adb3-5b1de58bb261\" (UID: \"207c9e1e-531d-45a9-adb3-5b1de58bb261\") "
Sep 16 18:58:38.746996 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.746951    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/207c9e1e-531d-45a9-adb3-5b1de58bb261-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "207c9e1e-531d-45a9-adb3-5b1de58bb261" (UID: "207c9e1e-531d-45a9-adb3-5b1de58bb261"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:58:38.748980 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.748956    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/207c9e1e-531d-45a9-adb3-5b1de58bb261-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "207c9e1e-531d-45a9-adb3-5b1de58bb261" (UID: "207c9e1e-531d-45a9-adb3-5b1de58bb261"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:58:38.749117 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.749093    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/207c9e1e-531d-45a9-adb3-5b1de58bb261-kube-api-access-w75tm" (OuterVolumeSpecName: "kube-api-access-w75tm") pod "207c9e1e-531d-45a9-adb3-5b1de58bb261" (UID: "207c9e1e-531d-45a9-adb3-5b1de58bb261"). InnerVolumeSpecName "kube-api-access-w75tm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:58:38.749269 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.749246    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/207c9e1e-531d-45a9-adb3-5b1de58bb261-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "207c9e1e-531d-45a9-adb3-5b1de58bb261" (UID: "207c9e1e-531d-45a9-adb3-5b1de58bb261"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:58:38.847793 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.847762    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/207c9e1e-531d-45a9-adb3-5b1de58bb261-openshift-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:58:38.847793 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.847787    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w75tm\" (UniqueName: \"kubernetes.io/projected/207c9e1e-531d-45a9-adb3-5b1de58bb261-kube-api-access-w75tm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:58:38.847793 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.847796    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/207c9e1e-531d-45a9-adb3-5b1de58bb261-maas-api-tls\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:58:38.848019 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:38.847805    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/207c9e1e-531d-45a9-adb3-5b1de58bb261-metrics-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Sep 16 18:58:39.586515 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:39.586483    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"
Sep 16 18:58:39.619674 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:39.619643    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"]
Sep 16 18:58:39.636436 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:39.636413    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-b66c78b8-l6wz5"]
Sep 16 18:58:39.866513 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:58:39.866434    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="207c9e1e-531d-45a9-adb3-5b1de58bb261" path="/var/lib/kubelet/pods/207c9e1e-531d-45a9-adb3-5b1de58bb261/volumes"
Sep 16 18:59:00.676699 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:00.676662    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f8c84ff76-4cz6w_584d2899-44b5-4e6e-ab5d-1140e115a2e4/manager/0.log"
Sep 16 18:59:01.201844 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:01.201815    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bdbbf975-sf28v_cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914/copy-manifests/0.log"
Sep 16 18:59:01.218215 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:01.218187    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bdbbf975-sf28v_cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914/manager/0.log"
Sep 16 18:59:01.682524 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:01.682500    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7589f5744d-tpwpx_3acb3d6e-28b7-433f-9fdf-3790bf42e749/maas-api/0.log"
Sep 16 18:59:03.149421 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:03.149379    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-sldz6_f86ca5fc-24df-473e-a5e7-05b4333477ed/manager/0.log"
Sep 16 18:59:03.886851 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:03.886817    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-529z4_55fe1f9f-d650-4d58-88e2-dfcd09b50818/manager/0.log"
Sep 16 18:59:04.273612 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:04.273533    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5_e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb/istio-proxy/0.log"
Sep 16 18:59:04.443531 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:04.443504    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q7rrf_99c71921-fe9c-44ca-bf07-019ffffc863d/discovery/0.log"
Sep 16 18:59:04.565631 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:04.565550    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d9c67857d-2d8t2_2b228b11-1b24-4cb5-ac9c-e692a7987194/kube-auth-proxy/0.log"
Sep 16 18:59:04.819477 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:04.819395    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l8h2n_8efaa52c-c1c3-4735-8106-c2f98a95b1a3/istio-proxy/1.log"
Sep 16 18:59:05.676935 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:05.676902    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hzrt4_e55edd0d-41e3-4f7f-8550-058b0b981415/main/0.log"
Sep 16 18:59:06.047180 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:06.047103    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6jbrf_fded7cab-f312-440a-9613-b66df666d506/main/0.log"
Sep 16 18:59:15.396693 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:15.396654    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vm6px_390d10d8-4834-4fd7-b1ce-1abd2943c8b4/global-pull-secret-syncer/0.log"
Sep 16 18:59:15.720096 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:15.720020    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pq9c5_b16330df-7050-44b6-acf9-326d07374804/konnectivity-agent/0.log"
Sep 16 18:59:15.761924 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:15.761878    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-4.ec2.internal_3855482ecf545e291be557b4f332fc2e/haproxy/0.log"
Sep 16 18:59:19.955727 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:19.955699    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-sldz6_f86ca5fc-24df-473e-a5e7-05b4333477ed/manager/0.log"
Sep 16 18:59:20.296618 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:20.296539    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-529z4_55fe1f9f-d650-4d58-88e2-dfcd09b50818/manager/0.log"
Sep 16 18:59:22.181326 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:22.181298    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-44q9j_bbdd6d73-7b95-466f-aa35-4f398daabb71/cluster-monitoring-operator/0.log"
Sep 16 18:59:22.251603 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:22.251573    2580 scope.go:117] "RemoveContainer" containerID="90d5f5edabf26f9bcd44e0bc718bf5c2ebb351d9501502b399c1850447037e9c"
Sep 16 18:59:22.381582 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:22.381554    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5c486fd4cc-nqwqp_a54b8156-5685-43bc-bc33-968f815208f0/metrics-server/0.log"
Sep 16 18:59:22.428824 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:22.428794    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-9tfkc_0bfbc0d2-8c69-4ea1-ba25-08fcfd89fe23/monitoring-plugin/0.log"
Sep 16 18:59:22.471920 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:22.471836    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wcgm_53144d48-3087-4763-9131-b11019278016/node-exporter/0.log"
Sep 16 18:59:22.504948 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:22.504918    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wcgm_53144d48-3087-4763-9131-b11019278016/kube-rbac-proxy/0.log"
Sep 16 18:59:22.530454 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:22.530428    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wcgm_53144d48-3087-4763-9131-b11019278016/init-textfile/0.log"
Sep 16 18:59:24.203418 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.203386    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"]
Sep 16 18:59:24.203791 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.203712    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="207c9e1e-531d-45a9-adb3-5b1de58bb261" containerName="maas-api"
Sep 16 18:59:24.203791 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.203723    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="207c9e1e-531d-45a9-adb3-5b1de58bb261" containerName="maas-api"
Sep 16 18:59:24.203791 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.203792    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="207c9e1e-531d-45a9-adb3-5b1de58bb261" containerName="maas-api"
Sep 16 18:59:24.208201 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.208183    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.213298 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:59:24.213263    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-must-gather-slrm4\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-slrm4\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 16 18:59:24.213599 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:59:24.213573    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-bzh68\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-must-gather-slrm4\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-slrm4\"/\"default-dockercfg-bzh68\"" type="*v1.Secret"
Sep 16 18:59:24.216762 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:59:24.216735    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"perf-node-gather-daemonset-vspsn\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-slrm4\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="0393c149-5b12-4da8-ad92-dd75716bac73" pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.216903 ip-10-0-130-4 kubenswrapper[2580]: E0916 18:59:24.216885    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-must-gather-slrm4\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-slrm4\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 16 18:59:24.227637 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.227610    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"]
Sep 16 18:59:24.335828 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.335787    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0393c149-5b12-4da8-ad92-dd75716bac73-podres\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.336016 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.335841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxlnh\" (UniqueName: \"kubernetes.io/projected/0393c149-5b12-4da8-ad92-dd75716bac73-kube-api-access-dxlnh\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.336016 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.335895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0393c149-5b12-4da8-ad92-dd75716bac73-sys\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.336016 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.335952    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0393c149-5b12-4da8-ad92-dd75716bac73-proc\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.336016 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.335977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0393c149-5b12-4da8-ad92-dd75716bac73-lib-modules\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.437110 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.437079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0393c149-5b12-4da8-ad92-dd75716bac73-podres\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.437272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.437120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxlnh\" (UniqueName: \"kubernetes.io/projected/0393c149-5b12-4da8-ad92-dd75716bac73-kube-api-access-dxlnh\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.437272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.437141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0393c149-5b12-4da8-ad92-dd75716bac73-sys\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.437272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.437179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0393c149-5b12-4da8-ad92-dd75716bac73-proc\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.437272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.437199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0393c149-5b12-4da8-ad92-dd75716bac73-lib-modules\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.437272 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.437243    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0393c149-5b12-4da8-ad92-dd75716bac73-podres\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.437583 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.437287    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0393c149-5b12-4da8-ad92-dd75716bac73-sys\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.437583 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.437302    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0393c149-5b12-4da8-ad92-dd75716bac73-proc\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:24.437583 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:24.437335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0393c149-5b12-4da8-ad92-dd75716bac73-lib-modules\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:25.052633 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:25.052605    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-x8cgn_546b63d9-01af-4c4c-89ec-3f0bff97b5f0/networking-console-plugin/0.log"
Sep 16 18:59:25.088950 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:25.088919    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-slrm4\"/\"default-dockercfg-bzh68\""
Sep 16 18:59:25.183042 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:25.183014    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-slrm4\"/\"kube-root-ca.crt\""
Sep 16 18:59:25.636603 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:25.636570    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-slrm4\"/\"openshift-service-ca.crt\""
Sep 16 18:59:25.641989 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:25.641958    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxlnh\" (UniqueName: \"kubernetes.io/projected/0393c149-5b12-4da8-ad92-dd75716bac73-kube-api-access-dxlnh\") pod \"perf-node-gather-daemonset-vspsn\" (UID: \"0393c149-5b12-4da8-ad92-dd75716bac73\") " pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:25.717783 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:25.717751    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:25.989237 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:25.989208    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"]
Sep 16 18:59:25.990640 ip-10-0-130-4 kubenswrapper[2580]: W0916 18:59:25.990612    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0393c149_5b12_4da8_ad92_dd75716bac73.slice/crio-0b5c404558c94c3501421b6c424fbf864f383b1287260b73f20ebe4cda5b7c01 WatchSource:0}: Error finding container 0b5c404558c94c3501421b6c424fbf864f383b1287260b73f20ebe4cda5b7c01: Status 404 returned error can't find the container with id 0b5c404558c94c3501421b6c424fbf864f383b1287260b73f20ebe4cda5b7c01
Sep 16 18:59:26.823197 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:26.823158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn" event={"ID":"0393c149-5b12-4da8-ad92-dd75716bac73","Type":"ContainerStarted","Data":"ae7b5649383525ba88adb9df7e994639f754cf2f01a83cf16a42f41ab9db2ca2"}
Sep 16 18:59:26.823617 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:26.823220    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn" event={"ID":"0393c149-5b12-4da8-ad92-dd75716bac73","Type":"ContainerStarted","Data":"0b5c404558c94c3501421b6c424fbf864f383b1287260b73f20ebe4cda5b7c01"}
Sep 16 18:59:26.823617 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:26.823250    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:26.859291 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:26.859242    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn" podStartSLOduration=2.859226773 podStartE2EDuration="2.859226773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:59:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:59:26.855804701 +0000 UTC m=+2585.498830740" watchObservedRunningTime="2026-09-16 18:59:26.859226773 +0000 UTC m=+2585.502252812"
Sep 16 18:59:28.714078 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:28.714049    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xbx5k_596d0e8d-6220-4472-be11-369dd730bb6f/dns/0.log"
Sep 16 18:59:28.763732 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:28.763705    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xbx5k_596d0e8d-6220-4472-be11-369dd730bb6f/kube-rbac-proxy/0.log"
Sep 16 18:59:28.938156 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:28.938127    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k69k7_87decdc9-1d76-402c-8fbb-d996fcaf8ce6/dns-node-resolver/0.log"
Sep 16 18:59:29.701855 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:29.701823    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2cflm_4faeab58-7f14-4555-9bc8-db6c5cb61fce/node-ca/0.log"
Sep 16 18:59:30.983241 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:30.983212    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5_e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb/istio-proxy/0.log"
Sep 16 18:59:31.376738 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:31.376705    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q7rrf_99c71921-fe9c-44ca-bf07-019ffffc863d/discovery/0.log"
Sep 16 18:59:31.401416 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:31.401361    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d9c67857d-2d8t2_2b228b11-1b24-4cb5-ac9c-e692a7987194/kube-auth-proxy/0.log"
Sep 16 18:59:31.493837 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:31.493809    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l8h2n_8efaa52c-c1c3-4735-8106-c2f98a95b1a3/istio-proxy/0.log"
Sep 16 18:59:31.496310 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:31.496295    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l8h2n_8efaa52c-c1c3-4735-8106-c2f98a95b1a3/istio-proxy/1.log"
Sep 16 18:59:32.837853 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:32.837828    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-slrm4/perf-node-gather-daemonset-vspsn"
Sep 16 18:59:32.847259 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:32.847238    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rgv5m_dece4fee-3ac5-4f85-afb3-037f880df056/serve-healthcheck-canary/0.log"
Sep 16 18:59:33.872716 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:33.872686    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jf5sk_11cc9377-86f2-4ff3-a9d6-aae718ecc1b4/kube-rbac-proxy/0.log"
Sep 16 18:59:33.947679 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:33.947652    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jf5sk_11cc9377-86f2-4ff3-a9d6-aae718ecc1b4/exporter/0.log"
Sep 16 18:59:34.036729 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:34.036700    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jf5sk_11cc9377-86f2-4ff3-a9d6-aae718ecc1b4/extractor/0.log"
Sep 16 18:59:34.769756 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:34.769725    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5_e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb/istio-proxy/0.log"
Sep 16 18:59:35.156203 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:35.156171    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q7rrf_99c71921-fe9c-44ca-bf07-019ffffc863d/discovery/0.log"
Sep 16 18:59:35.257404 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:35.257314    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d9c67857d-2d8t2_2b228b11-1b24-4cb5-ac9c-e692a7987194/kube-auth-proxy/0.log"
Sep 16 18:59:35.355761 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:35.355718    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l8h2n_8efaa52c-c1c3-4735-8106-c2f98a95b1a3/istio-proxy/0.log"
Sep 16 18:59:35.358039 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:35.358019    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l8h2n_8efaa52c-c1c3-4735-8106-c2f98a95b1a3/istio-proxy/1.log"
Sep 16 18:59:37.246595 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:37.246565    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8tvg5_e0e90f69-edff-4bbd-8d5a-8237a5a3f9cb/istio-proxy/0.log"
Sep 16 18:59:37.641803 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:37.641717    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q7rrf_99c71921-fe9c-44ca-bf07-019ffffc863d/discovery/0.log"
Sep 16 18:59:37.735515 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:37.735485    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d9c67857d-2d8t2_2b228b11-1b24-4cb5-ac9c-e692a7987194/kube-auth-proxy/0.log"
Sep 16 18:59:37.825553 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:37.825525    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l8h2n_8efaa52c-c1c3-4735-8106-c2f98a95b1a3/istio-proxy/0.log"
Sep 16 18:59:37.827788 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:37.827770    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l8h2n_8efaa52c-c1c3-4735-8106-c2f98a95b1a3/istio-proxy/1.log"
Sep 16 18:59:37.869714 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:37.869687    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f8c84ff76-4cz6w_584d2899-44b5-4e6e-ab5d-1140e115a2e4/manager/0.log"
Sep 16 18:59:38.254308 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:38.254222    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bdbbf975-sf28v_cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914/manager/0.log"
Sep 16 18:59:38.328321 ip-10-0-130-4 kubenswrapper[2580]: I0916 18:59:38.328297    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bdbbf975-sf28v_cc2d8e74-4fd8-4904-9aa9-8e77ed6dc914/copy-manifests/0.log"