Sep 11 19:58:31.116914 ip-10-0-130-146 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 19:58:31.116924 ip-10-0-130-146 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 19:58:31.116931 ip-10-0-130-146 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 19:58:31.117084 ip-10-0-130-146 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 19:58:41.296168 ip-10-0-130-146 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 19:58:41.296189 ip-10-0-130-146 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c529dac2376245028b06525adf5fd107 --
Sep 11 20:00:13.003354 ip-10-0-130-146 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 20:00:13.424733 ip-10-0-130-146 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 20:00:13.424733 ip-10-0-130-146 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 20:00:13.424733 ip-10-0-130-146 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 20:00:13.424733 ip-10-0-130-146 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 20:00:13.426176 ip-10-0-130-146 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 20:00:13.427013 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.426930    2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 20:00:13.430222 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430206    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430223    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430227    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430230    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430233    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430236    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430239    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430242    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430244    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430247    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430253    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430256    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430259    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430261    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430264    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 20:00:13.430260 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430267    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430270    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430273    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430275    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430278    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430280    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430283    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430285    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430288    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430290    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430294    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430298    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430302    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430304    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430307    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430310    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430312    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430315    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430317    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 20:00:13.430626 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430319    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430322    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430324    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430327    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430329    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430332    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430335    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430337    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430340    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430343    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430345    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430348    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430350    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430353    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430355    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430359    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430362    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430364    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430367    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430369    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 20:00:13.431095 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430372    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430374    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430377    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430380    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430382    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430385    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430388    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430390    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430393    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430396    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430398    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430400    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430403    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430406    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430408    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430410    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430413    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430416    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430419    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430421    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 20:00:13.431590 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430425    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430427    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430430    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430432    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430435    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430437    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430439    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430443    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430446    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430448    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430451    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430453    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430457    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430460    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430463    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430466    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430469    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430472    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430475    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 20:00:13.432201 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430478    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430480    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430483    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430486    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430489    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.430491    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431206    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431213    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431216    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431219    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431222    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431224    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431228    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431230    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431233    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431236    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431240    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431242    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431245    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 20:00:13.432659 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431250    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431254    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431257    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431261    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431263    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431266    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431269    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431272    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431274    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431277    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431280    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431282    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431285    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431287    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431290    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431293    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431295    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431298    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431300    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431303    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 20:00:13.433163 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431305    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431308    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431311    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431313    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431316    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431318    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431321    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431324    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431327    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431329    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431333    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431337    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431340    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431345    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431349    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431352    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431355    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431357    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431360    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 20:00:13.433677 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431362    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431365    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431367    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431369    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431373    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431375    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431378    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431380    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431383    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431385    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431388    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431390    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431393    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431395    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431398    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431401    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431403    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431406    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431408    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431411    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 20:00:13.434168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431418    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431420    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431423    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431425    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431428    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431430    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431435    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431438    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431440    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431443    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431445    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431448    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431450    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431453    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431455    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431458    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431461    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431463    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431466    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431469    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 20:00:13.434662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431471    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431474    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431476    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431478    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431481    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431483    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431486    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431836    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431841    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431843    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431846    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431849    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431852    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431855    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431857    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431860    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431863    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431865    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431868    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 20:00:13.435168 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431871    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431875    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431877    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431880    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431882    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431885    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431888    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431890    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431893    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431896    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431899    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431901    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431904    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431906    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431909    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431912    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431914    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431917    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431920    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 20:00:13.435645 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431922    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431925    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431928    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431930    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431932    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431936    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431938    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431941    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431944    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431947    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431949    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431952    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431955    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431958    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431960    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431963    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431967    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431969    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431972    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431974    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 20:00:13.436118 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431977    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431980    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431982    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431985    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431987    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431992    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431995    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.431998    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432001    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432004    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432006    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432009    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432011    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432014    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432016    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432019    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432021    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432024    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432026    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 20:00:13.436607 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432029    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432032    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432034    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432036    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432039    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432042    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432045    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432048    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432051    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432054    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432057    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432059    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432062    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432065    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432069    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432087    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432090    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432093    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432096    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432099    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 20:00:13.437178 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432102    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432104    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432107    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432110    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432113    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432117    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432120    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432123    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432126    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432201    2585 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432246    2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432253    2585 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432257    2585 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432262    2585 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432266    2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432271    2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432275    2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432278    2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432282    2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432285    2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432289    2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432292    2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 20:00:13.437693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432295    2585 flags.go:64] FLAG: --cgroup-root=""
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432298    2585 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432302    2585 flags.go:64] FLAG: --client-ca-file=""
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432305    2585 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432308    2585 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432312    2585 flags.go:64] FLAG: --cluster-domain=""
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432315    2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432318    2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432321    2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432324    2585 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432328    2585 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432331    2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432334    2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432337    2585 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432340    2585 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432343    2585 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432346    2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432349    2585 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432352    2585 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432359    2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432362    2585 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432365    2585 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432368    2585 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432371    2585 flags.go:64] FLAG: --enable-server="true"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432373    2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 20:00:13.438270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432379    2585 flags.go:64] FLAG: --event-burst="100"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432382    2585 flags.go:64] FLAG: --event-qps="50"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432385    2585 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432389    2585 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432392    2585 flags.go:64] FLAG: --eviction-hard=""
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432395    2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432398    2585 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432401    2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432405    2585 flags.go:64] FLAG: --eviction-soft=""
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432408    2585 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432411    2585 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432413    2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432416    2585 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432419    2585 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432422    2585 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432425    2585 flags.go:64] FLAG: --feature-gates=""
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432428    2585 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432431    2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432435    2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432438    2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432441    2585 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432444    2585 flags.go:64] FLAG: --help="false"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432447    2585 flags.go:64] FLAG: --hostname-override="ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432450    2585 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 20:00:13.438867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432453    2585 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432456    2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432459    2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432462    2585 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432465    2585 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432468    2585 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432473    2585 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432476    2585 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432479    2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432483    2585 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432486    2585 flags.go:64] FLAG: --kube-reserved=""
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432489    2585 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432491    2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432494    2585 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432497    2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432501    2585 flags.go:64] FLAG: --lock-file=""
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432504    2585 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432507    2585 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432510    2585 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432515    2585 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432518    2585 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432521    2585 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432524    2585 flags.go:64] FLAG: --logging-format="text"
Sep 11 20:00:13.439495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432527    2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432530    2585 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432533    2585 flags.go:64] FLAG: --manifest-url=""
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432536    2585 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432540    2585 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432543    2585 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432547    2585 flags.go:64] FLAG: --max-pods="110"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432550    2585 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432553    2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432556    2585 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432559    2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432562    2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432565    2585 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432568    2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432574    2585 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432579    2585 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432582    2585 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432585    2585 flags.go:64] FLAG: --pod-cidr=""
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432588    2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432594    2585 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432597    2585 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432600    2585 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432603    2585 flags.go:64] FLAG: --port="10250"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432606    2585 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 20:00:13.440151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432609    2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-088d0feccb0df3c8b"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432612    2585 flags.go:64] FLAG: --qos-reserved=""
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432615    2585 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432618    2585 flags.go:64] FLAG: --register-node="true"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432621    2585 flags.go:64] FLAG: --register-with-taints=""
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432625    2585 flags.go:64] FLAG: --registry-burst="10"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432628    2585 flags.go:64] FLAG: --registry-qps="5"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432631    2585 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432633    2585 flags.go:64] FLAG: --reserved-memory=""
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432637    2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432640    2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432643    2585 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432646    2585 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432649    2585 flags.go:64] FLAG: --runonce="false"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432652    2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432655    2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432658    2585 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432661    2585 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432664    2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432667    2585 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432670    2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432673    2585 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432676    2585 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432679    2585 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432683    2585 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432686    2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 20:00:13.441087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432689    2585 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432692    2585 flags.go:64] FLAG: --system-cgroups=""
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432696    2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432701    2585 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432704    2585 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432707    2585 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432711    2585 flags.go:64] FLAG: --tls-min-version=""
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432715    2585 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432718    2585 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432721    2585 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432724    2585 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432727    2585 flags.go:64] FLAG: --v="2"
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432730    2585 flags.go:64] FLAG: --version="false"
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432734    2585 flags.go:64] FLAG: --vmodule=""
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432738    2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.432741    2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432888    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432893    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432896    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432899    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432902    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432905    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432907    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432911    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 20:00:13.442035 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432914    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432917    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432920    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432922    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432925    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432928    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432932    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432936    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432940    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432943    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432946    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432954    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432959    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432963    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432966    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432971    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432974    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432977    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432980    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 20:00:13.442734 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432983    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432985    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432988    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432990    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432993    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432995    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.432998    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433000    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433003    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433006    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433008    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433011    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433013    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433016    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433018    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433021    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433024    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433026    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433029    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433033    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 20:00:13.443376 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433035    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433038    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433040    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433048    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433050    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433058    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433061    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433064    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433067    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433083    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433086    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433088    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433091    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433094    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433096    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433099    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433101    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433104    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433107    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 20:00:13.443905 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433109    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433112    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433115    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433118    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433120    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433123    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433125    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433128    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433130    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433133    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433136    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433138    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433142    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433145    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433148    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433150    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433153    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433156    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433158    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433167    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 20:00:13.444400 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433170    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433174    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433177    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433179    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433182    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433184    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433187    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433190    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433192    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433195    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433197    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433200    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.433203    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.433888    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.442928    2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 20:00:13.444898 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.442946    2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.443882    2585 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.443890    2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.443953    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.443960    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.443963    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.443966    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.443970    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.443974    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.443979    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.443982    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.443987    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.443992    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.443997    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444000    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444002    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444005    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444008    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444011    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 20:00:13.445413 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444013    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444016    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444019    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444021    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444024    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444026    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444029    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444031    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444034    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444036    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444039    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444041    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444045    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444048    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444051    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444054    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444057    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444060    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444064    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444069    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 20:00:13.446137 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444086    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444089    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444092    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444095    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444098    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444101    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444103    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444106    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444109    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444111    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444114    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444117    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444119    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444121    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444125    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444128    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444131    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444133    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444136    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444139    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 20:00:13.446632 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444144    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444148    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444153    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444157    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444161    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444166    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444169    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444172    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444176    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444179    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444181    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444184    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444187    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444190    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444192    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444195    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444197    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444200    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444203    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 20:00:13.447206 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444205    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444208    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444211    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444213    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444217    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444221    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444226    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444230    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444233    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444236    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444238    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444241    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444244    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444246    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444249    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444252    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444254    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444257    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444260    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444263    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 20:00:13.447709 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444266    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444268    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444271    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444274    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.444279    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444409    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444415    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444418    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444421    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444424    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444428    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444433    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444436    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444439    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444442    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 20:00:13.448252 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444445    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444448    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444451    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444454    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444457    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444460    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444463    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444466    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444469    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444474    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444478    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444482    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444485    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444488    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444490    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444493    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444497    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444500    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444503    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444506    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 20:00:13.448633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444509    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444512    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444515    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444518    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444521    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444524    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444526    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444529    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444531    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444534    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444537    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444539    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444542    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444544    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444547    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444551    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444554    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444556    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444559    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 20:00:13.449135 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444562    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444564    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444567    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444569    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444572    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444574    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444577    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444580    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444582    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444585    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444588    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444590    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444593    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444595    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444598    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444601    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444603    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444607    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444611    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 20:00:13.449620 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444615    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444619    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444621    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444624    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444626    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444629    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444631    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444634    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444636    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444639    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444643    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444646    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444648    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444651    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444654    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444656    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444659    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444661    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444664    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444666    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 20:00:13.450125 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444669    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444672    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444675    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444677    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444680    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444682    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444685    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444688    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444690    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444693    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:13.444695    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.444701    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.444834    2585 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.449579    2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 20:00:13.450622 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.450624    2585 server.go:1019] "Starting client certificate rotation"
Sep 11 20:00:13.450975 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.450732    2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 20:00:13.450975 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.450763    2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 20:00:13.454175 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.454159    2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 20:00:13.455336 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.455312    2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 20:00:13.465296 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.465278    2585 log.go:25] "Validated CRI v1 runtime API"
Sep 11 20:00:13.471645 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.471628    2585 log.go:25] "Validated CRI v1 image API"
Sep 11 20:00:13.472588 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.472573    2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 20:00:13.476921 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.476901    2585 fs.go:135] Filesystem UUIDs: map[64e2cb75-3b1d-4891-825f-0ef0dee65f75:/dev/nvme0n1p4 67975551-b5e9-45d9-8f72-fa15850d530b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 11 20:00:13.477000 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.476920    2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 20:00:13.481585 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.481561    2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 20:00:13.484387 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.484271    2585 manager.go:216] Machine: {Timestamp:2026-09-11 20:00:13.482829279 +0000 UTC m=+0.372959917 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100530 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f780c770c7421fbf05bb9ef09ddf6 SystemUUID:ec2f780c-770c-7421-fbf0-5bb9ef09ddf6 BootID:c529dac2-3762-4502-8b06-525adf5fd107 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bb:6a:35:20:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bb:6a:35:20:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:05:7a:eb:3c:50 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 20:00:13.484387 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.484376    2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 20:00:13.484544 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.484491    2585 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 20:00:13.488120 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.488090    2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 20:00:13.488262 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.488125    2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 20:00:13.488976 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.488965    2585 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 20:00:13.489007 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.488979    2585 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 20:00:13.489007 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.488986    2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 20:00:13.489007 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.489000    2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 20:00:13.490354 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.490343    2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 20:00:13.495020 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.495009    2585 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 20:00:13.495141 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.495131    2585 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 20:00:13.495179 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.495162    2585 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 20:00:13.495179 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.495171    2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 20:00:13.495234 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.495188    2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 20:00:13.495234 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.495197    2585 kubelet.go:398] "Adding apiserver pod source"
Sep 11 20:00:13.495234 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.495212    2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 20:00:13.495567 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.495555    2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 20:00:13.495624 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.495573    2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 20:00:13.498942 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.498920    2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 20:00:13.501197 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.501184    2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 20:00:13.501241 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.501214    2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 20:00:13.503315 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.503300    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 20:00:13.503373 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.503322    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 20:00:13.503373 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.503332    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 20:00:13.503373 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.503340    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 20:00:13.503373 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.503352    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 20:00:13.503373 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.503361    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 20:00:13.503531 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.503381    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 20:00:13.503531 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.503389    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 20:00:13.503531 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.503399    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 20:00:13.503531 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.503409    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 20:00:13.503531 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.503435    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 20:00:13.503531 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.503444    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 20:00:13.504314 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.504291    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 20:00:13.504377 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.504355    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 20:00:13.504377 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.504367    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 20:00:13.504377 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.504359    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 20:00:13.507138 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.507122    2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 20:00:13.508414 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.508401    2585 server.go:1268] "Started kubelet"
Sep 11 20:00:13.508500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.508473    2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 20:00:13.508570 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.508506    2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 20:00:13.508657 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.508590    2585 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 20:00:13.509444 ip-10-0-130-146 systemd[1]: Started Kubernetes Kubelet.
Sep 11 20:00:13.512778 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.512086    2585 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 20:00:13.512778 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.512415    2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 20:00:13.516850 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.516829    2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 20:00:13.518202 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.518186    2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 20:00:13.518312 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.518187    2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 20:00:13.518412 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.518388    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:13.518921 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.518894    2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 20:00:13.519038 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.519019    2585 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 20:00:13.519146 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.519043    2585 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 20:00:13.519146 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.519121    2585 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 20:00:13.519146 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.519130    2585 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 20:00:13.519518 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.519500    2585 factory.go:55] Registering systemd factory
Sep 11 20:00:13.519589 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.519521    2585 factory.go:223] Registration of the systemd container factory successfully
Sep 11 20:00:13.519842 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.519826    2585 factory.go:153] Registering CRI-O factory
Sep 11 20:00:13.519933 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.519923    2585 factory.go:223] Registration of the crio container factory successfully
Sep 11 20:00:13.520050 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.520039    2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 20:00:13.520170 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.520159    2585 factory.go:103] Registering Raw factory
Sep 11 20:00:13.520250 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.520242    2585 manager.go:1196] Started watching for new ooms in manager
Sep 11 20:00:13.520633 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.520611    2585 manager.go:349] Starting recovery of all containers
Sep 11 20:00:13.524831 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.524806    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 20:00:13.525036 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.524888    2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 20:00:13.530124 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.524865    2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-146.ec2.internal.18d45ca47ca2e309  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-146.ec2.internal,UID:ip-10-0-130-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-146.ec2.internal,},FirstTimestamp:2026-09-11 20:00:13.508371209 +0000 UTC m=+0.398501847,LastTimestamp:2026-09-11 20:00:13.508371209 +0000 UTC m=+0.398501847,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-146.ec2.internal,}"
Sep 11 20:00:13.532867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.532793    2585 manager.go:354] Recovery completed
Sep 11 20:00:13.536376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.536357    2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tjxcb"
Sep 11 20:00:13.538399 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.538387    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 20:00:13.540068 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.540055    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 20:00:13.540132 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.540097    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 20:00:13.540132 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.540112    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientPID"
Sep 11 20:00:13.540596 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.540582    2585 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 20:00:13.540596 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.540592    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 20:00:13.540596 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.540594    2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 20:00:13.540753 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.540611    2585 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 20:00:13.541261 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.541241    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 20:00:13.541340 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.541272    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 20:00:13.541340 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.541287    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientPID"
Sep 11 20:00:13.542802 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.542686    2585 policy_none.go:49] "None policy: Start"
Sep 11 20:00:13.542869 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.542806    2585 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 20:00:13.542869 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.542817    2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 20:00:13.543547 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.543475    2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-146.ec2.internal.18d45ca47e868b9b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-146.ec2.internal,UID:ip-10-0-130-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-146.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-146.ec2.internal,},FirstTimestamp:2026-09-11 20:00:13.540068251 +0000 UTC m=+0.430198888,LastTimestamp:2026-09-11 20:00:13.540068251 +0000 UTC m=+0.430198888,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-146.ec2.internal,}"
Sep 11 20:00:13.544704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.544691    2585 policy_none.go:47] "Start"
Sep 11 20:00:13.544799 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.544779    2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tjxcb"
Sep 11 20:00:13.596892 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.585869    2585 manager.go:337] "Starting Device Plugin manager"
Sep 11 20:00:13.596892 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.585908    2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 20:00:13.596892 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.585921    2585 server.go:87] "Starting device plugin registration server"
Sep 11 20:00:13.596892 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.586250    2585 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 20:00:13.596892 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.586262    2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 20:00:13.596892 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.586358    2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 20:00:13.596892 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.586432    2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 20:00:13.596892 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.586442    2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 20:00:13.596892 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.587062    2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 20:00:13.596892 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.587130    2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:13.612516 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.612488    2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 20:00:13.613669 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.613645    2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 20:00:13.613773 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.613697    2585 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 20:00:13.613773 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.613717    2585 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 20:00:13.613874 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.613796    2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 20:00:13.616092 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.616052    2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 20:00:13.687443 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.687387    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 20:00:13.688680 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.688663    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 20:00:13.688776 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.688696    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 20:00:13.688776 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.688711    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientPID"
Sep 11 20:00:13.688776 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.688740    2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.698331 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.698313    2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.698408 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.698337    2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-146.ec2.internal\": node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:13.713876 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.713853    2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-146.ec2.internal"]
Sep 11 20:00:13.713970 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.713924    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 20:00:13.715245 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.715229    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 20:00:13.715317 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.715260    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 20:00:13.715317 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.715274    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientPID"
Sep 11 20:00:13.717486 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.717474    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 20:00:13.717616 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.717602    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.717679 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.717637    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 20:00:13.718331 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.718316    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 20:00:13.718456 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.718321    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 20:00:13.718456 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.718361    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 20:00:13.718456 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.718371    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientPID"
Sep 11 20:00:13.718456 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.718341    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 20:00:13.718456 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.718433    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientPID"
Sep 11 20:00:13.719379 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.719356    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3675b94d77e2c8e178e2e49334541679-config\") pod \"kube-apiserver-proxy-ip-10-0-130-146.ec2.internal\" (UID: \"3675b94d77e2c8e178e2e49334541679\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.719466 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.719396    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea15ae8e22d594ee8a48c2619632f052-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal\" (UID: \"ea15ae8e22d594ee8a48c2619632f052\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.719466 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.719425    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea15ae8e22d594ee8a48c2619632f052-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal\" (UID: \"ea15ae8e22d594ee8a48c2619632f052\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.720610 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.720594    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.720701 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.720624    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 20:00:13.721973 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.721960    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 20:00:13.722052 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.721986    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 20:00:13.722052 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.721997    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientPID"
Sep 11 20:00:13.723956 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.723937    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:13.744600 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.744579    2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-146.ec2.internal\" not found" node="ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.748756 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.748741    2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-146.ec2.internal\" not found" node="ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.820180 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.820151    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3675b94d77e2c8e178e2e49334541679-config\") pod \"kube-apiserver-proxy-ip-10-0-130-146.ec2.internal\" (UID: \"3675b94d77e2c8e178e2e49334541679\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.820180 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.820180    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea15ae8e22d594ee8a48c2619632f052-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal\" (UID: \"ea15ae8e22d594ee8a48c2619632f052\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.820360 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.820201    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea15ae8e22d594ee8a48c2619632f052-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal\" (UID: \"ea15ae8e22d594ee8a48c2619632f052\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.820360 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.820262    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3675b94d77e2c8e178e2e49334541679-config\") pod \"kube-apiserver-proxy-ip-10-0-130-146.ec2.internal\" (UID: \"3675b94d77e2c8e178e2e49334541679\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.820360 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.820272    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea15ae8e22d594ee8a48c2619632f052-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal\" (UID: \"ea15ae8e22d594ee8a48c2619632f052\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.820360 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:13.820262    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea15ae8e22d594ee8a48c2619632f052-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal\" (UID: \"ea15ae8e22d594ee8a48c2619632f052\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:13.824272 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.824255    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:13.925039 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:13.924999    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:14.025773 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:14.025710    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:14.046883 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:14.046857    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:14.051757 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:14.051673    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:14.126436 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:14.126405    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:14.226957 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:14.226928    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:16.056411 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:16.056331    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:16.114114 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.114090    2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 20:00:16.156558 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:16.156532    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:16.179690 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.179670    2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 20:00:16.179822 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.179805    2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 20:00:16.179885 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.179840    2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 20:00:16.256918 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:16.256888    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:16.279457 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.279424    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 19:55:15 +0000 UTC" deadline="2028-06-05 08:42:31.290410456 +0000 UTC"
Sep 11 20:00:16.279457 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.279451    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15180h42m15.010962654s"
Sep 11 20:00:16.357931 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:16.357863    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:16.364251 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.364228    2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 20:00:16.435740 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.435720    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 20:00:16.437019 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.436999    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 20:00:16.437112 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.437030    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 20:00:16.437112 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.437042    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeHasSufficientPID"
Sep 11 20:00:16.458644 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:16.458625    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-146.ec2.internal\" not found"
Sep 11 20:00:16.557974 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.557934    2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 20:00:16.625090 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:16.625034    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3675b94d77e2c8e178e2e49334541679.slice/crio-9337bcfdd30c8d92a5f9a1224dd772505d300504fb6d24e98a2925428204a820 WatchSource:0}: Error finding container 9337bcfdd30c8d92a5f9a1224dd772505d300504fb6d24e98a2925428204a820: Status 404 returned error can't find the container with id 9337bcfdd30c8d92a5f9a1224dd772505d300504fb6d24e98a2925428204a820
Sep 11 20:00:16.625427 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:16.625394    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea15ae8e22d594ee8a48c2619632f052.slice/crio-7c1d0e6eaa1b7140606c92be3105f2d04a6065e508aeaa3b8c09df2156d59501 WatchSource:0}: Error finding container 7c1d0e6eaa1b7140606c92be3105f2d04a6065e508aeaa3b8c09df2156d59501: Status 404 returned error can't find the container with id 7c1d0e6eaa1b7140606c92be3105f2d04a6065e508aeaa3b8c09df2156d59501
Sep 11 20:00:16.629852 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.629835    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 20:00:16.648002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.647983    2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:16.661159 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.661139    2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 20:00:16.661967 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.661943    2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-146.ec2.internal"
Sep 11 20:00:16.670867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:16.670855    2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 20:00:17.225715 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.225684    2585 apiserver.go:52] "Watching apiserver"
Sep 11 20:00:17.234157 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.234126    2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 20:00:17.234595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.234566    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-pcq4x","kube-system/kube-apiserver-proxy-ip-10-0-130-146.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal","openshift-multus/network-metrics-daemon-zn8nm","openshift-network-diagnostics/network-check-target-7jr97","openshift-network-operator/iptables-alerter-vchkm","openshift-ovn-kubernetes/ovnkube-node-vxbcp","kube-system/global-pull-secret-syncer-vsxwz","kube-system/konnectivity-agent-xsg69","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv","openshift-cluster-node-tuning-operator/tuned-6p4c6","openshift-dns/node-resolver-sdh4n","openshift-image-registry/node-ca-vrvvx","openshift-multus/multus-additional-cni-plugins-jkfkl"]
Sep 11 20:00:17.237286 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.237263    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.239465 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.239441    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vrvvx"
Sep 11 20:00:17.240124 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.240106    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 20:00:17.240245 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.240226    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 20:00:17.240305 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.240286    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 20:00:17.240363 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.240235    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 20:00:17.240363 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.240313    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5wxb6\""
Sep 11 20:00:17.241365 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.241350    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 20:00:17.241452 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.241434    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 20:00:17.241729 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.241713    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.241949 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.241926    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 20:00:17.242105 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.242087    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 20:00:17.242581 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.242545    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 20:00:17.242581 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.242553    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jdjsc\""
Sep 11 20:00:17.244275 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.244100    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:17.244275 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.244118    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 20:00:17.244275 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.244204    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:17.246063 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.244943    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 20:00:17.246063 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.245065    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5b95w\""
Sep 11 20:00:17.246063 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.245136    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 20:00:17.246063 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.245507    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 20:00:17.246063 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.245552    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 20:00:17.247440 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.247421    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:17.247524 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.247481    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:17.247524 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.247492    2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 20:00:17.249704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.249685    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vchkm"
Sep 11 20:00:17.252013 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.251998    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xsg69"
Sep 11 20:00:17.252328 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.252092    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 20:00:17.252328 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.252170    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 20:00:17.252328 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.252231    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tmjvz\""
Sep 11 20:00:17.252505 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.252325    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 20:00:17.254347 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.254329    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.254478 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.254462    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 20:00:17.254552 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.254510    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 20:00:17.254757 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.254742    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xrg7n\""
Sep 11 20:00:17.256629 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.256612    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:17.256705 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.256682    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:17.257574 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257558    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-run-ovn-kubernetes\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.257660 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257580    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-cni-bin\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.257660 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257595    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 20:00:17.257660 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257595    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9b5t\" (UniqueName: \"kubernetes.io/projected/8dd887eb-41d0-4861-a5b8-4be593422241-kube-api-access-f9b5t\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:17.257660 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257639    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hljfp\" (UniqueName: \"kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp\") pod \"network-check-target-7jr97\" (UID: \"308fdcdd-97ce-4c84-8020-cdfe11c51d09\") " pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:17.257660 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257654    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b243401-1c1f-450e-b17c-6978d2554ff0-host-slash\") pod \"iptables-alerter-vchkm\" (UID: \"7b243401-1c1f-450e-b17c-6978d2554ff0\") " pod="openshift-network-operator/iptables-alerter-vchkm"
Sep 11 20:00:17.257877 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257670    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dee611c8-1f4c-486b-a0c7-4584874acac9-ovn-node-metrics-cert\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.257877 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257691    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4w5k\" (UniqueName: \"kubernetes.io/projected/dee611c8-1f4c-486b-a0c7-4584874acac9-kube-api-access-b4w5k\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.257877 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257767    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-system-cni-dir\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.257877 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257798    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-cnibin\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.257877 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257815    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-run-ovn\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.257877 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257837    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-slash\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.257877 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257862    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257889    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-log-socket\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257916    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg9c2\" (UniqueName: \"kubernetes.io/projected/7b243401-1c1f-450e-b17c-6978d2554ff0-kube-api-access-dg9c2\") pod \"iptables-alerter-vchkm\" (UID: \"7b243401-1c1f-450e-b17c-6978d2554ff0\") " pod="openshift-network-operator/iptables-alerter-vchkm"
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257948    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257988    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f6rpl\""
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.257987    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258031    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dee611c8-1f4c-486b-a0c7-4584874acac9-ovnkube-script-lib\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258046    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7341bdd-c654-4188-bce4-8cd18669ebfa-host\") pod \"node-ca-vrvvx\" (UID: \"e7341bdd-c654-4188-bce4-8cd18669ebfa\") " pod="openshift-image-registry/node-ca-vrvvx"
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258068    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e7341bdd-c654-4188-bce4-8cd18669ebfa-serviceca\") pod \"node-ca-vrvvx\" (UID: \"e7341bdd-c654-4188-bce4-8cd18669ebfa\") " pod="openshift-image-registry/node-ca-vrvvx"
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258084    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258098    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-run-openvswitch\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258116    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-node-log\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258143    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-systemd-units\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258157    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-run-netns\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258577 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258170    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-run-systemd\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258577 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258202    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.258577 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258230    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqrjc\" (UniqueName: \"kubernetes.io/projected/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-kube-api-access-zqrjc\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.258577 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258257    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-var-lib-openvswitch\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258577 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258281    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-cni-netd\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258577 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258303    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dee611c8-1f4c-486b-a0c7-4584874acac9-env-overrides\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258577 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258326    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b243401-1c1f-450e-b17c-6978d2554ff0-iptables-alerter-script\") pod \"iptables-alerter-vchkm\" (UID: \"7b243401-1c1f-450e-b17c-6978d2554ff0\") " pod="openshift-network-operator/iptables-alerter-vchkm"
Sep 11 20:00:17.258577 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258365    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-etc-openvswitch\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258577 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258412    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-kubelet\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258577 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258432    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dee611c8-1f4c-486b-a0c7-4584874acac9-ovnkube-config\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.258577 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258446    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7gq5\" (UniqueName: \"kubernetes.io/projected/e7341bdd-c654-4188-bce4-8cd18669ebfa-kube-api-access-z7gq5\") pod \"node-ca-vrvvx\" (UID: \"e7341bdd-c654-4188-bce4-8cd18669ebfa\") " pod="openshift-image-registry/node-ca-vrvvx"
Sep 11 20:00:17.258577 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258485    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.258981 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.258951    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.261309 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.261289    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.261461 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.261409    2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 20:00:17.261532 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.261479    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 20:00:17.261716 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.261699    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 20:00:17.261789 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.261758    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z4fwg\""
Sep 11 20:00:17.261789 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.261773    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 20:00:17.263616 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.263600    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sdh4n"
Sep 11 20:00:17.264073 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.264052    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7zncg\""
Sep 11 20:00:17.264322 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.264305    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 20:00:17.264988 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.264966    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 20:00:17.266360 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.266343    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 20:00:17.266687 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.266671    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 20:00:17.267037 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.267022    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tsbfl\""
Sep 11 20:00:17.283481 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.283461    2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-62p6k"
Sep 11 20:00:17.292795 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.292774    2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-62p6k"
Sep 11 20:00:17.347070 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.347024    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-146.ec2.internal" event={"ID":"3675b94d77e2c8e178e2e49334541679","Type":"ContainerStarted","Data":"9337bcfdd30c8d92a5f9a1224dd772505d300504fb6d24e98a2925428204a820"}
Sep 11 20:00:17.348254 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.348222    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal" event={"ID":"ea15ae8e22d594ee8a48c2619632f052","Type":"ContainerStarted","Data":"7c1d0e6eaa1b7140606c92be3105f2d04a6065e508aeaa3b8c09df2156d59501"}
Sep 11 20:00:17.348593 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.348567    2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 20:00:17.359265 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359241    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-hostroot\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.359376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359272    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f62e8683-1a77-47c2-981b-a832d9df930c-kubelet-config\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:17.359376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359294    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-run-ovn-kubernetes\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.359376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359309    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-cni-bin\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.359376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359360    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9b5t\" (UniqueName: \"kubernetes.io/projected/8dd887eb-41d0-4861-a5b8-4be593422241-kube-api-access-f9b5t\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:17.359376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359367    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-run-ovn-kubernetes\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.359625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359389    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b243401-1c1f-450e-b17c-6978d2554ff0-host-slash\") pod \"iptables-alerter-vchkm\" (UID: \"7b243401-1c1f-450e-b17c-6978d2554ff0\") " pod="openshift-network-operator/iptables-alerter-vchkm"
Sep 11 20:00:17.359625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359408    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-cni-bin\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.359625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359443    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-multus-conf-dir\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.359625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359444    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b243401-1c1f-450e-b17c-6978d2554ff0-host-slash\") pod \"iptables-alerter-vchkm\" (UID: \"7b243401-1c1f-450e-b17c-6978d2554ff0\") " pod="openshift-network-operator/iptables-alerter-vchkm"
Sep 11 20:00:17.359625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359472    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-sysctl-conf\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.359625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359494    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:17.359625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359510    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.359625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359532    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-system-cni-dir\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.359625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359557    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-run-ovn\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.359625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359578    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f62e8683-1a77-47c2-981b-a832d9df930c-dbus\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:17.359625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359600    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-log-socket\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.359625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359612    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-system-cni-dir\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359648    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-run-ovn\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359670    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-log-socket\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359677    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-sysctl-d\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359720    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359755    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-socket-dir\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359760    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359805    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-sys-fs\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359854    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dncz2\" (UniqueName: \"kubernetes.io/projected/a507914b-4ebf-46c4-94ed-cc292bce63c4-kube-api-access-dncz2\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359883    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e7341bdd-c654-4188-bce4-8cd18669ebfa-serviceca\") pod \"node-ca-vrvvx\" (UID: \"e7341bdd-c654-4188-bce4-8cd18669ebfa\") " pod="openshift-image-registry/node-ca-vrvvx"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359917    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-multus-socket-dir-parent\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359932    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-run\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359946    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-node-log\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.359987    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-run-netns\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360009    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-run-systemd\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360029    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.360111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360044    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b243401-1c1f-450e-b17c-6978d2554ff0-iptables-alerter-script\") pod \"iptables-alerter-vchkm\" (UID: \"7b243401-1c1f-450e-b17c-6978d2554ff0\") " pod="openshift-network-operator/iptables-alerter-vchkm"
Sep 11 20:00:17.360765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360554    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.360765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360589    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-run-k8s-cni-cncf-io\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.360765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360611    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-run-netns\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.360765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360634    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-var-lib-openvswitch\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.360765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360648    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-var-lib-kubelet\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.360765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360670    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-tmp\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.360765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360692    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f20ee550-9f30-480a-9b31-ebc964ae0fe0-agent-certs\") pod \"konnectivity-agent-xsg69\" (UID: \"f20ee550-9f30-480a-9b31-ebc964ae0fe0\") " pod="kube-system/konnectivity-agent-xsg69"
Sep 11 20:00:17.360765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360715    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f20ee550-9f30-480a-9b31-ebc964ae0fe0-konnectivity-ca\") pod \"konnectivity-agent-xsg69\" (UID: \"f20ee550-9f30-480a-9b31-ebc964ae0fe0\") " pod="kube-system/konnectivity-agent-xsg69"
Sep 11 20:00:17.360765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360730    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30b3adc7-99ac-4743-9eb5-c1d99ceb1b79-hosts-file\") pod \"node-resolver-sdh4n\" (UID: \"30b3adc7-99ac-4743-9eb5-c1d99ceb1b79\") " pod="openshift-dns/node-resolver-sdh4n"
Sep 11 20:00:17.360765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360744    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6mhb\" (UniqueName: \"kubernetes.io/projected/30b3adc7-99ac-4743-9eb5-c1d99ceb1b79-kube-api-access-h6mhb\") pod \"node-resolver-sdh4n\" (UID: \"30b3adc7-99ac-4743-9eb5-c1d99ceb1b79\") " pod="openshift-dns/node-resolver-sdh4n"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360761    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f18aa82-473c-4dfb-82db-31a149631d21-multus-daemon-config\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360862    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-etc-openvswitch\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360888    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-kubelet\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360919    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dee611c8-1f4c-486b-a0c7-4584874acac9-ovnkube-config\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360913    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-run-netns\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360935    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-run-systemd\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360943    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-multus-cni-dir\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360979    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-node-log\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.360981    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-tuned\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361000    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-var-lib-openvswitch\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361018    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-modprobe-d\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361056    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-etc-openvswitch\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361079    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-kubelet\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361086    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hljfp\" (UniqueName: \"kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp\") pod \"network-check-target-7jr97\" (UID: \"308fdcdd-97ce-4c84-8020-cdfe11c51d09\") " pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:17.361176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361110    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-cnibin\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361311    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361340    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-var-lib-kubelet\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361372    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-run-multus-certs\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361414    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b243401-1c1f-450e-b17c-6978d2554ff0-iptables-alerter-script\") pod \"iptables-alerter-vchkm\" (UID: \"7b243401-1c1f-450e-b17c-6978d2554ff0\") " pod="openshift-network-operator/iptables-alerter-vchkm"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361418    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dee611c8-1f4c-486b-a0c7-4584874acac9-ovn-node-metrics-cert\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361485    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4w5k\" (UniqueName: \"kubernetes.io/projected/dee611c8-1f4c-486b-a0c7-4584874acac9-kube-api-access-b4w5k\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361516    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dee611c8-1f4c-486b-a0c7-4584874acac9-ovnkube-config\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361530    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e7341bdd-c654-4188-bce4-8cd18669ebfa-serviceca\") pod \"node-ca-vrvvx\" (UID: \"e7341bdd-c654-4188-bce4-8cd18669ebfa\") " pod="openshift-image-registry/node-ca-vrvvx"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361551    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-cnibin\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361694    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-cnibin\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361738    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-slash\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361766    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.361791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361794    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-slash\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361842    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-var-lib-cni-bin\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361863    2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361887    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg9c2\" (UniqueName: \"kubernetes.io/projected/7b243401-1c1f-450e-b17c-6978d2554ff0-kube-api-access-dg9c2\") pod \"iptables-alerter-vchkm\" (UID: \"7b243401-1c1f-450e-b17c-6978d2554ff0\") " pod="openshift-network-operator/iptables-alerter-vchkm"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361938    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-systemd\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.361987    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362066    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-lib-modules\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362092    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-host\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362129    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362160    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dee611c8-1f4c-486b-a0c7-4584874acac9-ovnkube-script-lib\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362183    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7341bdd-c654-4188-bce4-8cd18669ebfa-host\") pod \"node-ca-vrvvx\" (UID: \"e7341bdd-c654-4188-bce4-8cd18669ebfa\") " pod="openshift-image-registry/node-ca-vrvvx"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362223    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.362235    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362254    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-etc-kubernetes\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362278    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-sysconfig\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.362326    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs podName:8dd887eb-41d0-4861-a5b8-4be593422241 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:17.86229219 +0000 UTC m=+3.023542423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs") pod "network-metrics-daemon-zn8nm" (UID: "8dd887eb-41d0-4861-a5b8-4be593422241") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362339    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7341bdd-c654-4188-bce4-8cd18669ebfa-host\") pod \"node-ca-vrvvx\" (UID: \"e7341bdd-c654-4188-bce4-8cd18669ebfa\") " pod="openshift-image-registry/node-ca-vrvvx"
Sep 11 20:00:17.362431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362347    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-sys\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362375    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-registration-dir\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362404    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-run-openvswitch\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362429    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-systemd-units\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362454    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqrjc\" (UniqueName: \"kubernetes.io/projected/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-kube-api-access-zqrjc\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362477    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f18aa82-473c-4dfb-82db-31a149631d21-cni-binary-copy\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362499    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-kubernetes\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362521    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-device-dir\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362550    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30b3adc7-99ac-4743-9eb5-c1d99ceb1b79-tmp-dir\") pod \"node-resolver-sdh4n\" (UID: \"30b3adc7-99ac-4743-9eb5-c1d99ceb1b79\") " pod="openshift-dns/node-resolver-sdh4n"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362575    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wghvb\" (UniqueName: \"kubernetes.io/projected/7f18aa82-473c-4dfb-82db-31a149631d21-kube-api-access-wghvb\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362616    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-cni-netd\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362640    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dee611c8-1f4c-486b-a0c7-4584874acac9-env-overrides\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362661    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-system-cni-dir\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362687    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-785nl\" (UniqueName: \"kubernetes.io/projected/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-kube-api-access-785nl\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362700    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dee611c8-1f4c-486b-a0c7-4584874acac9-ovnkube-script-lib\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362719    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7gq5\" (UniqueName: \"kubernetes.io/projected/e7341bdd-c654-4188-bce4-8cd18669ebfa-kube-api-access-z7gq5\") pod \"node-ca-vrvvx\" (UID: \"e7341bdd-c654-4188-bce4-8cd18669ebfa\") " pod="openshift-image-registry/node-ca-vrvvx"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362756    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.363264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362767    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.363851 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362816    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-systemd-units\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.363851 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362840    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-var-lib-cni-multus\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.363851 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362931    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-run-openvswitch\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.363851 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.362989    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dee611c8-1f4c-486b-a0c7-4584874acac9-host-cni-netd\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.363851 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.363164    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dee611c8-1f4c-486b-a0c7-4584874acac9-env-overrides\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.363851 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.363277    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.365819 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.365802    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dee611c8-1f4c-486b-a0c7-4584874acac9-ovn-node-metrics-cert\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.368711 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.368691    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 20:00:17.368795 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.368718    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 20:00:17.368795 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.368731    2585 projected.go:196] Error preparing data for projected volume kube-api-access-hljfp for pod openshift-network-diagnostics/network-check-target-7jr97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 20:00:17.368894 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.368799    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp podName:308fdcdd-97ce-4c84-8020-cdfe11c51d09 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:17.868782962 +0000 UTC m=+3.030033185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hljfp" (UniqueName: "kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp") pod "network-check-target-7jr97" (UID: "308fdcdd-97ce-4c84-8020-cdfe11c51d09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 20:00:17.369028 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.369010    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9b5t\" (UniqueName: \"kubernetes.io/projected/8dd887eb-41d0-4861-a5b8-4be593422241-kube-api-access-f9b5t\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:17.371241 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.371222    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4w5k\" (UniqueName: \"kubernetes.io/projected/dee611c8-1f4c-486b-a0c7-4584874acac9-kube-api-access-b4w5k\") pod \"ovnkube-node-vxbcp\" (UID: \"dee611c8-1f4c-486b-a0c7-4584874acac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.374845 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.374826    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7gq5\" (UniqueName: \"kubernetes.io/projected/e7341bdd-c654-4188-bce4-8cd18669ebfa-kube-api-access-z7gq5\") pod \"node-ca-vrvvx\" (UID: \"e7341bdd-c654-4188-bce4-8cd18669ebfa\") " pod="openshift-image-registry/node-ca-vrvvx"
Sep 11 20:00:17.375064 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.375042    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqrjc\" (UniqueName: \"kubernetes.io/projected/8b217b0a-fb3e-4b5a-942a-0f57a3913ca9-kube-api-access-zqrjc\") pod \"multus-additional-cni-plugins-jkfkl\" (UID: \"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9\") " pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.375252 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.375232    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg9c2\" (UniqueName: \"kubernetes.io/projected/7b243401-1c1f-450e-b17c-6978d2554ff0-kube-api-access-dg9c2\") pod \"iptables-alerter-vchkm\" (UID: \"7b243401-1c1f-450e-b17c-6978d2554ff0\") " pod="openshift-network-operator/iptables-alerter-vchkm"
Sep 11 20:00:17.462727 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.462689    2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 20:00:17.463385 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.463358    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-var-lib-cni-multus\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.463432    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-var-lib-cni-multus\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.463697    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-hostroot\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.463739    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f62e8683-1a77-47c2-981b-a832d9df930c-kubelet-config\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.463810    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-multus-conf-dir\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.463825    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-hostroot\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.463871    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f62e8683-1a77-47c2-981b-a832d9df930c-kubelet-config\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.463760    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-multus-conf-dir\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.463965    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-sysctl-conf\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.463993    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464026    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464056    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f62e8683-1a77-47c2-981b-a832d9df930c-dbus\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464085    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-sysctl-d\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464474    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-socket-dir\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464517    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-sys-fs\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464548    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dncz2\" (UniqueName: \"kubernetes.io/projected/a507914b-4ebf-46c4-94ed-cc292bce63c4-kube-api-access-dncz2\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464582    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-multus-socket-dir-parent\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.465944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464611    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-run\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464640    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-run-k8s-cni-cncf-io\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464667    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-run-netns\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464696    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-var-lib-kubelet\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464724    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-tmp\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464751    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f20ee550-9f30-480a-9b31-ebc964ae0fe0-agent-certs\") pod \"konnectivity-agent-xsg69\" (UID: \"f20ee550-9f30-480a-9b31-ebc964ae0fe0\") " pod="kube-system/konnectivity-agent-xsg69"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464775    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f20ee550-9f30-480a-9b31-ebc964ae0fe0-konnectivity-ca\") pod \"konnectivity-agent-xsg69\" (UID: \"f20ee550-9f30-480a-9b31-ebc964ae0fe0\") " pod="kube-system/konnectivity-agent-xsg69"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464804    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30b3adc7-99ac-4743-9eb5-c1d99ceb1b79-hosts-file\") pod \"node-resolver-sdh4n\" (UID: \"30b3adc7-99ac-4743-9eb5-c1d99ceb1b79\") " pod="openshift-dns/node-resolver-sdh4n"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464832    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6mhb\" (UniqueName: \"kubernetes.io/projected/30b3adc7-99ac-4743-9eb5-c1d99ceb1b79-kube-api-access-h6mhb\") pod \"node-resolver-sdh4n\" (UID: \"30b3adc7-99ac-4743-9eb5-c1d99ceb1b79\") " pod="openshift-dns/node-resolver-sdh4n"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464861    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f18aa82-473c-4dfb-82db-31a149631d21-multus-daemon-config\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464885    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-multus-cni-dir\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464913    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-tuned\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464941    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-modprobe-d\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.464999    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-cnibin\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465029    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465060    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-var-lib-kubelet\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465091    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-run-multus-certs\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465128    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-var-lib-cni-bin\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.466808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465156    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-systemd\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465185    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-lib-modules\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465215    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-host\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465259    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-etc-kubernetes\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465286    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-sysconfig\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465315    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-sys\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465343    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-registration-dir\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465376    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f18aa82-473c-4dfb-82db-31a149631d21-cni-binary-copy\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465403    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-kubernetes\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465438    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-device-dir\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465467    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30b3adc7-99ac-4743-9eb5-c1d99ceb1b79-tmp-dir\") pod \"node-resolver-sdh4n\" (UID: \"30b3adc7-99ac-4743-9eb5-c1d99ceb1b79\") " pod="openshift-dns/node-resolver-sdh4n"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465494    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wghvb\" (UniqueName: \"kubernetes.io/projected/7f18aa82-473c-4dfb-82db-31a149631d21-kube-api-access-wghvb\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465524    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-system-cni-dir\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465552    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-785nl\" (UniqueName: \"kubernetes.io/projected/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-kube-api-access-785nl\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465868    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-cnibin\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465931    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-host\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.465986    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-lib-modules\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466049    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-device-dir\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.467635 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.465911    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466065    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-multus-cni-dir\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466082    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-var-lib-cni-bin\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466068    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-run-multus-certs\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466085    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f62e8683-1a77-47c2-981b-a832d9df930c-dbus\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466129    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-registration-dir\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.466142    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret podName:f62e8683-1a77-47c2-981b-a832d9df930c nodeName:}" failed. No retries permitted until 2026-09-11 20:00:17.966119368 +0000 UTC m=+3.127369589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret") pod "global-pull-secret-syncer-vsxwz" (UID: "f62e8683-1a77-47c2-981b-a832d9df930c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466214    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-run-k8s-cni-cncf-io\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466235    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-socket-dir\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466254    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-modprobe-d\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466268    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-sys-fs\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466285    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-etc-kubernetes\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466301    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30b3adc7-99ac-4743-9eb5-c1d99ceb1b79-tmp-dir\") pod \"node-resolver-sdh4n\" (UID: \"30b3adc7-99ac-4743-9eb5-c1d99ceb1b79\") " pod="openshift-dns/node-resolver-sdh4n"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466312    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-var-lib-kubelet\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466319    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-systemd\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466567    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-sys\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466595    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.468168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466663    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a507914b-4ebf-46c4-94ed-cc292bce63c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466685    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-run-netns\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466784    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-sysctl-d\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466835    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-multus-socket-dir-parent\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466874    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-run\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.466981    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30b3adc7-99ac-4743-9eb5-c1d99ceb1b79-hosts-file\") pod \"node-resolver-sdh4n\" (UID: \"30b3adc7-99ac-4743-9eb5-c1d99ceb1b79\") " pod="openshift-dns/node-resolver-sdh4n"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.467129    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f20ee550-9f30-480a-9b31-ebc964ae0fe0-konnectivity-ca\") pod \"konnectivity-agent-xsg69\" (UID: \"f20ee550-9f30-480a-9b31-ebc964ae0fe0\") " pod="kube-system/konnectivity-agent-xsg69"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.467134    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f18aa82-473c-4dfb-82db-31a149631d21-multus-daemon-config\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.467198    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-host-var-lib-kubelet\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.467200    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f18aa82-473c-4dfb-82db-31a149631d21-cni-binary-copy\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.467313    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-kubernetes\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.467335    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f18aa82-473c-4dfb-82db-31a149631d21-system-cni-dir\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.467339    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-sysctl-conf\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.468641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.467430    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-sysconfig\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.469178 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.469098    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-etc-tuned\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.469178 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.469139    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-tmp\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.469269 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.469254    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f20ee550-9f30-480a-9b31-ebc964ae0fe0-agent-certs\") pod \"konnectivity-agent-xsg69\" (UID: \"f20ee550-9f30-480a-9b31-ebc964ae0fe0\") " pod="kube-system/konnectivity-agent-xsg69"
Sep 11 20:00:17.478439 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.478380    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-785nl\" (UniqueName: \"kubernetes.io/projected/7f78ce6a-8dae-49d8-9fc7-a42f0315eddc-kube-api-access-785nl\") pod \"tuned-6p4c6\" (UID: \"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.478831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.478810    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6mhb\" (UniqueName: \"kubernetes.io/projected/30b3adc7-99ac-4743-9eb5-c1d99ceb1b79-kube-api-access-h6mhb\") pod \"node-resolver-sdh4n\" (UID: \"30b3adc7-99ac-4743-9eb5-c1d99ceb1b79\") " pod="openshift-dns/node-resolver-sdh4n"
Sep 11 20:00:17.479209 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.479167    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wghvb\" (UniqueName: \"kubernetes.io/projected/7f18aa82-473c-4dfb-82db-31a149631d21-kube-api-access-wghvb\") pod \"multus-pcq4x\" (UID: \"7f18aa82-473c-4dfb-82db-31a149631d21\") " pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.479464 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.479444    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dncz2\" (UniqueName: \"kubernetes.io/projected/a507914b-4ebf-46c4-94ed-cc292bce63c4-kube-api-access-dncz2\") pod \"aws-ebs-csi-driver-node-bngnv\" (UID: \"a507914b-4ebf-46c4-94ed-cc292bce63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.549560 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.549526    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:17.553653 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.553634    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vrvvx"
Sep 11 20:00:17.559492 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:17.559469    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee611c8_1f4c_486b_a0c7_4584874acac9.slice/crio-1af0683847a4915ed7b10567ff27f00a61392666720e0e0d2175dcd035354574 WatchSource:0}: Error finding container 1af0683847a4915ed7b10567ff27f00a61392666720e0e0d2175dcd035354574: Status 404 returned error can't find the container with id 1af0683847a4915ed7b10567ff27f00a61392666720e0e0d2175dcd035354574
Sep 11 20:00:17.560611 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.560595    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jkfkl"
Sep 11 20:00:17.561239 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:17.561219    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7341bdd_c654_4188_bce4_8cd18669ebfa.slice/crio-630bc13307b47a92045cf8cea55a91b225f65710147e8ed8d466b4840eb7a696 WatchSource:0}: Error finding container 630bc13307b47a92045cf8cea55a91b225f65710147e8ed8d466b4840eb7a696: Status 404 returned error can't find the container with id 630bc13307b47a92045cf8cea55a91b225f65710147e8ed8d466b4840eb7a696
Sep 11 20:00:17.566396 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.566377    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pcq4x"
Sep 11 20:00:17.569461 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:17.569443    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b217b0a_fb3e_4b5a_942a_0f57a3913ca9.slice/crio-d7b2c6a708b5bc2b9f369d1acc33b5b86e74a640f368fbe159a227eb6d4a2a4d WatchSource:0}: Error finding container d7b2c6a708b5bc2b9f369d1acc33b5b86e74a640f368fbe159a227eb6d4a2a4d: Status 404 returned error can't find the container with id d7b2c6a708b5bc2b9f369d1acc33b5b86e74a640f368fbe159a227eb6d4a2a4d
Sep 11 20:00:17.572407 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.572386    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vchkm"
Sep 11 20:00:17.573647 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:17.573627    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f18aa82_473c_4dfb_82db_31a149631d21.slice/crio-d920f653cb72fa37b02ff6d0a5846adde5841de9b79d2d81b62e090794e9c9ea WatchSource:0}: Error finding container d920f653cb72fa37b02ff6d0a5846adde5841de9b79d2d81b62e090794e9c9ea: Status 404 returned error can't find the container with id d920f653cb72fa37b02ff6d0a5846adde5841de9b79d2d81b62e090794e9c9ea
Sep 11 20:00:17.577647 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.577629    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xsg69"
Sep 11 20:00:17.581661 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:17.581643    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b243401_1c1f_450e_b17c_6978d2554ff0.slice/crio-a2c227888bd3ea3031fd3822f6a15b0006af6f93e66706d436616b67e0fdd2ef WatchSource:0}: Error finding container a2c227888bd3ea3031fd3822f6a15b0006af6f93e66706d436616b67e0fdd2ef: Status 404 returned error can't find the container with id a2c227888bd3ea3031fd3822f6a15b0006af6f93e66706d436616b67e0fdd2ef
Sep 11 20:00:17.582640 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.582628    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv"
Sep 11 20:00:17.586366 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:17.586349    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20ee550_9f30_480a_9b31_ebc964ae0fe0.slice/crio-805efec78dc197691bfa3fc7d7b697aeb7f75b2224833843eb224923852a4209 WatchSource:0}: Error finding container 805efec78dc197691bfa3fc7d7b697aeb7f75b2224833843eb224923852a4209: Status 404 returned error can't find the container with id 805efec78dc197691bfa3fc7d7b697aeb7f75b2224833843eb224923852a4209
Sep 11 20:00:17.590178 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.590162    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6p4c6"
Sep 11 20:00:17.592996 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:17.592949    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda507914b_4ebf_46c4_94ed_cc292bce63c4.slice/crio-e09a830391d597bfb8d2b1635405993739faa3d11261ed78d94a4ab65ee124d9 WatchSource:0}: Error finding container e09a830391d597bfb8d2b1635405993739faa3d11261ed78d94a4ab65ee124d9: Status 404 returned error can't find the container with id e09a830391d597bfb8d2b1635405993739faa3d11261ed78d94a4ab65ee124d9
Sep 11 20:00:17.593500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.593486    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sdh4n"
Sep 11 20:00:17.598209 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:17.598191    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f78ce6a_8dae_49d8_9fc7_a42f0315eddc.slice/crio-e4dcfaf2b267d981fab3696942f052ae0faf0e940659cfd33395ccc8dd61f4ad WatchSource:0}: Error finding container e4dcfaf2b267d981fab3696942f052ae0faf0e940659cfd33395ccc8dd61f4ad: Status 404 returned error can't find the container with id e4dcfaf2b267d981fab3696942f052ae0faf0e940659cfd33395ccc8dd61f4ad
Sep 11 20:00:17.602186 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:17.602170    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b3adc7_99ac_4743_9eb5_c1d99ceb1b79.slice/crio-4feb7b5cb00a234cbc6e322f005ad7b64276d710050369016f0864d5588b6ea2 WatchSource:0}: Error finding container 4feb7b5cb00a234cbc6e322f005ad7b64276d710050369016f0864d5588b6ea2: Status 404 returned error can't find the container with id 4feb7b5cb00a234cbc6e322f005ad7b64276d710050369016f0864d5588b6ea2
Sep 11 20:00:17.868389 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.868297    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:17.868552 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.868445    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:17.868552 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.868504    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs podName:8dd887eb-41d0-4861-a5b8-4be593422241 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:18.868489042 +0000 UTC m=+4.029739279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs") pod "network-metrics-daemon-zn8nm" (UID: "8dd887eb-41d0-4861-a5b8-4be593422241") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:17.969031 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.968982    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:17.969194 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:17.969062    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hljfp\" (UniqueName: \"kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp\") pod \"network-check-target-7jr97\" (UID: \"308fdcdd-97ce-4c84-8020-cdfe11c51d09\") " pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:17.969247 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.969225    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:17.969286 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.969261    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 20:00:17.969286 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.969278    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 20:00:17.969347 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.969290    2585 projected.go:196] Error preparing data for projected volume kube-api-access-hljfp for pod openshift-network-diagnostics/network-check-target-7jr97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 20:00:17.969347 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.969295    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret podName:f62e8683-1a77-47c2-981b-a832d9df930c nodeName:}" failed. No retries permitted until 2026-09-11 20:00:18.969280573 +0000 UTC m=+4.130530793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret") pod "global-pull-secret-syncer-vsxwz" (UID: "f62e8683-1a77-47c2-981b-a832d9df930c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:17.969347 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:17.969330    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp podName:308fdcdd-97ce-4c84-8020-cdfe11c51d09 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:18.969318316 +0000 UTC m=+4.130568537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hljfp" (UniqueName: "kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp") pod "network-check-target-7jr97" (UID: "308fdcdd-97ce-4c84-8020-cdfe11c51d09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 20:00:18.296547 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.296219    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 19:55:17 +0000 UTC" deadline="2028-03-29 12:54:09.708667357 +0000 UTC"
Sep 11 20:00:18.296547 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.296455    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13552h53m51.412217153s"
Sep 11 20:00:18.344250 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.343584    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:18.344250 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:18.343714    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:18.344250 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.344115    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:18.344250 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:18.344214    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:18.369002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.368967    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vrvvx" event={"ID":"e7341bdd-c654-4188-bce4-8cd18669ebfa","Type":"ContainerStarted","Data":"630bc13307b47a92045cf8cea55a91b225f65710147e8ed8d466b4840eb7a696"}
Sep 11 20:00:18.385251 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.385189    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp" event={"ID":"dee611c8-1f4c-486b-a0c7-4584874acac9","Type":"ContainerStarted","Data":"1af0683847a4915ed7b10567ff27f00a61392666720e0e0d2175dcd035354574"}
Sep 11 20:00:18.411769 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.411731    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sdh4n" event={"ID":"30b3adc7-99ac-4743-9eb5-c1d99ceb1b79","Type":"ContainerStarted","Data":"4feb7b5cb00a234cbc6e322f005ad7b64276d710050369016f0864d5588b6ea2"}
Sep 11 20:00:18.424643 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.424608    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkfkl" event={"ID":"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9","Type":"ContainerStarted","Data":"d7b2c6a708b5bc2b9f369d1acc33b5b86e74a640f368fbe159a227eb6d4a2a4d"}
Sep 11 20:00:18.438166 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.438110    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6p4c6" event={"ID":"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc","Type":"ContainerStarted","Data":"e4dcfaf2b267d981fab3696942f052ae0faf0e940659cfd33395ccc8dd61f4ad"}
Sep 11 20:00:18.444981 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.444937    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv" event={"ID":"a507914b-4ebf-46c4-94ed-cc292bce63c4","Type":"ContainerStarted","Data":"e09a830391d597bfb8d2b1635405993739faa3d11261ed78d94a4ab65ee124d9"}
Sep 11 20:00:18.453112 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.452945    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xsg69" event={"ID":"f20ee550-9f30-480a-9b31-ebc964ae0fe0","Type":"ContainerStarted","Data":"805efec78dc197691bfa3fc7d7b697aeb7f75b2224833843eb224923852a4209"}
Sep 11 20:00:18.464877 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.464804    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vchkm" event={"ID":"7b243401-1c1f-450e-b17c-6978d2554ff0","Type":"ContainerStarted","Data":"a2c227888bd3ea3031fd3822f6a15b0006af6f93e66706d436616b67e0fdd2ef"}
Sep 11 20:00:18.470613 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.470546    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pcq4x" event={"ID":"7f18aa82-473c-4dfb-82db-31a149631d21","Type":"ContainerStarted","Data":"d920f653cb72fa37b02ff6d0a5846adde5841de9b79d2d81b62e090794e9c9ea"}
Sep 11 20:00:18.625568 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.625499    2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 20:00:18.879146 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.878520    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:18.879146 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:18.878670    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:18.879146 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:18.878734    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs podName:8dd887eb-41d0-4861-a5b8-4be593422241 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:20.878715454 +0000 UTC m=+6.039965677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs") pod "network-metrics-daemon-zn8nm" (UID: "8dd887eb-41d0-4861-a5b8-4be593422241") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:18.979625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.979074    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:18.979625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:18.979134    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hljfp\" (UniqueName: \"kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp\") pod \"network-check-target-7jr97\" (UID: \"308fdcdd-97ce-4c84-8020-cdfe11c51d09\") " pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:18.979625 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:18.979258    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 20:00:18.979625 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:18.979276    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 20:00:18.979625 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:18.979289    2585 projected.go:196] Error preparing data for projected volume kube-api-access-hljfp for pod openshift-network-diagnostics/network-check-target-7jr97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 20:00:18.979625 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:18.979347    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp podName:308fdcdd-97ce-4c84-8020-cdfe11c51d09 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:20.979327646 +0000 UTC m=+6.140577871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hljfp" (UniqueName: "kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp") pod "network-check-target-7jr97" (UID: "308fdcdd-97ce-4c84-8020-cdfe11c51d09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 20:00:18.991243 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:18.991106    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:18.991243 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:18.991191    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret podName:f62e8683-1a77-47c2-981b-a832d9df930c nodeName:}" failed. No retries permitted until 2026-09-11 20:00:20.991172315 +0000 UTC m=+6.152422539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret") pod "global-pull-secret-syncer-vsxwz" (UID: "f62e8683-1a77-47c2-981b-a832d9df930c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:19.297145 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:19.297033    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 19:55:17 +0000 UTC" deadline="2028-05-28 17:18:54.150617368 +0000 UTC"
Sep 11 20:00:19.297145 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:19.297100    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14997h18m34.853521295s"
Sep 11 20:00:19.346987 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:19.346174    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:19.346987 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:19.346318    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:19.495638 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:19.495585    2585 generic.go:356] "Generic (PLEG): container finished" podID="ea15ae8e22d594ee8a48c2619632f052" containerID="07b3f63c051b2d6ae3b3c2880e444478b686c6d351218af2420144f24e441ce4" exitCode=0
Sep 11 20:00:19.495638 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:19.495633    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal" event={"ID":"ea15ae8e22d594ee8a48c2619632f052","Type":"ContainerDied","Data":"07b3f63c051b2d6ae3b3c2880e444478b686c6d351218af2420144f24e441ce4"}
Sep 11 20:00:20.347043 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:20.343679    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:20.347043 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:20.343808    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:20.347043 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:20.346870    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:20.347043 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:20.346991    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:20.520890 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:20.520805    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal" event={"ID":"ea15ae8e22d594ee8a48c2619632f052","Type":"ContainerStarted","Data":"4526e8ea942523c16fd9176b6d4c79bea1020562e7071623ef28530f060a43e7"}
Sep 11 20:00:20.896198 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:20.896109    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:20.896365 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:20.896303    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:20.896365 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:20.896361    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs podName:8dd887eb-41d0-4861-a5b8-4be593422241 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:24.896344002 +0000 UTC m=+10.057594224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs") pod "network-metrics-daemon-zn8nm" (UID: "8dd887eb-41d0-4861-a5b8-4be593422241") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:20.996913 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:20.996875    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:20.997096 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:20.996947    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hljfp\" (UniqueName: \"kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp\") pod \"network-check-target-7jr97\" (UID: \"308fdcdd-97ce-4c84-8020-cdfe11c51d09\") " pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:20.997164 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:20.997139    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 20:00:20.997164 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:20.997158    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 20:00:20.997264 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:20.997171    2585 projected.go:196] Error preparing data for projected volume kube-api-access-hljfp for pod openshift-network-diagnostics/network-check-target-7jr97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 20:00:20.997264 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:20.997229    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp podName:308fdcdd-97ce-4c84-8020-cdfe11c51d09 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:24.997211216 +0000 UTC m=+10.158461441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hljfp" (UniqueName: "kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp") pod "network-check-target-7jr97" (UID: "308fdcdd-97ce-4c84-8020-cdfe11c51d09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 20:00:20.997843 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:20.997728    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:20.997843 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:20.997791    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret podName:f62e8683-1a77-47c2-981b-a832d9df930c nodeName:}" failed. No retries permitted until 2026-09-11 20:00:24.997774917 +0000 UTC m=+10.159025151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret") pod "global-pull-secret-syncer-vsxwz" (UID: "f62e8683-1a77-47c2-981b-a832d9df930c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:21.344167 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:21.344093    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:21.344315 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:21.344239    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:22.342800 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:22.342765    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:22.343267 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:22.342890    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:22.343342 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:22.343313    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:22.343444 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:22.343419    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:23.343548 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:23.343511    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:23.343946 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:23.343660    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:24.343697 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:24.343615    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:24.344168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:24.343617    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:24.344168 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:24.343748    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:24.344168 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:24.343856    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:24.929807 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:24.929527    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:24.929807 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:24.929673    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:24.929807 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:24.929736    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs podName:8dd887eb-41d0-4861-a5b8-4be593422241 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:32.929717409 +0000 UTC m=+18.090967661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs") pod "network-metrics-daemon-zn8nm" (UID: "8dd887eb-41d0-4861-a5b8-4be593422241") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:25.030928 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:25.030265    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:25.030928 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:25.030340    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hljfp\" (UniqueName: \"kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp\") pod \"network-check-target-7jr97\" (UID: \"308fdcdd-97ce-4c84-8020-cdfe11c51d09\") " pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:25.030928 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:25.030503    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 20:00:25.030928 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:25.030521    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 20:00:25.030928 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:25.030542    2585 projected.go:196] Error preparing data for projected volume kube-api-access-hljfp for pod openshift-network-diagnostics/network-check-target-7jr97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 20:00:25.030928 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:25.030601    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp podName:308fdcdd-97ce-4c84-8020-cdfe11c51d09 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:33.030583569 +0000 UTC m=+18.191833802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hljfp" (UniqueName: "kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp") pod "network-check-target-7jr97" (UID: "308fdcdd-97ce-4c84-8020-cdfe11c51d09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 20:00:25.031337 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:25.030941    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:25.031337 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:25.031007    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret podName:f62e8683-1a77-47c2-981b-a832d9df930c nodeName:}" failed. No retries permitted until 2026-09-11 20:00:33.030992038 +0000 UTC m=+18.192242263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret") pod "global-pull-secret-syncer-vsxwz" (UID: "f62e8683-1a77-47c2-981b-a832d9df930c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:25.346083 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:25.346052    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:25.346525 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:25.346178    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:26.343289 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:26.343248    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:26.343454 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:26.343296    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:26.343454 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:26.343367    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:26.343575 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:26.343493    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:27.343503 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:27.343470    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:27.344074 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:27.343616    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:28.343787 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:28.343751    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:28.344249 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:28.343792    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:28.344249 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:28.343895    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:28.344249 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:28.344041    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:29.343674 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:29.343615    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:29.343839 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:29.343739    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:30.342783 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:30.342746    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:30.342982 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:30.342864    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:30.342982 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:30.342922    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:30.343108 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:30.343038    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:31.343775 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:31.343745    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:31.344173 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:31.343917    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:32.343729 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:32.343698    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:32.344019 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:32.343699    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:32.344019 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:32.343821    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:32.344019 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:32.343921    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:32.986509 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:32.986467    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:32.986667 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:32.986578    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:32.986667 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:32.986633    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs podName:8dd887eb-41d0-4861-a5b8-4be593422241 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:48.98661598 +0000 UTC m=+34.147866202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs") pod "network-metrics-daemon-zn8nm" (UID: "8dd887eb-41d0-4861-a5b8-4be593422241") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:33.087039 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:33.087006    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:33.087212 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:33.087064    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hljfp\" (UniqueName: \"kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp\") pod \"network-check-target-7jr97\" (UID: \"308fdcdd-97ce-4c84-8020-cdfe11c51d09\") " pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:33.087212 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:33.087173    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:33.087212 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:33.087199    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 20:00:33.087360 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:33.087216    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 20:00:33.087360 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:33.087228    2585 projected.go:196] Error preparing data for projected volume kube-api-access-hljfp for pod openshift-network-diagnostics/network-check-target-7jr97: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 20:00:33.087360 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:33.087242    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret podName:f62e8683-1a77-47c2-981b-a832d9df930c nodeName:}" failed. No retries permitted until 2026-09-11 20:00:49.087224353 +0000 UTC m=+34.248474589 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret") pod "global-pull-secret-syncer-vsxwz" (UID: "f62e8683-1a77-47c2-981b-a832d9df930c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:33.087360 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:33.087275    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp podName:308fdcdd-97ce-4c84-8020-cdfe11c51d09 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:49.087258308 +0000 UTC m=+34.248508531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hljfp" (UniqueName: "kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp") pod "network-check-target-7jr97" (UID: "308fdcdd-97ce-4c84-8020-cdfe11c51d09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 20:00:33.343027 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:33.342995    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:33.343187 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:33.343124    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:34.342788 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:34.342751    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:34.343278 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:34.342760    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:34.343278 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:34.342878    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:34.343278 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:34.342972    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:35.344049 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:35.344020    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:35.344493 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:35.344130    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:36.343505 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.343290    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:36.343636 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.343290    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:36.343636 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:36.343581    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:36.343747 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:36.343679    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:36.552417 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.552393    2585 generic.go:356] "Generic (PLEG): container finished" podID="8b217b0a-fb3e-4b5a-942a-0f57a3913ca9" containerID="37f8afbc7beec57644965db73a755e4a73b941f241319aa58d9cf01996f49022" exitCode=0
Sep 11 20:00:36.552862 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.552467    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkfkl" event={"ID":"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9","Type":"ContainerDied","Data":"37f8afbc7beec57644965db73a755e4a73b941f241319aa58d9cf01996f49022"}
Sep 11 20:00:36.556018 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.555993    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6p4c6" event={"ID":"7f78ce6a-8dae-49d8-9fc7-a42f0315eddc","Type":"ContainerStarted","Data":"3a4bdbde0c26af64c1c324ab3e5f81beb2b93ff678b09b6db1315747fbf77b0d"}
Sep 11 20:00:36.557575 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.557552    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv" event={"ID":"a507914b-4ebf-46c4-94ed-cc292bce63c4","Type":"ContainerStarted","Data":"8add5b3b3b540feb6545197c46cd4cd5fd4e9319869f5e4e5676a6a8ae768b70"}
Sep 11 20:00:36.558924 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.558901    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xsg69" event={"ID":"f20ee550-9f30-480a-9b31-ebc964ae0fe0","Type":"ContainerStarted","Data":"f93473fef76c9e5d3f77ed2ba8afeb7cb1010c89eefa128f1b831942aaab8d84"}
Sep 11 20:00:36.560654 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.560634    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pcq4x" event={"ID":"7f18aa82-473c-4dfb-82db-31a149631d21","Type":"ContainerStarted","Data":"e799b856555219c0d410d8b06b589a1517d34c241a15928069de5c2b138c0c29"}
Sep 11 20:00:36.561997 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.561941    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vrvvx" event={"ID":"e7341bdd-c654-4188-bce4-8cd18669ebfa","Type":"ContainerStarted","Data":"7584a55abc17379c2ffb2d36a680f971cff6f9ff4d5d1920f0cef9bf54788f0b"}
Sep 11 20:00:36.564171 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.564153    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp" event={"ID":"dee611c8-1f4c-486b-a0c7-4584874acac9","Type":"ContainerStarted","Data":"42b02262ccf1afb55f236c3226b5805b65b8394491d3def59b404816552b5d92"}
Sep 11 20:00:36.564300 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.564211    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp" event={"ID":"dee611c8-1f4c-486b-a0c7-4584874acac9","Type":"ContainerStarted","Data":"ed3b186127bddbfb181ae6ffd94b41fb641ac5b46a1eb055009b8933307787e8"}
Sep 11 20:00:36.564300 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.564252    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp" event={"ID":"dee611c8-1f4c-486b-a0c7-4584874acac9","Type":"ContainerStarted","Data":"7483aa5b1be7b4d2ff8830c314da660748ab0c4bc6f287f8f133d888e541042a"}
Sep 11 20:00:36.564300 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.564290    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp" event={"ID":"dee611c8-1f4c-486b-a0c7-4584874acac9","Type":"ContainerStarted","Data":"0f528cc031deecf3006e3a43851c60b9eedc3c52f5460400c1d6f01f784b6ce9"}
Sep 11 20:00:36.565457 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.565439    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-146.ec2.internal" event={"ID":"3675b94d77e2c8e178e2e49334541679","Type":"ContainerStarted","Data":"5155935ed5c2f8893ebddeebb711bbb39e5211fb5acfb10a3234eb4c4696f320"}
Sep 11 20:00:36.566684 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.566666    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sdh4n" event={"ID":"30b3adc7-99ac-4743-9eb5-c1d99ceb1b79","Type":"ContainerStarted","Data":"7589ed5b7e6d159cef96a40a747b0b488f8a5a191d35687a3a33362d8bf92a56"}
Sep 11 20:00:36.574763 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.574726    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-146.ec2.internal" podStartSLOduration=20.574713779 podStartE2EDuration="20.574713779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:00:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:20.550276073 +0000 UTC m=+5.711526329" watchObservedRunningTime="2026-09-11 20:00:36.574713779 +0000 UTC m=+21.735964018"
Sep 11 20:00:36.590329 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.590296    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6p4c6" podStartSLOduration=3.180165636 podStartE2EDuration="21.590284809s" totalImagesPullingTime="18.410119173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:36.589946768 +0000 UTC m=+21.751197010" watchObservedRunningTime="2026-09-11 20:00:36.590284809 +0000 UTC m=+21.751535050"
Sep 11 20:00:36.603101 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.603067    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-146.ec2.internal" podStartSLOduration=20.603056703 podStartE2EDuration="20.603056703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:00:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:36.60276519 +0000 UTC m=+21.764015434" watchObservedRunningTime="2026-09-11 20:00:36.603056703 +0000 UTC m=+21.764306944"
Sep 11 20:00:36.640231 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.640200    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vrvvx" podStartSLOduration=3.193293628 podStartE2EDuration="21.640188222s" totalImagesPullingTime="18.446894594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:36.623601773 +0000 UTC m=+21.784852012" watchObservedRunningTime="2026-09-11 20:00:36.640188222 +0000 UTC m=+21.801438463"
Sep 11 20:00:36.640643 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.640620    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xsg69" podStartSLOduration=3.236278174 podStartE2EDuration="21.640612542s" totalImagesPullingTime="18.404334368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:36.639892226 +0000 UTC m=+21.801142468" watchObservedRunningTime="2026-09-11 20:00:36.640612542 +0000 UTC m=+21.801862785"
Sep 11 20:00:36.672845 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.672808    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sdh4n" podStartSLOduration=3.280820781 podStartE2EDuration="21.672795653s" totalImagesPullingTime="18.391974872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:36.654480117 +0000 UTC m=+21.815730359" watchObservedRunningTime="2026-09-11 20:00:36.672795653 +0000 UTC m=+21.834045894"
Sep 11 20:00:36.672984 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:36.672944    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pcq4x" podStartSLOduration=3.206681579 podStartE2EDuration="21.672938765s" totalImagesPullingTime="18.466257186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:36.67255995 +0000 UTC m=+21.833810193" watchObservedRunningTime="2026-09-11 20:00:36.672938765 +0000 UTC m=+21.834189003"
Sep 11 20:00:37.343480 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:37.343447    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:37.343671 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:37.343581    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:37.577698 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:37.577666    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp" event={"ID":"dee611c8-1f4c-486b-a0c7-4584874acac9","Type":"ContainerStarted","Data":"30d7b92d52bbfec77341967343e9c62fa1221e9e8effa5d3477d60afc61078d5"}
Sep 11 20:00:37.578281 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:37.577777    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp" event={"ID":"dee611c8-1f4c-486b-a0c7-4584874acac9","Type":"ContainerStarted","Data":"9850c29161388b8dab430e18f376966bfa7e9626a7a7a7dddcdf0769bcb82c9d"}
Sep 11 20:00:37.667248 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:37.667211    2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 20:00:38.330496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:38.330409    2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T20:00:37.667231902Z","UUID":"70722f6f-c584-4d4e-839c-f60ff516a300","Handler":null,"Name":"","Endpoint":""}
Sep 11 20:00:38.331814 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:38.331793    2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 20:00:38.331814 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:38.331818    2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 20:00:38.342859 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:38.342836    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:38.342996 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:38.342836    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:38.343075 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:38.343024    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:38.343075 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:38.343055    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:38.582783 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:38.582744    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv" event={"ID":"a507914b-4ebf-46c4-94ed-cc292bce63c4","Type":"ContainerStarted","Data":"35027ba1bd207e3332d04d90d72bec41d46ffcae79315e6a1d9e0a8133c92a01"}
Sep 11 20:00:38.584537 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:38.584505    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vchkm" event={"ID":"7b243401-1c1f-450e-b17c-6978d2554ff0","Type":"ContainerStarted","Data":"e66e1fd3158810c4901598cac8f3c51b307fe0e009e0e7c2ddac6e483584dfe7"}
Sep 11 20:00:39.343433 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:39.343408    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:39.343615 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:39.343525    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:39.589852 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:39.589814    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv" event={"ID":"a507914b-4ebf-46c4-94ed-cc292bce63c4","Type":"ContainerStarted","Data":"31cd369902624b098fe2e35d0e0355353c612b8804971450d11ed6e9506ec62f"}
Sep 11 20:00:39.595434 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:39.595361    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp" event={"ID":"dee611c8-1f4c-486b-a0c7-4584874acac9","Type":"ContainerStarted","Data":"6581bb133db5149345c81b66dd3db26427caab389fd79b65ec64a6d8804a1111"}
Sep 11 20:00:39.609464 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:39.609424    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vchkm" podStartSLOduration=6.183309292 podStartE2EDuration="24.60941064s" totalImagesPullingTime="18.426101348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:38.599444845 +0000 UTC m=+23.760695090" watchObservedRunningTime="2026-09-11 20:00:39.60941064 +0000 UTC m=+24.770660881"
Sep 11 20:00:39.609677 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:39.609654    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bngnv" podStartSLOduration=3.693578676 podStartE2EDuration="24.609650292s" totalImagesPullingTime="20.916071616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:39.60818856 +0000 UTC m=+24.769438803" watchObservedRunningTime="2026-09-11 20:00:39.609650292 +0000 UTC m=+24.770900533"
Sep 11 20:00:40.343968 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:40.343757    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:40.344171 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:40.343757    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:40.344171 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:40.344088    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:40.344269 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:40.344173    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:41.281166 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:41.281089    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xsg69"
Sep 11 20:00:41.281811 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:41.281785    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xsg69"
Sep 11 20:00:41.343738 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:41.343710    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:41.343889 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:41.343840    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:41.599640 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:41.599612    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xsg69"
Sep 11 20:00:41.600627 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:41.600445    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xsg69"
Sep 11 20:00:42.343754 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:42.343584    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:42.344163 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:42.343584    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:42.344163 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:42.343820    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:42.344163 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:42.343919    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:42.604633 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:42.604545    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp" event={"ID":"dee611c8-1f4c-486b-a0c7-4584874acac9","Type":"ContainerStarted","Data":"e445287f1e75e9c8135d2f9e1c597b29ed73e4b66db3aff2f95cfd925cab6dd6"}
Sep 11 20:00:42.604786 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:42.604750    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:42.604831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:42.604817    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:42.606418 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:42.606396    2585 generic.go:356] "Generic (PLEG): container finished" podID="8b217b0a-fb3e-4b5a-942a-0f57a3913ca9" containerID="e8403c30fb67c86d9dbf629deb3de2f1a0da1861fa2449ed6212ced0805f5ae7" exitCode=0
Sep 11 20:00:42.606532 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:42.606482    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkfkl" event={"ID":"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9","Type":"ContainerDied","Data":"e8403c30fb67c86d9dbf629deb3de2f1a0da1861fa2449ed6212ced0805f5ae7"}
Sep 11 20:00:42.620465 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:42.620445    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:42.633459 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:42.633417    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp" podStartSLOduration=9.032723677 podStartE2EDuration="27.633403022s" totalImagesPullingTime="18.600679345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:42.631872134 +0000 UTC m=+27.793122376" watchObservedRunningTime="2026-09-11 20:00:42.633403022 +0000 UTC m=+27.794653264"
Sep 11 20:00:43.343858 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:43.343828    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:43.344450 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:43.343971    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:43.486406 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:43.486371    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vsxwz"]
Sep 11 20:00:43.486561 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:43.486550    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:43.486710 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:43.486680    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:43.487654 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:43.487629    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7jr97"]
Sep 11 20:00:43.487756 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:43.487729    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:43.487800 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:43.487789    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:43.487972 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:43.487935    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zn8nm"]
Sep 11 20:00:43.608971 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:43.608894    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:43.609612 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:43.609581    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:43.609708 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:43.609640    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:43.626692 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:43.626672    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:00:44.612969 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:44.612925    2585 generic.go:356] "Generic (PLEG): container finished" podID="8b217b0a-fb3e-4b5a-942a-0f57a3913ca9" containerID="0221f9a7ee90b54d7fd9867f6ec4cb44a03c37bbbd7c2328fcfca306fa901ba9" exitCode=0
Sep 11 20:00:44.613500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:44.612992    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkfkl" event={"ID":"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9","Type":"ContainerDied","Data":"0221f9a7ee90b54d7fd9867f6ec4cb44a03c37bbbd7c2328fcfca306fa901ba9"}
Sep 11 20:00:45.343726 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:45.343700    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:45.343871 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:45.343795    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:45.343871 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:45.343817    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:45.344009 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:45.343891    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:45.344009 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:45.343790    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:45.344009 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:45.343991    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:46.620101 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:46.619911    2585 generic.go:356] "Generic (PLEG): container finished" podID="8b217b0a-fb3e-4b5a-942a-0f57a3913ca9" containerID="1d393d129e158a13580e183b3e2df225f04462fb658dbe92def00e69f6c914b6" exitCode=0
Sep 11 20:00:46.620101 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:46.619984    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkfkl" event={"ID":"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9","Type":"ContainerDied","Data":"1d393d129e158a13580e183b3e2df225f04462fb658dbe92def00e69f6c914b6"}
Sep 11 20:00:47.342802 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:47.342771    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:47.342987 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:47.342899    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jr97" podUID="308fdcdd-97ce-4c84-8020-cdfe11c51d09"
Sep 11 20:00:47.343307 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:47.343068    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:47.343307 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:47.343172    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zn8nm" podUID="8dd887eb-41d0-4861-a5b8-4be593422241"
Sep 11 20:00:47.343307 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:47.342781    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:47.343307 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:47.343269    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsxwz" podUID="f62e8683-1a77-47c2-981b-a832d9df930c"
Sep 11 20:00:48.615308 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.615283    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-146.ec2.internal" event="NodeReady"
Sep 11 20:00:48.615624 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.615401    2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 20:00:48.649495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.648784    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9776f6448-6mdj2"]
Sep 11 20:00:48.689162 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.689134    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kc2dt"]
Sep 11 20:00:48.689308 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.689260    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.692273 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.692003    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 20:00:48.692273 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.692018    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l4rd2\""
Sep 11 20:00:48.692273 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.692129    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 20:00:48.692535 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.692382    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 20:00:48.699322 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.699302    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 20:00:48.700033 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.700016    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wn94s"]
Sep 11 20:00:48.700144 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.700129    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:48.702445 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.702428    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 20:00:48.702947 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.702928    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 20:00:48.703047 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.703008    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nbwp6\""
Sep 11 20:00:48.713892 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.713875    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9776f6448-6mdj2"]
Sep 11 20:00:48.713996 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.713909    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kc2dt"]
Sep 11 20:00:48.713996 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.713942    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wn94s"]
Sep 11 20:00:48.714108 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.714038    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wn94s"
Sep 11 20:00:48.716738 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.716719    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 20:00:48.716824 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.716805    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 20:00:48.716866 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.716828    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 20:00:48.716866 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.716830    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fjh5z\""
Sep 11 20:00:48.768376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.768352    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"]
Sep 11 20:00:48.791193 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.791165    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-4zntx"]
Sep 11 20:00:48.791586 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.791567    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"
Sep 11 20:00:48.794600 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.794580    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 20:00:48.795190 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.794719    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 20:00:48.795190 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.794745    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 20:00:48.795190 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.794807    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qvhdg\""
Sep 11 20:00:48.795190 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.794979    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 20:00:48.807564 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807545    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbkc\" (UniqueName: \"kubernetes.io/projected/6700a361-c2da-4e39-92eb-fb1b5619c434-kube-api-access-kpbkc\") pod \"ingress-canary-wn94s\" (UID: \"6700a361-c2da-4e39-92eb-fb1b5619c434\") " pod="openshift-ingress-canary/ingress-canary-wn94s"
Sep 11 20:00:48.807638 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807574    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3afeaa-5162-49cf-b716-f59fcd056613-tmp-dir\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:48.807638 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807598    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4cd97dc-74f4-46f0-b68e-c349940db6d7-image-registry-private-configuration\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.807638 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807623    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4cd97dc-74f4-46f0-b68e-c349940db6d7-ca-trust-extracted\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.807753 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807642    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4cd97dc-74f4-46f0-b68e-c349940db6d7-trusted-ca\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.807753 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807717    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-bound-sa-token\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.807753 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807738    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2c3afeaa-5162-49cf-b716-f59fcd056613-config-volume\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:48.807838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807754    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:48.807838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807812    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.807899 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807836    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-certificates\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.807899 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807853    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whqg7\" (UniqueName: \"kubernetes.io/projected/2c3afeaa-5162-49cf-b716-f59fcd056613-kube-api-access-whqg7\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:48.807899 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807877    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6700a361-c2da-4e39-92eb-fb1b5619c434-cert\") pod \"ingress-canary-wn94s\" (UID: \"6700a361-c2da-4e39-92eb-fb1b5619c434\") " pod="openshift-ingress-canary/ingress-canary-wn94s"
Sep 11 20:00:48.808010 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807916    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4cd97dc-74f4-46f0-b68e-c349940db6d7-installation-pull-secrets\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.808010 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.807938    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kknxl\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-kube-api-access-kknxl\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.815136 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.815089    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-9zm9v"]
Sep 11 20:00:48.815214 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.815198    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:48.817988 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.817948    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 20:00:48.818122 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.818103    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 20:00:48.818198 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.818147    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 20:00:48.818526 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.818502    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 20:00:48.818886 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.818866    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pcssm\""
Sep 11 20:00:48.823454 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.823434    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 20:00:48.839167 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.839144    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kmftf"]
Sep 11 20:00:48.839307 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.839284    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:48.841776 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.841760    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6dvnr\""
Sep 11 20:00:48.842109 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.842093    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 20:00:48.842109 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.842107    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 20:00:48.842814 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.842418    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 20:00:48.842814 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.842461    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 20:00:48.847434 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.847413    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 20:00:48.855423 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.855369    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"]
Sep 11 20:00:48.855506 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.855445    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-4zntx"]
Sep 11 20:00:48.855506 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.855465    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-9zm9v"]
Sep 11 20:00:48.855506 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.855483    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kmftf"]
Sep 11 20:00:48.855506 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.855486    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kmftf"
Sep 11 20:00:48.858080 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.858040    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xsg69_f20ee550-9f30-480a-9b31-ebc964ae0fe0/konnectivity-agent/0.log" limit=1024
Sep 11 20:00:48.858230 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.858210    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 20:00:48.858230 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.858228    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 20:00:48.858368 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.858249    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8bn2t\""
Sep 11 20:00:48.865618 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.865599    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"]
Sep 11 20:00:48.886560 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.886537    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"]
Sep 11 20:00:48.886689 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.886671    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:48.889679 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.889655    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 20:00:48.892185 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.891784    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 20:00:48.893394 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.893241    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nfpfj\""
Sep 11 20:00:48.894997 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.894557    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 20:00:48.894997 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.894829    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 20:00:48.908464 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.908438    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whqg7\" (UniqueName: \"kubernetes.io/projected/2c3afeaa-5162-49cf-b716-f59fcd056613-kube-api-access-whqg7\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:48.908563 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.908488    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj7fn\" (UniqueName: \"kubernetes.io/projected/452aaf2b-9726-4c46-8fbe-aab42ae6dcc1-kube-api-access-nj7fn\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vtzn7\" (UID: \"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"
Sep 11 20:00:48.908563 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.908517    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56d5e007-e7c4-46ee-8825-8a5dd2dbd94d-config\") pod \"console-operator-696884fb9c-4zntx\" (UID: \"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d\") " pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:48.908563 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.908493    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"]
Sep 11 20:00:48.908719 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.908572    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:00:48.908788 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.908571    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56d5e007-e7c4-46ee-8825-8a5dd2dbd94d-serving-cert\") pod \"console-operator-696884fb9c-4zntx\" (UID: \"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d\") " pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:48.908840 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.908808    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56d5e007-e7c4-46ee-8825-8a5dd2dbd94d-trusted-ca\") pod \"console-operator-696884fb9c-4zntx\" (UID: \"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d\") " pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:48.908888 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.908845    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc26z\" (UniqueName: \"kubernetes.io/projected/56d5e007-e7c4-46ee-8825-8a5dd2dbd94d-kube-api-access-hc26z\") pod \"console-operator-696884fb9c-4zntx\" (UID: \"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d\") " pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:48.908944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.908882    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6700a361-c2da-4e39-92eb-fb1b5619c434-cert\") pod \"ingress-canary-wn94s\" (UID: \"6700a361-c2da-4e39-92eb-fb1b5619c434\") " pod="openshift-ingress-canary/ingress-canary-wn94s"
Sep 11 20:00:48.908944 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.908932    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4cd97dc-74f4-46f0-b68e-c349940db6d7-installation-pull-secrets\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.909070 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.908974    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kknxl\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-kube-api-access-kknxl\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.909070 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.909019    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbkc\" (UniqueName: \"kubernetes.io/projected/6700a361-c2da-4e39-92eb-fb1b5619c434-kube-api-access-kpbkc\") pod \"ingress-canary-wn94s\" (UID: \"6700a361-c2da-4e39-92eb-fb1b5619c434\") " pod="openshift-ingress-canary/ingress-canary-wn94s"
Sep 11 20:00:48.909070 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.909052    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/452aaf2b-9726-4c46-8fbe-aab42ae6dcc1-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vtzn7\" (UID: \"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"
Sep 11 20:00:48.909207 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.909083    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3afeaa-5162-49cf-b716-f59fcd056613-tmp-dir\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:48.909207 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.909127    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4cd97dc-74f4-46f0-b68e-c349940db6d7-image-registry-private-configuration\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.909207 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.909157    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4cd97dc-74f4-46f0-b68e-c349940db6d7-ca-trust-extracted\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.909207 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.909179    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4cd97dc-74f4-46f0-b68e-c349940db6d7-trusted-ca\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.909844 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.909824    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-bound-sa-token\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.910001 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.909982    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2c3afeaa-5162-49cf-b716-f59fcd056613-config-volume\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:48.910085 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.910011    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:48.910085 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.910035    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/452aaf2b-9726-4c46-8fbe-aab42ae6dcc1-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vtzn7\" (UID: \"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"
Sep 11 20:00:48.910085 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.910074    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.910240 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.910083    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c3afeaa-5162-49cf-b716-f59fcd056613-tmp-dir\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:48.910240 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.910098    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-certificates\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.910772 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.910750    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2c3afeaa-5162-49cf-b716-f59fcd056613-config-volume\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:48.911024 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.911005    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-certificates\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.911103 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.911083    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4cd97dc-74f4-46f0-b68e-c349940db6d7-ca-trust-extracted\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.911103 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:48.911096    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 20:00:48.911206 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:48.911144    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls podName:2c3afeaa-5162-49cf-b716-f59fcd056613 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:49.411129027 +0000 UTC m=+34.572379256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls") pod "dns-default-kc2dt" (UID: "2c3afeaa-5162-49cf-b716-f59fcd056613") : secret "dns-default-metrics-tls" not found
Sep 11 20:00:48.911441 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:48.911424    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 20:00:48.911510 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:48.911442    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9776f6448-6mdj2: secret "image-registry-tls" not found
Sep 11 20:00:48.911510 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:48.911486    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls podName:d4cd97dc-74f4-46f0-b68e-c349940db6d7 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:49.411470996 +0000 UTC m=+34.572721218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls") pod "image-registry-9776f6448-6mdj2" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7") : secret "image-registry-tls" not found
Sep 11 20:00:48.912072 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.912050    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4cd97dc-74f4-46f0-b68e-c349940db6d7-trusted-ca\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.912376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.912351    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 20:00:48.912469 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.912376    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4rs88\""
Sep 11 20:00:48.912612 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.912596    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 20:00:48.913553 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.912793    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 20:00:48.914138 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.914120    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6700a361-c2da-4e39-92eb-fb1b5619c434-cert\") pod \"ingress-canary-wn94s\" (UID: \"6700a361-c2da-4e39-92eb-fb1b5619c434\") " pod="openshift-ingress-canary/ingress-canary-wn94s"
Sep 11 20:00:48.914711 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.914683    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4cd97dc-74f4-46f0-b68e-c349940db6d7-image-registry-private-configuration\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.915417 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.915374    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4cd97dc-74f4-46f0-b68e-c349940db6d7-installation-pull-secrets\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.931168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.931144    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whqg7\" (UniqueName: \"kubernetes.io/projected/2c3afeaa-5162-49cf-b716-f59fcd056613-kube-api-access-whqg7\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:48.933720 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.933695    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbkc\" (UniqueName: \"kubernetes.io/projected/6700a361-c2da-4e39-92eb-fb1b5619c434-kube-api-access-kpbkc\") pod \"ingress-canary-wn94s\" (UID: \"6700a361-c2da-4e39-92eb-fb1b5619c434\") " pod="openshift-ingress-canary/ingress-canary-wn94s"
Sep 11 20:00:48.934011 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.933990    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kknxl\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-kube-api-access-kknxl\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.934375 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.934354    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-bound-sa-token\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:48.938981 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.938931    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-r4f5p"]
Sep 11 20:00:48.939103 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.939080    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"
Sep 11 20:00:48.941785 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.941768    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-b5jqq\""
Sep 11 20:00:48.942235 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.942211    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 20:00:48.942633 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.942613    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 20:00:48.942714 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.942650    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 20:00:48.942714 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.942655    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 20:00:48.955125 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.955107    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7cb7c47b86-p6kg9"]
Sep 11 20:00:48.955241 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.955227    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-r4f5p"
Sep 11 20:00:48.957704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.957690    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mkvfs\""
Sep 11 20:00:48.958009 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.957990    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 20:00:48.958333 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.958320    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 20:00:48.973746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.973285    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"]
Sep 11 20:00:48.973746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.973327    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"]
Sep 11 20:00:48.973746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.973347    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-r4f5p"]
Sep 11 20:00:48.973746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.973364    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"]
Sep 11 20:00:48.973746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.973383    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cb7c47b86-p6kg9"]
Sep 11 20:00:48.973746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.973415    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:48.979372 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.979326    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 20:00:48.979501 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.979486    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 20:00:48.980342 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.979637    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 20:00:48.980342 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.979715    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ctwbc\""
Sep 11 20:00:48.980342 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.979754    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 20:00:48.980342 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.979763    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 20:00:48.980342 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:48.980050    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 20:00:49.000095 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.000028    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xsg69_f20ee550-9f30-480a-9b31-ebc964ae0fe0/konnectivity-agent/0.log" limit=1024
Sep 11 20:00:49.011263 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011232    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj7fn\" (UniqueName: \"kubernetes.io/projected/452aaf2b-9726-4c46-8fbe-aab42ae6dcc1-kube-api-access-nj7fn\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vtzn7\" (UID: \"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"
Sep 11 20:00:49.011369 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011275    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-trusted-ca-bundle\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.011369 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011316    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-n8q24\" (UID: \"3b461974-6c6d-4485-bd02-e90bc5fe9ec3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:00:49.011478 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011391    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-tmp\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.011478 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011468    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-serving-cert\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.011579 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011504    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfc4n\" (UniqueName: \"kubernetes.io/projected/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-kube-api-access-zfc4n\") pod \"cluster-samples-operator-86499c89c4-n8q24\" (UID: \"3b461974-6c6d-4485-bd02-e90bc5fe9ec3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:00:49.011579 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011539    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-snapshots\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.011682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011578    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56d5e007-e7c4-46ee-8825-8a5dd2dbd94d-config\") pod \"console-operator-696884fb9c-4zntx\" (UID: \"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d\") " pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:49.011682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011603    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56d5e007-e7c4-46ee-8825-8a5dd2dbd94d-serving-cert\") pod \"console-operator-696884fb9c-4zntx\" (UID: \"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d\") " pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:49.011682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011626    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56d5e007-e7c4-46ee-8825-8a5dd2dbd94d-trusted-ca\") pod \"console-operator-696884fb9c-4zntx\" (UID: \"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d\") " pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:49.011682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011652    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/452aaf2b-9726-4c46-8fbe-aab42ae6dcc1-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vtzn7\" (UID: \"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"
Sep 11 20:00:49.011879 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011728    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc26z\" (UniqueName: \"kubernetes.io/projected/56d5e007-e7c4-46ee-8825-8a5dd2dbd94d-kube-api-access-hc26z\") pod \"console-operator-696884fb9c-4zntx\" (UID: \"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d\") " pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:49.011879 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011764    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:49.011879 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011799    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:49.011879 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011831    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4l59\" (UniqueName: \"kubernetes.io/projected/64bd481c-3c01-44e3-9806-3a0e9191fe20-kube-api-access-v4l59\") pod \"volume-data-source-validator-86695b7cc7-kmftf\" (UID: \"64bd481c-3c01-44e3-9806-3a0e9191fe20\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kmftf"
Sep 11 20:00:49.011879 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011861    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkzk2\" (UniqueName: \"kubernetes.io/projected/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-kube-api-access-gkzk2\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:49.012093 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011886    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/452aaf2b-9726-4c46-8fbe-aab42ae6dcc1-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vtzn7\" (UID: \"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"
Sep 11 20:00:49.012093 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.011928    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-service-ca-bundle\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.012093 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.012047    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:49.012093 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.012082    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpkdf\" (UniqueName: \"kubernetes.io/projected/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-kube-api-access-fpkdf\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.012273 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.012137    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:49.012273 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.012176    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs podName:8dd887eb-41d0-4861-a5b8-4be593422241 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:21.012156458 +0000 UTC m=+66.173406699 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs") pod "network-metrics-daemon-zn8nm" (UID: "8dd887eb-41d0-4861-a5b8-4be593422241") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 20:00:49.012386 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.012361    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56d5e007-e7c4-46ee-8825-8a5dd2dbd94d-config\") pod \"console-operator-696884fb9c-4zntx\" (UID: \"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d\") " pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:49.012639 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.012616    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56d5e007-e7c4-46ee-8825-8a5dd2dbd94d-trusted-ca\") pod \"console-operator-696884fb9c-4zntx\" (UID: \"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d\") " pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:49.012715 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.012660    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/452aaf2b-9726-4c46-8fbe-aab42ae6dcc1-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vtzn7\" (UID: \"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"
Sep 11 20:00:49.014428 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.014402    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/452aaf2b-9726-4c46-8fbe-aab42ae6dcc1-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vtzn7\" (UID: \"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"
Sep 11 20:00:49.014669 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.014595    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56d5e007-e7c4-46ee-8825-8a5dd2dbd94d-serving-cert\") pod \"console-operator-696884fb9c-4zntx\" (UID: \"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d\") " pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:49.023311 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.023288    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wn94s"
Sep 11 20:00:49.025475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.025450    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj7fn\" (UniqueName: \"kubernetes.io/projected/452aaf2b-9726-4c46-8fbe-aab42ae6dcc1-kube-api-access-nj7fn\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vtzn7\" (UID: \"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"
Sep 11 20:00:49.026204 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.026180    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc26z\" (UniqueName: \"kubernetes.io/projected/56d5e007-e7c4-46ee-8825-8a5dd2dbd94d-kube-api-access-hc26z\") pod \"console-operator-696884fb9c-4zntx\" (UID: \"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d\") " pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:49.100712 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.100675    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"
Sep 11 20:00:49.101920 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.101887    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xsg69_f20ee550-9f30-480a-9b31-ebc964ae0fe0/konnectivity-agent/0.log" limit=1024
Sep 11 20:00:49.113391 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.113161    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:49.113778 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.113738    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.114055 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.113942    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rns4\" (UniqueName: \"kubernetes.io/projected/1fc3208b-5161-465f-ae33-a63b6a913af8-kube-api-access-9rns4\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.114055 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.114007    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-trusted-ca-bundle\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.114377 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.114274    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-n8q24\" (UID: \"3b461974-6c6d-4485-bd02-e90bc5fe9ec3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:00:49.114377 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.114333    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t9fw\" (UniqueName: \"kubernetes.io/projected/911396cd-cbfc-44b0-a8e6-fac9d4211627-kube-api-access-4t9fw\") pod \"network-check-source-6f8b768455-r4f5p\" (UID: \"911396cd-cbfc-44b0-a8e6-fac9d4211627\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-r4f5p"
Sep 11 20:00:49.114639 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.114568    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:49.114639 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.114578    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-tmp\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.115035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.114891    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2716994-b475-47b5-b27c-ae7df016be23-config\") pod \"service-ca-operator-cf7c776b7-h6d2f\" (UID: \"b2716994-b475-47b5-b27c-ae7df016be23\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"
Sep 11 20:00:49.115035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.114977    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-serving-cert\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.115035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.114991    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-tmp\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.115600 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.115150    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfc4n\" (UniqueName: \"kubernetes.io/projected/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-kube-api-access-zfc4n\") pod \"cluster-samples-operator-86499c89c4-n8q24\" (UID: \"3b461974-6c6d-4485-bd02-e90bc5fe9ec3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.115873    2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.115936    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls podName:3b461974-6c6d-4485-bd02-e90bc5fe9ec3 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:49.615919816 +0000 UTC m=+34.777170039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-n8q24" (UID: "3b461974-6c6d-4485-bd02-e90bc5fe9ec3") : secret "samples-operator-tls" not found
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116128    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116185    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-snapshots\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116210    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-default-certificate\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116254    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hljfp\" (UniqueName: \"kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp\") pod \"network-check-target-7jr97\" (UID: \"308fdcdd-97ce-4c84-8020-cdfe11c51d09\") " pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116282    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116306    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-stats-auth\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116333    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2716994-b475-47b5-b27c-ae7df016be23-serving-cert\") pod \"service-ca-operator-cf7c776b7-h6d2f\" (UID: \"b2716994-b475-47b5-b27c-ae7df016be23\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116412    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4l59\" (UniqueName: \"kubernetes.io/projected/64bd481c-3c01-44e3-9806-3a0e9191fe20-kube-api-access-v4l59\") pod \"volume-data-source-validator-86695b7cc7-kmftf\" (UID: \"64bd481c-3c01-44e3-9806-3a0e9191fe20\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kmftf"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116443    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkzk2\" (UniqueName: \"kubernetes.io/projected/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-kube-api-access-gkzk2\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116481    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116510    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-service-ca-bundle\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116538    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpkdf\" (UniqueName: \"kubernetes.io/projected/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-kube-api-access-fpkdf\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116584    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drc69\" (UniqueName: \"kubernetes.io/projected/b2716994-b475-47b5-b27c-ae7df016be23-kube-api-access-drc69\") pod \"service-ca-operator-cf7c776b7-h6d2f\" (UID: \"b2716994-b475-47b5-b27c-ae7df016be23\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"
Sep 11 20:00:49.117522 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.116909    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:49.118279 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.116929    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-trusted-ca-bundle\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.118279 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.116977    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret podName:f62e8683-1a77-47c2-981b-a832d9df930c nodeName:}" failed. No retries permitted until 2026-09-11 20:01:21.116944434 +0000 UTC m=+66.278194664 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret") pod "global-pull-secret-syncer-vsxwz" (UID: "f62e8683-1a77-47c2-981b-a832d9df930c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 20:00:49.118279 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.117034    2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 20:00:49.118279 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.117843    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls podName:49c83ddc-3e64-44cf-a7be-0284d4c9d91b nodeName:}" failed. No retries permitted until 2026-09-11 20:00:49.617066791 +0000 UTC m=+34.778317025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4tfj" (UID: "49c83ddc-3e64-44cf-a7be-0284d4c9d91b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 20:00:49.118479 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.118297    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-snapshots\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.118695 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.118677    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-service-ca-bundle\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.119813 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.119781    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-serving-cert\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.120221 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.120199    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hljfp\" (UniqueName: \"kubernetes.io/projected/308fdcdd-97ce-4c84-8020-cdfe11c51d09-kube-api-access-hljfp\") pod \"network-check-target-7jr97\" (UID: \"308fdcdd-97ce-4c84-8020-cdfe11c51d09\") " pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:49.125459 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.125437    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:49.127293 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.127271    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfc4n\" (UniqueName: \"kubernetes.io/projected/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-kube-api-access-zfc4n\") pod \"cluster-samples-operator-86499c89c4-n8q24\" (UID: \"3b461974-6c6d-4485-bd02-e90bc5fe9ec3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:00:49.128205 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.128162    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4l59\" (UniqueName: \"kubernetes.io/projected/64bd481c-3c01-44e3-9806-3a0e9191fe20-kube-api-access-v4l59\") pod \"volume-data-source-validator-86695b7cc7-kmftf\" (UID: \"64bd481c-3c01-44e3-9806-3a0e9191fe20\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kmftf"
Sep 11 20:00:49.129529 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.129504    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpkdf\" (UniqueName: \"kubernetes.io/projected/ca1a8908-a5ff-4122-9d3f-5ae60adb45b9-kube-api-access-fpkdf\") pod \"insights-operator-5844b856db-9zm9v\" (UID: \"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9\") " pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.131167 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.131125    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkzk2\" (UniqueName: \"kubernetes.io/projected/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-kube-api-access-gkzk2\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:49.149687 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.149662    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-9zm9v"
Sep 11 20:00:49.166061 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.166034    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kmftf"
Sep 11 20:00:49.203404 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.203364    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xsg69_f20ee550-9f30-480a-9b31-ebc964ae0fe0/konnectivity-agent/0.log" limit=1024
Sep 11 20:00:49.219062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.217896    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-stats-auth\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.219062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.218294    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2716994-b475-47b5-b27c-ae7df016be23-serving-cert\") pod \"service-ca-operator-cf7c776b7-h6d2f\" (UID: \"b2716994-b475-47b5-b27c-ae7df016be23\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"
Sep 11 20:00:49.219062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.218373    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drc69\" (UniqueName: \"kubernetes.io/projected/b2716994-b475-47b5-b27c-ae7df016be23-kube-api-access-drc69\") pod \"service-ca-operator-cf7c776b7-h6d2f\" (UID: \"b2716994-b475-47b5-b27c-ae7df016be23\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"
Sep 11 20:00:49.219062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.218421    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.219062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.218449    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rns4\" (UniqueName: \"kubernetes.io/projected/1fc3208b-5161-465f-ae33-a63b6a913af8-kube-api-access-9rns4\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.219062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.218505    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t9fw\" (UniqueName: \"kubernetes.io/projected/911396cd-cbfc-44b0-a8e6-fac9d4211627-kube-api-access-4t9fw\") pod \"network-check-source-6f8b768455-r4f5p\" (UID: \"911396cd-cbfc-44b0-a8e6-fac9d4211627\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-r4f5p"
Sep 11 20:00:49.219062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.218560    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2716994-b475-47b5-b27c-ae7df016be23-config\") pod \"service-ca-operator-cf7c776b7-h6d2f\" (UID: \"b2716994-b475-47b5-b27c-ae7df016be23\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"
Sep 11 20:00:49.219062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.218594    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.219062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.218627    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-default-certificate\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.220505 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.220271    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle podName:1fc3208b-5161-465f-ae33-a63b6a913af8 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:49.720248248 +0000 UTC m=+34.881498490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle") pod "router-default-7cb7c47b86-p6kg9" (UID: "1fc3208b-5161-465f-ae33-a63b6a913af8") : configmap references non-existent config key: service-ca.crt
Sep 11 20:00:49.220505 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.220319    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2716994-b475-47b5-b27c-ae7df016be23-config\") pod \"service-ca-operator-cf7c776b7-h6d2f\" (UID: \"b2716994-b475-47b5-b27c-ae7df016be23\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"
Sep 11 20:00:49.220505 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.220495    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 20:00:49.220615 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.220544    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs podName:1fc3208b-5161-465f-ae33-a63b6a913af8 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:49.720528658 +0000 UTC m=+34.881778895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs") pod "router-default-7cb7c47b86-p6kg9" (UID: "1fc3208b-5161-465f-ae33-a63b6a913af8") : secret "router-metrics-certs-default" not found
Sep 11 20:00:49.225319 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.223028    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2716994-b475-47b5-b27c-ae7df016be23-serving-cert\") pod \"service-ca-operator-cf7c776b7-h6d2f\" (UID: \"b2716994-b475-47b5-b27c-ae7df016be23\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"
Sep 11 20:00:49.227024 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.226923    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-default-certificate\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.227024 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.226972    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-stats-auth\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.237755 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.237730    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drc69\" (UniqueName: \"kubernetes.io/projected/b2716994-b475-47b5-b27c-ae7df016be23-kube-api-access-drc69\") pod \"service-ca-operator-cf7c776b7-h6d2f\" (UID: \"b2716994-b475-47b5-b27c-ae7df016be23\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"
Sep 11 20:00:49.237867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.237772    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rns4\" (UniqueName: \"kubernetes.io/projected/1fc3208b-5161-465f-ae33-a63b6a913af8-kube-api-access-9rns4\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.240012 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.239986    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t9fw\" (UniqueName: \"kubernetes.io/projected/911396cd-cbfc-44b0-a8e6-fac9d4211627-kube-api-access-4t9fw\") pod \"network-check-source-6f8b768455-r4f5p\" (UID: \"911396cd-cbfc-44b0-a8e6-fac9d4211627\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-r4f5p"
Sep 11 20:00:49.254663 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.254465    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"
Sep 11 20:00:49.264904 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.264748    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-r4f5p"
Sep 11 20:00:49.339147 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.338939    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wn94s"]
Sep 11 20:00:49.342254 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:49.342196    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6700a361_c2da_4e39_92eb_fb1b5619c434.slice/crio-da804127314a340241299a73a5b5b94f891ec6757e8bc4cffb1941529c3222dd WatchSource:0}: Error finding container da804127314a340241299a73a5b5b94f891ec6757e8bc4cffb1941529c3222dd: Status 404 returned error can't find the container with id da804127314a340241299a73a5b5b94f891ec6757e8bc4cffb1941529c3222dd
Sep 11 20:00:49.344359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.343201    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:00:49.344359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.343221    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:49.344359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.343647    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:00:49.348318 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.347796    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fv8gc\""
Sep 11 20:00:49.348318 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.347836    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 20:00:49.351284 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.351063    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b7zd7\""
Sep 11 20:00:49.351284 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.351071    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 20:00:49.370971 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.370829    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:49.403033 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.403010    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7"]
Sep 11 20:00:49.407016 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:49.406987    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452aaf2b_9726_4c46_8fbe_aab42ae6dcc1.slice/crio-74bf08ee5624bb81c0c7525df71523d9383b255a2c23372d386d31bcae6d4361 WatchSource:0}: Error finding container 74bf08ee5624bb81c0c7525df71523d9383b255a2c23372d386d31bcae6d4361: Status 404 returned error can't find the container with id 74bf08ee5624bb81c0c7525df71523d9383b255a2c23372d386d31bcae6d4361
Sep 11 20:00:49.421308 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.421285    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:49.421423 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.421407    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:49.421528 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.421513    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 20:00:49.421586 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.421535    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 20:00:49.421586 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.421553    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9776f6448-6mdj2: secret "image-registry-tls" not found
Sep 11 20:00:49.421586 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.421583    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls podName:2c3afeaa-5162-49cf-b716-f59fcd056613 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:50.421567391 +0000 UTC m=+35.582817613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls") pod "dns-default-kc2dt" (UID: "2c3afeaa-5162-49cf-b716-f59fcd056613") : secret "dns-default-metrics-tls" not found
Sep 11 20:00:49.421727 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.421597    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls podName:d4cd97dc-74f4-46f0-b68e-c349940db6d7 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:50.42159155 +0000 UTC m=+35.582841771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls") pod "image-registry-9776f6448-6mdj2" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7") : secret "image-registry-tls" not found
Sep 11 20:00:49.443538 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.443517    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-4zntx"]
Sep 11 20:00:49.445246 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:49.445225    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d5e007_e7c4_46ee_8825_8a5dd2dbd94d.slice/crio-75b2bd7a07f6be86becbe7db1f0a8a7168c400060f25f4bfbd74ff60e69bec81 WatchSource:0}: Error finding container 75b2bd7a07f6be86becbe7db1f0a8a7168c400060f25f4bfbd74ff60e69bec81: Status 404 returned error can't find the container with id 75b2bd7a07f6be86becbe7db1f0a8a7168c400060f25f4bfbd74ff60e69bec81
Sep 11 20:00:49.472722 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.472646    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-9zm9v"]
Sep 11 20:00:49.475711 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:49.475681    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca1a8908_a5ff_4122_9d3f_5ae60adb45b9.slice/crio-d155611fd926594a941980867ae395f32605272591da5939faa4ae642810e573 WatchSource:0}: Error finding container d155611fd926594a941980867ae395f32605272591da5939faa4ae642810e573: Status 404 returned error can't find the container with id d155611fd926594a941980867ae395f32605272591da5939faa4ae642810e573
Sep 11 20:00:49.485419 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.485373    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kmftf"]
Sep 11 20:00:49.487891 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:49.487858    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64bd481c_3c01_44e3_9806_3a0e9191fe20.slice/crio-bf9cf17e6715c11bd965893c342746971f7ec19193953e91e45574c7afe48a45 WatchSource:0}: Error finding container bf9cf17e6715c11bd965893c342746971f7ec19193953e91e45574c7afe48a45: Status 404 returned error can't find the container with id bf9cf17e6715c11bd965893c342746971f7ec19193953e91e45574c7afe48a45
Sep 11 20:00:49.543343 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.543289    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f"]
Sep 11 20:00:49.545789 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:49.545766    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2716994_b475_47b5_b27c_ae7df016be23.slice/crio-6af20aef6094219e067e6ab3bfb059b8b6e14caa6f2288df98143af28198a0e4 WatchSource:0}: Error finding container 6af20aef6094219e067e6ab3bfb059b8b6e14caa6f2288df98143af28198a0e4: Status 404 returned error can't find the container with id 6af20aef6094219e067e6ab3bfb059b8b6e14caa6f2288df98143af28198a0e4
Sep 11 20:00:49.584985 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.584963    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-r4f5p"]
Sep 11 20:00:49.589966 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:49.589927    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911396cd_cbfc_44b0_a8e6_fac9d4211627.slice/crio-aa38c0ab83a646a7696b156c54501da40a289b105676706483d9de0742f11d75 WatchSource:0}: Error finding container aa38c0ab83a646a7696b156c54501da40a289b105676706483d9de0742f11d75: Status 404 returned error can't find the container with id aa38c0ab83a646a7696b156c54501da40a289b105676706483d9de0742f11d75
Sep 11 20:00:49.623084 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.623034    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:49.623416 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.623185    2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 20:00:49.623416 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.623236    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-n8q24\" (UID: \"3b461974-6c6d-4485-bd02-e90bc5fe9ec3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:00:49.623416 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.623244    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls podName:49c83ddc-3e64-44cf-a7be-0284d4c9d91b nodeName:}" failed. No retries permitted until 2026-09-11 20:00:50.623224596 +0000 UTC m=+35.784474823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4tfj" (UID: "49c83ddc-3e64-44cf-a7be-0284d4c9d91b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 20:00:49.623416 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.623359    2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 20:00:49.623416 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.623416    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls podName:3b461974-6c6d-4485-bd02-e90bc5fe9ec3 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:50.623398466 +0000 UTC m=+35.784648691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-n8q24" (UID: "3b461974-6c6d-4485-bd02-e90bc5fe9ec3") : secret "samples-operator-tls" not found
Sep 11 20:00:49.630780 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.630744    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f" event={"ID":"b2716994-b475-47b5-b27c-ae7df016be23","Type":"ContainerStarted","Data":"6af20aef6094219e067e6ab3bfb059b8b6e14caa6f2288df98143af28198a0e4"}
Sep 11 20:00:49.631791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.631773    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-9zm9v" event={"ID":"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9","Type":"ContainerStarted","Data":"d155611fd926594a941980867ae395f32605272591da5939faa4ae642810e573"}
Sep 11 20:00:49.632785 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.632765    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7" event={"ID":"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1","Type":"ContainerStarted","Data":"74bf08ee5624bb81c0c7525df71523d9383b255a2c23372d386d31bcae6d4361"}
Sep 11 20:00:49.633763 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.633739    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kmftf" event={"ID":"64bd481c-3c01-44e3-9806-3a0e9191fe20","Type":"ContainerStarted","Data":"bf9cf17e6715c11bd965893c342746971f7ec19193953e91e45574c7afe48a45"}
Sep 11 20:00:49.634841 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.634821    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-4zntx" event={"ID":"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d","Type":"ContainerStarted","Data":"75b2bd7a07f6be86becbe7db1f0a8a7168c400060f25f4bfbd74ff60e69bec81"}
Sep 11 20:00:49.635858 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.635840    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-r4f5p" event={"ID":"911396cd-cbfc-44b0-a8e6-fac9d4211627","Type":"ContainerStarted","Data":"aa38c0ab83a646a7696b156c54501da40a289b105676706483d9de0742f11d75"}
Sep 11 20:00:49.636837 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.636820    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wn94s" event={"ID":"6700a361-c2da-4e39-92eb-fb1b5619c434","Type":"ContainerStarted","Data":"da804127314a340241299a73a5b5b94f891ec6757e8bc4cffb1941529c3222dd"}
Sep 11 20:00:49.677198 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.677175    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7jr97"]
Sep 11 20:00:49.680286 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:00:49.680261    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308fdcdd_97ce_4c84_8020_cdfe11c51d09.slice/crio-701e3b23bb79bd46d5d3187b89f3b601a665fcedc655ad443349642990f654c8 WatchSource:0}: Error finding container 701e3b23bb79bd46d5d3187b89f3b601a665fcedc655ad443349642990f654c8: Status 404 returned error can't find the container with id 701e3b23bb79bd46d5d3187b89f3b601a665fcedc655ad443349642990f654c8
Sep 11 20:00:49.724187 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.724167    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.724286 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:49.724258    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:49.724340 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.724325    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle podName:1fc3208b-5161-465f-ae33-a63b6a913af8 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:50.724304245 +0000 UTC m=+35.885554472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle") pod "router-default-7cb7c47b86-p6kg9" (UID: "1fc3208b-5161-465f-ae33-a63b6a913af8") : configmap references non-existent config key: service-ca.crt
Sep 11 20:00:49.724396 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.724371    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 20:00:49.724429 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:49.724417    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs podName:1fc3208b-5161-465f-ae33-a63b6a913af8 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:50.72440574 +0000 UTC m=+35.885655964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs") pod "router-default-7cb7c47b86-p6kg9" (UID: "1fc3208b-5161-465f-ae33-a63b6a913af8") : secret "router-metrics-certs-default" not found
Sep 11 20:00:50.430755 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:50.430278    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:50.430755 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:50.430343    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:50.430755 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:50.430487    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 20:00:50.430755 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:50.430503    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9776f6448-6mdj2: secret "image-registry-tls" not found
Sep 11 20:00:50.430755 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:50.430567    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls podName:d4cd97dc-74f4-46f0-b68e-c349940db6d7 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:52.430550013 +0000 UTC m=+37.591800236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls") pod "image-registry-9776f6448-6mdj2" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7") : secret "image-registry-tls" not found
Sep 11 20:00:50.430755 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:50.430716    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 20:00:50.430755 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:50.430766    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls podName:2c3afeaa-5162-49cf-b716-f59fcd056613 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:52.430753214 +0000 UTC m=+37.592003448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls") pod "dns-default-kc2dt" (UID: "2c3afeaa-5162-49cf-b716-f59fcd056613") : secret "dns-default-metrics-tls" not found
Sep 11 20:00:50.632270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:50.632233    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:50.632903 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:50.632390    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-n8q24\" (UID: \"3b461974-6c6d-4485-bd02-e90bc5fe9ec3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:00:50.632903 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:50.632497    2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 20:00:50.632903 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:50.632560    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls podName:3b461974-6c6d-4485-bd02-e90bc5fe9ec3 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:52.632541822 +0000 UTC m=+37.793792045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-n8q24" (UID: "3b461974-6c6d-4485-bd02-e90bc5fe9ec3") : secret "samples-operator-tls" not found
Sep 11 20:00:50.633111 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:50.632943    2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 20:00:50.633111 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:50.633011    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls podName:49c83ddc-3e64-44cf-a7be-0284d4c9d91b nodeName:}" failed. No retries permitted until 2026-09-11 20:00:52.632994857 +0000 UTC m=+37.794245090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4tfj" (UID: "49c83ddc-3e64-44cf-a7be-0284d4c9d91b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 20:00:50.643487 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:50.643415    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7jr97" event={"ID":"308fdcdd-97ce-4c84-8020-cdfe11c51d09","Type":"ContainerStarted","Data":"701e3b23bb79bd46d5d3187b89f3b601a665fcedc655ad443349642990f654c8"}
Sep 11 20:00:50.733884 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:50.733792    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:50.734086 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:50.734009    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle podName:1fc3208b-5161-465f-ae33-a63b6a913af8 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:52.733988394 +0000 UTC m=+37.895238626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle") pod "router-default-7cb7c47b86-p6kg9" (UID: "1fc3208b-5161-465f-ae33-a63b6a913af8") : configmap references non-existent config key: service-ca.crt
Sep 11 20:00:50.734710 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:50.734479    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:50.734710 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:50.734627    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 20:00:50.734710 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:50.734678    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs podName:1fc3208b-5161-465f-ae33-a63b6a913af8 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:52.73466463 +0000 UTC m=+37.895914864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs") pod "router-default-7cb7c47b86-p6kg9" (UID: "1fc3208b-5161-465f-ae33-a63b6a913af8") : secret "router-metrics-certs-default" not found
Sep 11 20:00:52.448258 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:52.448229    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:52.448839 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:52.448339    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:52.448839 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:52.448406    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 20:00:52.448839 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:52.448428    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9776f6448-6mdj2: secret "image-registry-tls" not found
Sep 11 20:00:52.448839 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:52.448450    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 20:00:52.448839 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:52.448496    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls podName:d4cd97dc-74f4-46f0-b68e-c349940db6d7 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:56.448477039 +0000 UTC m=+41.609727270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls") pod "image-registry-9776f6448-6mdj2" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7") : secret "image-registry-tls" not found
Sep 11 20:00:52.448839 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:52.448515    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls podName:2c3afeaa-5162-49cf-b716-f59fcd056613 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:56.448505188 +0000 UTC m=+41.609755415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls") pod "dns-default-kc2dt" (UID: "2c3afeaa-5162-49cf-b716-f59fcd056613") : secret "dns-default-metrics-tls" not found
Sep 11 20:00:52.650405 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:52.650374    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:52.650565 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:52.650498    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-n8q24\" (UID: \"3b461974-6c6d-4485-bd02-e90bc5fe9ec3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:00:52.650565 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:52.650552    2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 20:00:52.650696 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:52.650615    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls podName:49c83ddc-3e64-44cf-a7be-0284d4c9d91b nodeName:}" failed. No retries permitted until 2026-09-11 20:00:56.650597509 +0000 UTC m=+41.811847748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4tfj" (UID: "49c83ddc-3e64-44cf-a7be-0284d4c9d91b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 20:00:52.650696 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:52.650658    2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 20:00:52.650789 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:52.650718    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls podName:3b461974-6c6d-4485-bd02-e90bc5fe9ec3 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:56.650701938 +0000 UTC m=+41.811952167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-n8q24" (UID: "3b461974-6c6d-4485-bd02-e90bc5fe9ec3") : secret "samples-operator-tls" not found
Sep 11 20:00:52.751411 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:52.751330    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:52.751411 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:52.751406    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:52.751614 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:52.751489    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 20:00:52.751614 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:52.751535    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs podName:1fc3208b-5161-465f-ae33-a63b6a913af8 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:56.751518519 +0000 UTC m=+41.912768752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs") pod "router-default-7cb7c47b86-p6kg9" (UID: "1fc3208b-5161-465f-ae33-a63b6a913af8") : secret "router-metrics-certs-default" not found
Sep 11 20:00:52.751614 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:52.751550    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle podName:1fc3208b-5161-465f-ae33-a63b6a913af8 nodeName:}" failed. No retries permitted until 2026-09-11 20:00:56.751542704 +0000 UTC m=+41.912792925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle") pod "router-default-7cb7c47b86-p6kg9" (UID: "1fc3208b-5161-465f-ae33-a63b6a913af8") : configmap references non-existent config key: service-ca.crt
Sep 11 20:00:56.488645 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:56.488605    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:00:56.489202 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:56.488663    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:00:56.489202 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:56.488765    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 20:00:56.489202 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:56.488774    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 20:00:56.489202 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:56.488849    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls podName:2c3afeaa-5162-49cf-b716-f59fcd056613 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:04.488827207 +0000 UTC m=+49.650077441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls") pod "dns-default-kc2dt" (UID: "2c3afeaa-5162-49cf-b716-f59fcd056613") : secret "dns-default-metrics-tls" not found
Sep 11 20:00:56.489202 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:56.488782    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9776f6448-6mdj2: secret "image-registry-tls" not found
Sep 11 20:00:56.489202 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:56.488913    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls podName:d4cd97dc-74f4-46f0-b68e-c349940db6d7 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:04.488898667 +0000 UTC m=+49.650148912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls") pod "image-registry-9776f6448-6mdj2" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7") : secret "image-registry-tls" not found
Sep 11 20:00:56.690223 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:56.690189    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:00:56.690395 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:56.690313    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-n8q24\" (UID: \"3b461974-6c6d-4485-bd02-e90bc5fe9ec3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:00:56.690395 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:56.690336    2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 20:00:56.690526 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:56.690409    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls podName:49c83ddc-3e64-44cf-a7be-0284d4c9d91b nodeName:}" failed. No retries permitted until 2026-09-11 20:01:04.690389644 +0000 UTC m=+49.851639865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4tfj" (UID: "49c83ddc-3e64-44cf-a7be-0284d4c9d91b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 20:00:56.690526 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:56.690438    2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 20:00:56.690526 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:56.690490    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls podName:3b461974-6c6d-4485-bd02-e90bc5fe9ec3 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:04.69047475 +0000 UTC m=+49.851724970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-n8q24" (UID: "3b461974-6c6d-4485-bd02-e90bc5fe9ec3") : secret "samples-operator-tls" not found
Sep 11 20:00:56.791248 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:56.791217    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:56.791424 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:56.791307    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:00:56.791424 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:56.791405    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle podName:1fc3208b-5161-465f-ae33-a63b6a913af8 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:04.791384114 +0000 UTC m=+49.952634352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle") pod "router-default-7cb7c47b86-p6kg9" (UID: "1fc3208b-5161-465f-ae33-a63b6a913af8") : configmap references non-existent config key: service-ca.crt
Sep 11 20:00:56.791424 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:56.791407    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 20:00:56.791558 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:56.791454    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs podName:1fc3208b-5161-465f-ae33-a63b6a913af8 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:04.791443239 +0000 UTC m=+49.952693462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs") pod "router-default-7cb7c47b86-p6kg9" (UID: "1fc3208b-5161-465f-ae33-a63b6a913af8") : secret "router-metrics-certs-default" not found
Sep 11 20:00:58.679015 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.678689    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wn94s" event={"ID":"6700a361-c2da-4e39-92eb-fb1b5619c434","Type":"ContainerStarted","Data":"c525fe5738c9b8646ecdd007af4a0cad7d0def0713427177d28baf8d2e41bafb"}
Sep 11 20:00:58.683923 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.683844    2585 generic.go:356] "Generic (PLEG): container finished" podID="8b217b0a-fb3e-4b5a-942a-0f57a3913ca9" containerID="864452fe191fdf23e3a629541884c61b538c15c6a9b824384044c9648bd701ad" exitCode=0
Sep 11 20:00:58.684056 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.683921    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkfkl" event={"ID":"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9","Type":"ContainerDied","Data":"864452fe191fdf23e3a629541884c61b538c15c6a9b824384044c9648bd701ad"}
Sep 11 20:00:58.686743 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.686053    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f" event={"ID":"b2716994-b475-47b5-b27c-ae7df016be23","Type":"ContainerStarted","Data":"dab39409d7ffcb04db926b6a900dce12b030d5587d9538ce07c964d91a2a0eba"}
Sep 11 20:00:58.689102 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.689063    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-9zm9v" event={"ID":"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9","Type":"ContainerStarted","Data":"b842590ddc9ec5107fd46afbcabff9533380f183acfff339d7be32c7454b06dc"}
Sep 11 20:00:58.691404 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.691362    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7" event={"ID":"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1","Type":"ContainerStarted","Data":"8bffe3c44b72828601f4f2c4c54e7d9e1ab038bc0b7f8ffc0987ffa9723f0be2"}
Sep 11 20:00:58.693693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.693565    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7jr97" event={"ID":"308fdcdd-97ce-4c84-8020-cdfe11c51d09","Type":"ContainerStarted","Data":"0a47e4e9cce49f6a577a978ba6e26941250b8e1d48459bfcb4a9d67eed3ef05d"}
Sep 11 20:00:58.693693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.693624    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:00:58.695268 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.695237    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kmftf" event={"ID":"64bd481c-3c01-44e3-9806-3a0e9191fe20","Type":"ContainerStarted","Data":"2644018ecdfd81c1e3ebfb0e68b45d36c19ab2ef4d58fb3753241ffc4c29fb03"}
Sep 11 20:00:58.696831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.696814    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/0.log"
Sep 11 20:00:58.696927 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.696846    2585 generic.go:356] "Generic (PLEG): container finished" podID="56d5e007-e7c4-46ee-8825-8a5dd2dbd94d" containerID="f75df518824a8b933946bed718d046267d13c57cb87084c775c0573a95ed0b11" exitCode=255
Sep 11 20:00:58.697074 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.697028    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-4zntx" event={"ID":"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d","Type":"ContainerDied","Data":"f75df518824a8b933946bed718d046267d13c57cb87084c775c0573a95ed0b11"}
Sep 11 20:00:58.697140 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.697113    2585 scope.go:117] "RemoveContainer" containerID="f75df518824a8b933946bed718d046267d13c57cb87084c775c0573a95ed0b11"
Sep 11 20:00:58.698332 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.698312    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-r4f5p" event={"ID":"911396cd-cbfc-44b0-a8e6-fac9d4211627","Type":"ContainerStarted","Data":"d762746a832c0b5abb9cf82b6d86e3f339687b7314c3cf38dc1318273850fce4"}
Sep 11 20:00:58.740697 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.740400    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wn94s" podStartSLOduration=2.012811102 podStartE2EDuration="10.740380959s" totalImagesPullingTime="8.727569857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:58.738240022 +0000 UTC m=+43.899490264" watchObservedRunningTime="2026-09-11 20:00:58.740380959 +0000 UTC m=+43.901631201"
Sep 11 20:00:58.823186 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.822538    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7" podStartSLOduration=3.940847026 podStartE2EDuration="10.822510175s" totalImagesPullingTime="6.881663149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:58.821689165 +0000 UTC m=+43.982939408" watchObservedRunningTime="2026-09-11 20:00:58.822510175 +0000 UTC m=+43.983760418"
Sep 11 20:00:58.823186 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.823027    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7jr97" podStartSLOduration=35.167629651 podStartE2EDuration="43.823010943s" totalImagesPullingTime="8.655381292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:58.778217074 +0000 UTC m=+43.939467317" watchObservedRunningTime="2026-09-11 20:00:58.823010943 +0000 UTC m=+43.984261181"
Sep 11 20:00:58.891189 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.891139    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-kmftf" podStartSLOduration=2.055690991 podStartE2EDuration="10.891117855s" totalImagesPullingTime="8.835426864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:58.888064597 +0000 UTC m=+44.049314840" watchObservedRunningTime="2026-09-11 20:00:58.891117855 +0000 UTC m=+44.052368099"
Sep 11 20:00:58.891722 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.891679    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-9zm9v" podStartSLOduration=2.044313324 podStartE2EDuration="10.89166284s" totalImagesPullingTime="8.847349516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:58.870654259 +0000 UTC m=+44.031904502" watchObservedRunningTime="2026-09-11 20:00:58.89166284 +0000 UTC m=+44.052913087"
Sep 11 20:00:58.907548 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.907504    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f" podStartSLOduration=2.2792911670000002 podStartE2EDuration="10.907485276s" totalImagesPullingTime="8.628194109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:58.907077242 +0000 UTC m=+44.068327486" watchObservedRunningTime="2026-09-11 20:00:58.907485276 +0000 UTC m=+44.068735518"
Sep 11 20:00:58.968498 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:58.968439    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-r4f5p" podStartSLOduration=2.235034839 podStartE2EDuration="10.968423205s" totalImagesPullingTime="8.733388366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:58.932319783 +0000 UTC m=+44.093570026" watchObservedRunningTime="2026-09-11 20:00:58.968423205 +0000 UTC m=+44.129673504"
Sep 11 20:00:59.126579 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.126542    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:59.126734 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.126603    2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:00:59.711306 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.711216    2585 generic.go:356] "Generic (PLEG): container finished" podID="8b217b0a-fb3e-4b5a-942a-0f57a3913ca9" containerID="e5a8d9069b4920bc1423467a4cf18dcb70762fa5eb66ad1e002f3b3a48a66240" exitCode=0
Sep 11 20:00:59.711716 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.711311    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkfkl" event={"ID":"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9","Type":"ContainerDied","Data":"e5a8d9069b4920bc1423467a4cf18dcb70762fa5eb66ad1e002f3b3a48a66240"}
Sep 11 20:00:59.714222 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.714200    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:00:59.714736 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.714715    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/0.log"
Sep 11 20:00:59.714821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.714758    2585 generic.go:356] "Generic (PLEG): container finished" podID="56d5e007-e7c4-46ee-8825-8a5dd2dbd94d" containerID="adc477f93588daa2377566a1846fc70b48f348fc94b8a681d9079a5d33f10524" exitCode=255
Sep 11 20:00:59.714921 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.714903    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-4zntx" event={"ID":"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d","Type":"ContainerDied","Data":"adc477f93588daa2377566a1846fc70b48f348fc94b8a681d9079a5d33f10524"}
Sep 11 20:00:59.715006 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.714992    2585 scope.go:117] "RemoveContainer" containerID="f75df518824a8b933946bed718d046267d13c57cb87084c775c0573a95ed0b11"
Sep 11 20:00:59.715066 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.715024    2585 scope.go:117] "RemoveContainer" containerID="adc477f93588daa2377566a1846fc70b48f348fc94b8a681d9079a5d33f10524"
Sep 11 20:00:59.715321 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:00:59.715217    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-4zntx_openshift-console-operator(56d5e007-e7c4-46ee-8825-8a5dd2dbd94d)\"" pod="openshift-console-operator/console-operator-696884fb9c-4zntx" podUID="56d5e007-e7c4-46ee-8825-8a5dd2dbd94d"
Sep 11 20:00:59.803290 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.802867    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wfv5l"]
Sep 11 20:00:59.833627 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.833596    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfv5l"]
Sep 11 20:00:59.833802 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.833736    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:00:59.836820 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.836566    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 20:00:59.836820 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.836736    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 20:00:59.836980 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.836853    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zqht8\""
Sep 11 20:00:59.919949 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.919924    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-crio-socket\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:00:59.920078 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.920047    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c6zb\" (UniqueName: \"kubernetes.io/projected/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-api-access-9c6zb\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:00:59.920136 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.920105    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:00:59.920201 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.920183    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:00:59.920252 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:00:59.920237    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-data-volume\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:00.021404 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.021312    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c6zb\" (UniqueName: \"kubernetes.io/projected/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-api-access-9c6zb\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:00.021404 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.021357    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:00.021404 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.021401    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:00.021665 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.021440    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-data-volume\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:00.021665 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.021496    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-crio-socket\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:00.021665 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:00.021525    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 20:01:00.021665 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.021600    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-crio-socket\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:00.021665 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:00.021614    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm podName:58d8f981-87ee-426c-aebd-9e1d9f62ea0a nodeName:}" failed. No retries permitted until 2026-09-11 20:01:00.521592373 +0000 UTC m=+45.682842598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfv5l" (UID: "58d8f981-87ee-426c-aebd-9e1d9f62ea0a") : configmap "kube-rbac-proxy" not found
Sep 11 20:01:00.021665 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:00.021526    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 20:01:00.021872 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:00.021683    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls podName:58d8f981-87ee-426c-aebd-9e1d9f62ea0a nodeName:}" failed. No retries permitted until 2026-09-11 20:01:00.521668155 +0000 UTC m=+45.682918375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfv5l" (UID: "58d8f981-87ee-426c-aebd-9e1d9f62ea0a") : secret "insights-runtime-extractor-tls" not found
Sep 11 20:01:00.021872 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.021837    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-data-volume\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:00.031989 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.031937    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c6zb\" (UniqueName: \"kubernetes.io/projected/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-api-access-9c6zb\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:00.364099 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.364058    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-cgds5"]
Sep 11 20:01:00.380898 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.380873    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-cgds5"]
Sep 11 20:01:00.381039 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.380998    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cgds5"
Sep 11 20:01:00.383617 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.383592    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 20:01:00.383744 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.383622    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rtmdh\""
Sep 11 20:01:00.383744 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.383663    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 20:01:00.425028 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.425006    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gspf\" (UniqueName: \"kubernetes.io/projected/195babbb-08c3-4e50-aa77-10f0844bd32b-kube-api-access-5gspf\") pod \"migrator-8b4d697c5-cgds5\" (UID: \"195babbb-08c3-4e50-aa77-10f0844bd32b\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cgds5"
Sep 11 20:01:00.525592 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.525564    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:00.525701 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.525658    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gspf\" (UniqueName: \"kubernetes.io/projected/195babbb-08c3-4e50-aa77-10f0844bd32b-kube-api-access-5gspf\") pod \"migrator-8b4d697c5-cgds5\" (UID: \"195babbb-08c3-4e50-aa77-10f0844bd32b\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cgds5"
Sep 11 20:01:00.525701 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.525690    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:00.525701 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:00.525692    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 20:01:00.525805 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:00.525761    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm podName:58d8f981-87ee-426c-aebd-9e1d9f62ea0a nodeName:}" failed. No retries permitted until 2026-09-11 20:01:01.525741128 +0000 UTC m=+46.686991369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfv5l" (UID: "58d8f981-87ee-426c-aebd-9e1d9f62ea0a") : configmap "kube-rbac-proxy" not found
Sep 11 20:01:00.525805 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:00.525780    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 20:01:00.525875 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:00.525822    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls podName:58d8f981-87ee-426c-aebd-9e1d9f62ea0a nodeName:}" failed. No retries permitted until 2026-09-11 20:01:01.525811539 +0000 UTC m=+46.687061758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfv5l" (UID: "58d8f981-87ee-426c-aebd-9e1d9f62ea0a") : secret "insights-runtime-extractor-tls" not found
Sep 11 20:01:00.534287 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.534264    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gspf\" (UniqueName: \"kubernetes.io/projected/195babbb-08c3-4e50-aa77-10f0844bd32b-kube-api-access-5gspf\") pod \"migrator-8b4d697c5-cgds5\" (UID: \"195babbb-08c3-4e50-aa77-10f0844bd32b\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cgds5"
Sep 11 20:01:00.689844 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.689773    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cgds5"
Sep 11 20:01:00.721423 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.721392    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkfkl" event={"ID":"8b217b0a-fb3e-4b5a-942a-0f57a3913ca9","Type":"ContainerStarted","Data":"32ebfa3858d076b7d3a6b2afe9f690daf594ee0e0dc150f9683c68714adabd89"}
Sep 11 20:01:00.722972 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.722937    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:01:00.723225 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.723212    2585 scope.go:117] "RemoveContainer" containerID="adc477f93588daa2377566a1846fc70b48f348fc94b8a681d9079a5d33f10524"
Sep 11 20:01:00.723351 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:00.723335    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-4zntx_openshift-console-operator(56d5e007-e7c4-46ee-8825-8a5dd2dbd94d)\"" pod="openshift-console-operator/console-operator-696884fb9c-4zntx" podUID="56d5e007-e7c4-46ee-8825-8a5dd2dbd94d"
Sep 11 20:01:00.742820 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.742766    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jkfkl" podStartSLOduration=10.304989269 podStartE2EDuration="45.742746275s" totalImagesPullingTime="35.437757006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:00.740515465 +0000 UTC m=+45.901765726" watchObservedRunningTime="2026-09-11 20:01:00.742746275 +0000 UTC m=+45.903996517"
Sep 11 20:01:00.986751 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:00.986721    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-cgds5"]
Sep 11 20:01:00.990075 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:00.990034    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195babbb_08c3_4e50_aa77_10f0844bd32b.slice/crio-9489b66ed59ce31ae9c8ab0a93f80e7e95319db0a1830f45211c97a39225a3af WatchSource:0}: Error finding container 9489b66ed59ce31ae9c8ab0a93f80e7e95319db0a1830f45211c97a39225a3af: Status 404 returned error can't find the container with id 9489b66ed59ce31ae9c8ab0a93f80e7e95319db0a1830f45211c97a39225a3af
Sep 11 20:01:01.180676 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.180644    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sdh4n_30b3adc7-99ac-4743-9eb5-c1d99ceb1b79/dns-node-resolver/0.log"
Sep 11 20:01:01.535262 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.535230    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:01.535422 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.535282    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:01.535422 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:01.535397    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 20:01:01.535502 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:01.535436    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 20:01:01.535502 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:01.535461    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls podName:58d8f981-87ee-426c-aebd-9e1d9f62ea0a nodeName:}" failed. No retries permitted until 2026-09-11 20:01:03.535446527 +0000 UTC m=+48.696696750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfv5l" (UID: "58d8f981-87ee-426c-aebd-9e1d9f62ea0a") : secret "insights-runtime-extractor-tls" not found
Sep 11 20:01:01.535502 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:01.535488    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm podName:58d8f981-87ee-426c-aebd-9e1d9f62ea0a nodeName:}" failed. No retries permitted until 2026-09-11 20:01:03.535475085 +0000 UTC m=+48.696725305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfv5l" (UID: "58d8f981-87ee-426c-aebd-9e1d9f62ea0a") : configmap "kube-rbac-proxy" not found
Sep 11 20:01:01.663069 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.663035    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"]
Sep 11 20:01:01.681028 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.680997    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"]
Sep 11 20:01:01.681195 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.681066    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:01.684065 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.683773    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 20:01:01.684065 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.683779    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tnt4l\""
Sep 11 20:01:01.684065 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.683779    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 20:01:01.728021 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.727987    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cgds5" event={"ID":"195babbb-08c3-4e50-aa77-10f0844bd32b","Type":"ContainerStarted","Data":"9489b66ed59ce31ae9c8ab0a93f80e7e95319db0a1830f45211c97a39225a3af"}
Sep 11 20:01:01.736690 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.736670    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-jzlvs\" (UID: \"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:01.736797 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.736779    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jzlvs\" (UID: \"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:01.837342 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.837316    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jzlvs\" (UID: \"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:01.837508 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.837427    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-jzlvs\" (UID: \"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:01.837508 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:01.837459    2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 20:01:01.837680 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:01.837533    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert podName:6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:02.337513378 +0000 UTC m=+47.498763613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jzlvs" (UID: "6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1") : secret "networking-console-plugin-cert" not found
Sep 11 20:01:01.838034 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:01.838016    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-jzlvs\" (UID: \"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:02.179485 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.179404    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vrvvx_e7341bdd-c654-4188-bce4-8cd18669ebfa/node-ca/0.log"
Sep 11 20:01:02.342583 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.342542    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jzlvs\" (UID: \"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:02.342891 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:02.342654    2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 20:01:02.342891 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:02.342738    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert podName:6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:03.342716519 +0000 UTC m=+48.503966762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jzlvs" (UID: "6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1") : secret "networking-console-plugin-cert" not found
Sep 11 20:01:02.579377 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.579308    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wn94s_6700a361-c2da-4e39-92eb-fb1b5619c434/serve-healthcheck-canary/0.log"
Sep 11 20:01:02.732636 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.732608    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cgds5" event={"ID":"195babbb-08c3-4e50-aa77-10f0844bd32b","Type":"ContainerStarted","Data":"3e18fc5213d63d777c00fc6fa62b78624533fbb98a5c9e01160b2fe849bb2a22"}
Sep 11 20:01:02.761724 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.761698    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-n6hrp"]
Sep 11 20:01:02.790261 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.790234    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-n6hrp"]
Sep 11 20:01:02.790377 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.790328    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-n6hrp"
Sep 11 20:01:02.793195 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.793174    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 11 20:01:02.794369 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.794344    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fktc4\""
Sep 11 20:01:02.794500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.794419    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 11 20:01:02.794659 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.794641    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 11 20:01:02.794739 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.794641    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 11 20:01:02.847171 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.847143    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa-signing-cabundle\") pod \"service-ca-568869fdc5-n6hrp\" (UID: \"0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa\") " pod="openshift-service-ca/service-ca-568869fdc5-n6hrp"
Sep 11 20:01:02.847301 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.847184    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa-signing-key\") pod \"service-ca-568869fdc5-n6hrp\" (UID: \"0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa\") " pod="openshift-service-ca/service-ca-568869fdc5-n6hrp"
Sep 11 20:01:02.847301 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.847203    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqpbp\" (UniqueName: \"kubernetes.io/projected/0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa-kube-api-access-vqpbp\") pod \"service-ca-568869fdc5-n6hrp\" (UID: \"0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa\") " pod="openshift-service-ca/service-ca-568869fdc5-n6hrp"
Sep 11 20:01:02.948403 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.948370    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa-signing-cabundle\") pod \"service-ca-568869fdc5-n6hrp\" (UID: \"0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa\") " pod="openshift-service-ca/service-ca-568869fdc5-n6hrp"
Sep 11 20:01:02.948571 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.948417    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa-signing-key\") pod \"service-ca-568869fdc5-n6hrp\" (UID: \"0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa\") " pod="openshift-service-ca/service-ca-568869fdc5-n6hrp"
Sep 11 20:01:02.948571 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.948445    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqpbp\" (UniqueName: \"kubernetes.io/projected/0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa-kube-api-access-vqpbp\") pod \"service-ca-568869fdc5-n6hrp\" (UID: \"0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa\") " pod="openshift-service-ca/service-ca-568869fdc5-n6hrp"
Sep 11 20:01:02.949134 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.949111    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa-signing-cabundle\") pod \"service-ca-568869fdc5-n6hrp\" (UID: \"0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa\") " pod="openshift-service-ca/service-ca-568869fdc5-n6hrp"
Sep 11 20:01:02.950776 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.950759    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa-signing-key\") pod \"service-ca-568869fdc5-n6hrp\" (UID: \"0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa\") " pod="openshift-service-ca/service-ca-568869fdc5-n6hrp"
Sep 11 20:01:02.957162 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:02.957142    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqpbp\" (UniqueName: \"kubernetes.io/projected/0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa-kube-api-access-vqpbp\") pod \"service-ca-568869fdc5-n6hrp\" (UID: \"0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa\") " pod="openshift-service-ca/service-ca-568869fdc5-n6hrp"
Sep 11 20:01:03.098600 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:03.098526    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-n6hrp"
Sep 11 20:01:03.352281 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:03.352201    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jzlvs\" (UID: \"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:03.352439 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:03.352360    2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 20:01:03.352439 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:03.352428    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert podName:6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:05.352410126 +0000 UTC m=+50.513660345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jzlvs" (UID: "6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1") : secret "networking-console-plugin-cert" not found
Sep 11 20:01:03.389345 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:03.389311    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-n6hrp"]
Sep 11 20:01:03.392970 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:03.392929    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca78e38_c0e4_47df_8801_f3ab1fd6c9aa.slice/crio-4a8ae7e7407daee5339c3b79c379d331731c7186ac666dda079d311e15f21388 WatchSource:0}: Error finding container 4a8ae7e7407daee5339c3b79c379d331731c7186ac666dda079d311e15f21388: Status 404 returned error can't find the container with id 4a8ae7e7407daee5339c3b79c379d331731c7186ac666dda079d311e15f21388
Sep 11 20:01:03.554114 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:03.554076    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:03.554271 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:03.554134    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:03.554271 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:03.554234    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 20:01:03.554271 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:03.554254    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 20:01:03.554389 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:03.554291    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm podName:58d8f981-87ee-426c-aebd-9e1d9f62ea0a nodeName:}" failed. No retries permitted until 2026-09-11 20:01:07.554275408 +0000 UTC m=+52.715525629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfv5l" (UID: "58d8f981-87ee-426c-aebd-9e1d9f62ea0a") : configmap "kube-rbac-proxy" not found
Sep 11 20:01:03.554389 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:03.554305    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls podName:58d8f981-87ee-426c-aebd-9e1d9f62ea0a nodeName:}" failed. No retries permitted until 2026-09-11 20:01:07.554299252 +0000 UTC m=+52.715549472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfv5l" (UID: "58d8f981-87ee-426c-aebd-9e1d9f62ea0a") : secret "insights-runtime-extractor-tls" not found
Sep 11 20:01:03.742186 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:03.742099    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cgds5" event={"ID":"195babbb-08c3-4e50-aa77-10f0844bd32b","Type":"ContainerStarted","Data":"652d56b144eb6e97e12c74ad8d278092b5f1a7f95f0a545d608f7b178a565a7a"}
Sep 11 20:01:03.743567 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:03.743538    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-n6hrp" event={"ID":"0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa","Type":"ContainerStarted","Data":"6bb69d6b069bff2dcafea4c59b155761a46f4118dac14e85237108baf2b1b03f"}
Sep 11 20:01:03.743679 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:03.743576    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-n6hrp" event={"ID":"0ca78e38-c0e4-47df-8801-f3ab1fd6c9aa","Type":"ContainerStarted","Data":"4a8ae7e7407daee5339c3b79c379d331731c7186ac666dda079d311e15f21388"}
Sep 11 20:01:03.764088 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:03.764041    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cgds5" podStartSLOduration=2.165603367 podStartE2EDuration="3.764025442s" totalImagesPullingTime="1.598422075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:03.761761166 +0000 UTC m=+48.923011409" watchObservedRunningTime="2026-09-11 20:01:03.764025442 +0000 UTC m=+48.925275683"
Sep 11 20:01:03.778886 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:03.778838    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-n6hrp" podStartSLOduration=1.7788186339999998 podStartE2EDuration="1.778818634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:03.778356755 +0000 UTC m=+48.939606997" watchObservedRunningTime="2026-09-11 20:01:03.778818634 +0000 UTC m=+48.940068877"
Sep 11 20:01:04.563297 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:04.563260    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:01:04.563456 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:04.563307    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:01:04.563456 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:04.563404    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 20:01:04.563456 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:04.563404    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 20:01:04.563568 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:04.563493    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls podName:2c3afeaa-5162-49cf-b716-f59fcd056613 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:20.563479051 +0000 UTC m=+65.724729270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls") pod "dns-default-kc2dt" (UID: "2c3afeaa-5162-49cf-b716-f59fcd056613") : secret "dns-default-metrics-tls" not found
Sep 11 20:01:04.563568 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:04.563414    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9776f6448-6mdj2: secret "image-registry-tls" not found
Sep 11 20:01:04.563568 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:04.563557    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls podName:d4cd97dc-74f4-46f0-b68e-c349940db6d7 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:20.563536734 +0000 UTC m=+65.724786973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls") pod "image-registry-9776f6448-6mdj2" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7") : secret "image-registry-tls" not found
Sep 11 20:01:04.764264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:04.764229    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-n8q24\" (UID: \"3b461974-6c6d-4485-bd02-e90bc5fe9ec3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:01:04.764604 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:04.764305    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:01:04.764604 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:04.764383    2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 20:01:04.764604 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:04.764413    2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 20:01:04.764604 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:04.764453    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls podName:3b461974-6c6d-4485-bd02-e90bc5fe9ec3 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:20.764434314 +0000 UTC m=+65.925684538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-n8q24" (UID: "3b461974-6c6d-4485-bd02-e90bc5fe9ec3") : secret "samples-operator-tls" not found
Sep 11 20:01:04.764604 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:04.764471    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls podName:49c83ddc-3e64-44cf-a7be-0284d4c9d91b nodeName:}" failed. No retries permitted until 2026-09-11 20:01:20.764461874 +0000 UTC m=+65.925712097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4tfj" (UID: "49c83ddc-3e64-44cf-a7be-0284d4c9d91b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 20:01:04.864947 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:04.864919    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:01:04.865140 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:04.865055    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 20:01:04.865140 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:04.865129    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs podName:1fc3208b-5161-465f-ae33-a63b6a913af8 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:20.865109634 +0000 UTC m=+66.026359867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs") pod "router-default-7cb7c47b86-p6kg9" (UID: "1fc3208b-5161-465f-ae33-a63b6a913af8") : secret "router-metrics-certs-default" not found
Sep 11 20:01:04.865262 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:04.865187    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:01:04.865330 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:04.865313    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle podName:1fc3208b-5161-465f-ae33-a63b6a913af8 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:20.865295374 +0000 UTC m=+66.026545608 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle") pod "router-default-7cb7c47b86-p6kg9" (UID: "1fc3208b-5161-465f-ae33-a63b6a913af8") : configmap references non-existent config key: service-ca.crt
Sep 11 20:01:05.369905 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:05.369874    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jzlvs\" (UID: \"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:05.370113 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:05.370069    2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 20:01:05.370175 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:05.370140    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert podName:6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:09.370121675 +0000 UTC m=+54.531371901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jzlvs" (UID: "6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1") : secret "networking-console-plugin-cert" not found
Sep 11 20:01:07.589733 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:07.589690    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:07.590333 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:07.589767    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:07.590333 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:07.589838    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 20:01:07.590333 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:07.589899    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls podName:58d8f981-87ee-426c-aebd-9e1d9f62ea0a nodeName:}" failed. No retries permitted until 2026-09-11 20:01:15.589884408 +0000 UTC m=+60.751134627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfv5l" (UID: "58d8f981-87ee-426c-aebd-9e1d9f62ea0a") : secret "insights-runtime-extractor-tls" not found
Sep 11 20:01:07.590491 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:07.590389    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:09.126277 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:09.126230    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:01:09.126782 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:09.126324    2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:01:09.126782 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:09.126749    2585 scope.go:117] "RemoveContainer" containerID="adc477f93588daa2377566a1846fc70b48f348fc94b8a681d9079a5d33f10524"
Sep 11 20:01:09.407126 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:09.407050    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jzlvs\" (UID: \"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:09.407268 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:09.407208    2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 20:01:09.407308 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:01:09.407279    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert podName:6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1 nodeName:}" failed. No retries permitted until 2026-09-11 20:01:17.407260706 +0000 UTC m=+62.568510932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jzlvs" (UID: "6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1") : secret "networking-console-plugin-cert" not found
Sep 11 20:01:09.770623 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:09.770525    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:01:09.770623 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:09.770594    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-4zntx" event={"ID":"56d5e007-e7c4-46ee-8825-8a5dd2dbd94d","Type":"ContainerStarted","Data":"ba333aecdaac28cc92eee6a796f7d8644fb0e97a67414a846f7442aec9f91c22"}
Sep 11 20:01:09.770914 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:09.770896    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:01:09.778349 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:09.778328    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-4zntx"
Sep 11 20:01:09.792204 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:09.792158    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-4zntx" podStartSLOduration=13.165666484 podStartE2EDuration="21.792142515s" totalImagesPullingTime="8.626476031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:09.791223282 +0000 UTC m=+54.952473536" watchObservedRunningTime="2026-09-11 20:01:09.792142515 +0000 UTC m=+54.953392759"
Sep 11 20:01:15.626057 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:15.626030    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxbcp"
Sep 11 20:01:15.659362 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:15.659340    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:15.661419 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:15.661395    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58d8f981-87ee-426c-aebd-9e1d9f62ea0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfv5l\" (UID: \"58d8f981-87ee-426c-aebd-9e1d9f62ea0a\") " pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:15.761487 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:15.761462    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zqht8\""
Sep 11 20:01:15.769621 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:15.769599    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfv5l"
Sep 11 20:01:16.040988 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:16.040889    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfv5l"]
Sep 11 20:01:16.043666 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:16.043643    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d8f981_87ee_426c_aebd_9e1d9f62ea0a.slice/crio-2bb1ce2f9ad6d4a087160df3a55244dbdc7d44702edb1e4be5b45a828a334003 WatchSource:0}: Error finding container 2bb1ce2f9ad6d4a087160df3a55244dbdc7d44702edb1e4be5b45a828a334003: Status 404 returned error can't find the container with id 2bb1ce2f9ad6d4a087160df3a55244dbdc7d44702edb1e4be5b45a828a334003
Sep 11 20:01:16.795749 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:16.795720    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfv5l" event={"ID":"58d8f981-87ee-426c-aebd-9e1d9f62ea0a","Type":"ContainerStarted","Data":"ea724f4bd5858ee75734dd4740f771e1620e6ef3a03816e577efc991520d6ac0"}
Sep 11 20:01:16.796144 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:16.795775    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfv5l" event={"ID":"58d8f981-87ee-426c-aebd-9e1d9f62ea0a","Type":"ContainerStarted","Data":"2bb1ce2f9ad6d4a087160df3a55244dbdc7d44702edb1e4be5b45a828a334003"}
Sep 11 20:01:17.474775 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:17.474735    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jzlvs\" (UID: \"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:17.477048 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:17.477024    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jzlvs\" (UID: \"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:17.595177 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:17.595152    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tnt4l\""
Sep 11 20:01:17.603368 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:17.603351    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"
Sep 11 20:01:17.800587 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:17.800514    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfv5l" event={"ID":"58d8f981-87ee-426c-aebd-9e1d9f62ea0a","Type":"ContainerStarted","Data":"102a413ab7810dc086b485db5af52e152d14cab961216f9dd00c47433ba4a2e5"}
Sep 11 20:01:17.868074 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:17.868050    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs"]
Sep 11 20:01:17.870505 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:17.870483    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d372a68_48a8_4f3b_9ed7_b8b7fb872ba1.slice/crio-a8cf6fd25b116247f4fa26cd07cfc552333cc39a981a996e6bb993a351524e00 WatchSource:0}: Error finding container a8cf6fd25b116247f4fa26cd07cfc552333cc39a981a996e6bb993a351524e00: Status 404 returned error can't find the container with id a8cf6fd25b116247f4fa26cd07cfc552333cc39a981a996e6bb993a351524e00
Sep 11 20:01:18.805554 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:18.805519    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs" event={"ID":"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1","Type":"ContainerStarted","Data":"a8cf6fd25b116247f4fa26cd07cfc552333cc39a981a996e6bb993a351524e00"}
Sep 11 20:01:19.811034 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:19.810999    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfv5l" event={"ID":"58d8f981-87ee-426c-aebd-9e1d9f62ea0a","Type":"ContainerStarted","Data":"6b8e63ee445a0419071d3a68ea6be80921dc454279ccb6b35627aaa5d6c3caf2"}
Sep 11 20:01:19.812525 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:19.812499    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs" event={"ID":"6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1","Type":"ContainerStarted","Data":"55ccced666ac82189da2a13e4640db66a6b8dfe867f54ed0ff21ee9c878cc5fd"}
Sep 11 20:01:19.832772 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:19.832733    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wfv5l" podStartSLOduration=17.730159999 podStartE2EDuration="20.832719437s" totalImagesPullingTime="3.102559438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:00:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:19.83160628 +0000 UTC m=+64.992856524" watchObservedRunningTime="2026-09-11 20:01:19.832719437 +0000 UTC m=+64.993969679"
Sep 11 20:01:19.847772 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:19.847732    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jzlvs" podStartSLOduration=17.456419172 podStartE2EDuration="18.847720647s" totalImagesPullingTime="1.391301475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:19.846764548 +0000 UTC m=+65.008014784" watchObservedRunningTime="2026-09-11 20:01:19.847720647 +0000 UTC m=+65.008970888"
Sep 11 20:01:20.602822 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.602782    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:01:20.603013 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.602932    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:01:20.605067 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.605041    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c3afeaa-5162-49cf-b716-f59fcd056613-metrics-tls\") pod \"dns-default-kc2dt\" (UID: \"2c3afeaa-5162-49cf-b716-f59fcd056613\") " pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:01:20.605170 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.605140    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls\") pod \"image-registry-9776f6448-6mdj2\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") " pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:01:20.803272 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.803237    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l4rd2\""
Sep 11 20:01:20.804412 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.804391    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-n8q24\" (UID: \"3b461974-6c6d-4485-bd02-e90bc5fe9ec3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:01:20.804490 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.804444    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:01:20.806745 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.806723    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b461974-6c6d-4485-bd02-e90bc5fe9ec3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-n8q24\" (UID: \"3b461974-6c6d-4485-bd02-e90bc5fe9ec3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:01:20.806849 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.806783    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49c83ddc-3e64-44cf-a7be-0284d4c9d91b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4tfj\" (UID: \"49c83ddc-3e64-44cf-a7be-0284d4c9d91b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:01:20.810680 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.810666    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:01:20.812023 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.812003    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nbwp6\""
Sep 11 20:01:20.819866 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.819792    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:01:20.905482 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.905453    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:01:20.905592 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.905529    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:01:20.906262 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.906237    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc3208b-5161-465f-ae33-a63b6a913af8-service-ca-bundle\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:01:20.908003 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:20.907948    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc3208b-5161-465f-ae33-a63b6a913af8-metrics-certs\") pod \"router-default-7cb7c47b86-p6kg9\" (UID: \"1fc3208b-5161-465f-ae33-a63b6a913af8\") " pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:01:21.020418 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.020393    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nfpfj\""
Sep 11 20:01:21.022482 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.022467    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"
Sep 11 20:01:21.034989 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.034950    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4rs88\""
Sep 11 20:01:21.043504 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.043332    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"
Sep 11 20:01:21.085666 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.085644    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ctwbc\""
Sep 11 20:01:21.093950 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.093893    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:01:21.096798 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.096694    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9776f6448-6mdj2"]
Sep 11 20:01:21.100804 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.100660    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kc2dt"]
Sep 11 20:01:21.106830 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.106735    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:01:21.106978 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:21.106935    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4cd97dc_74f4_46f0_b68e_c349940db6d7.slice/crio-d3a8766dd46b2377bd28650c30c7930e1af7c7af1b981dfb3dd6ac5268932d33 WatchSource:0}: Error finding container d3a8766dd46b2377bd28650c30c7930e1af7c7af1b981dfb3dd6ac5268932d33: Status 404 returned error can't find the container with id d3a8766dd46b2377bd28650c30c7930e1af7c7af1b981dfb3dd6ac5268932d33
Sep 11 20:01:21.107518 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:21.107485    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3afeaa_5162_49cf_b716_f59fcd056613.slice/crio-bcd507b70ab140427d5020e9f16f7a091a43ab8be2c723becddfbf4279493476 WatchSource:0}: Error finding container bcd507b70ab140427d5020e9f16f7a091a43ab8be2c723becddfbf4279493476: Status 404 returned error can't find the container with id bcd507b70ab140427d5020e9f16f7a091a43ab8be2c723becddfbf4279493476
Sep 11 20:01:21.109822 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.109552    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 20:01:21.120630 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.120578    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd887eb-41d0-4861-a5b8-4be593422241-metrics-certs\") pod \"network-metrics-daemon-zn8nm\" (UID: \"8dd887eb-41d0-4861-a5b8-4be593422241\") " pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:01:21.183702 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.183678    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b7zd7\""
Sep 11 20:01:21.191387 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.191369    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zn8nm"
Sep 11 20:01:21.207554 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.207521    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:01:21.210489 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.210469    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 20:01:21.219981 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.219933    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f62e8683-1a77-47c2-981b-a832d9df930c-original-pull-secret\") pod \"global-pull-secret-syncer-vsxwz\" (UID: \"f62e8683-1a77-47c2-981b-a832d9df930c\") " pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:01:21.293331 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.293305    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj"]
Sep 11 20:01:21.295233 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:21.295200    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c83ddc_3e64_44cf_a7be_0284d4c9d91b.slice/crio-84f611c492c6ca46517306e91ef84c00e4833b35a623f1ae6eb4f2d2a5aa1da7 WatchSource:0}: Error finding container 84f611c492c6ca46517306e91ef84c00e4833b35a623f1ae6eb4f2d2a5aa1da7: Status 404 returned error can't find the container with id 84f611c492c6ca46517306e91ef84c00e4833b35a623f1ae6eb4f2d2a5aa1da7
Sep 11 20:01:21.326574 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.326539    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24"]
Sep 11 20:01:21.377699 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.377637    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cb7c47b86-p6kg9"]
Sep 11 20:01:21.380097 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:21.380076    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc3208b_5161_465f_ae33_a63b6a913af8.slice/crio-cd5effa706bbab62c47e28ae379dd35fec26dc087b5712f46fdc777110e74c2a WatchSource:0}: Error finding container cd5effa706bbab62c47e28ae379dd35fec26dc087b5712f46fdc777110e74c2a: Status 404 returned error can't find the container with id cd5effa706bbab62c47e28ae379dd35fec26dc087b5712f46fdc777110e74c2a
Sep 11 20:01:21.458885 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.458855    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zn8nm"]
Sep 11 20:01:21.462069 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.462047    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsxwz"
Sep 11 20:01:21.462432 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:21.462405    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd887eb_41d0_4861_a5b8_4be593422241.slice/crio-bd1b57da641b227b53f281f6e28ca49624cbc3ca097d791f073d55774d756ef9 WatchSource:0}: Error finding container bd1b57da641b227b53f281f6e28ca49624cbc3ca097d791f073d55774d756ef9: Status 404 returned error can't find the container with id bd1b57da641b227b53f281f6e28ca49624cbc3ca097d791f073d55774d756ef9
Sep 11 20:01:21.731630 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.731293    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vsxwz"]
Sep 11 20:01:21.734153 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:21.734124    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf62e8683_1a77_47c2_981b_a832d9df930c.slice/crio-8d10bb734dbbb753de2b603266f944da0ba695fff102118b911df4973fb82564 WatchSource:0}: Error finding container 8d10bb734dbbb753de2b603266f944da0ba695fff102118b911df4973fb82564: Status 404 returned error can't find the container with id 8d10bb734dbbb753de2b603266f944da0ba695fff102118b911df4973fb82564
Sep 11 20:01:21.822043 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.822003    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zn8nm" event={"ID":"8dd887eb-41d0-4861-a5b8-4be593422241","Type":"ContainerStarted","Data":"bd1b57da641b227b53f281f6e28ca49624cbc3ca097d791f073d55774d756ef9"}
Sep 11 20:01:21.823423 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.823392    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kc2dt" event={"ID":"2c3afeaa-5162-49cf-b716-f59fcd056613","Type":"ContainerStarted","Data":"bcd507b70ab140427d5020e9f16f7a091a43ab8be2c723becddfbf4279493476"}
Sep 11 20:01:21.824687 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.824653    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24" event={"ID":"3b461974-6c6d-4485-bd02-e90bc5fe9ec3","Type":"ContainerStarted","Data":"166d349d26dffc06826064f80fa27260d0517491c2f48427bd4824a02cb01f0b"}
Sep 11 20:01:21.826420 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.826395    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cb7c47b86-p6kg9" event={"ID":"1fc3208b-5161-465f-ae33-a63b6a913af8","Type":"ContainerStarted","Data":"b4362c6c90dbb66a4761d09010018b958f9d01483d64ca0f036c5c0bdde3506b"}
Sep 11 20:01:21.826542 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.826440    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cb7c47b86-p6kg9" event={"ID":"1fc3208b-5161-465f-ae33-a63b6a913af8","Type":"ContainerStarted","Data":"cd5effa706bbab62c47e28ae379dd35fec26dc087b5712f46fdc777110e74c2a"}
Sep 11 20:01:21.827986 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.827940    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj" event={"ID":"49c83ddc-3e64-44cf-a7be-0284d4c9d91b","Type":"ContainerStarted","Data":"84f611c492c6ca46517306e91ef84c00e4833b35a623f1ae6eb4f2d2a5aa1da7"}
Sep 11 20:01:21.829273 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.829250    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vsxwz" event={"ID":"f62e8683-1a77-47c2-981b-a832d9df930c","Type":"ContainerStarted","Data":"8d10bb734dbbb753de2b603266f944da0ba695fff102118b911df4973fb82564"}
Sep 11 20:01:21.830988 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.830964    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9776f6448-6mdj2" event={"ID":"d4cd97dc-74f4-46f0-b68e-c349940db6d7","Type":"ContainerStarted","Data":"4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03"}
Sep 11 20:01:21.831091 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.831005    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9776f6448-6mdj2" event={"ID":"d4cd97dc-74f4-46f0-b68e-c349940db6d7","Type":"ContainerStarted","Data":"d3a8766dd46b2377bd28650c30c7930e1af7c7af1b981dfb3dd6ac5268932d33"}
Sep 11 20:01:21.831155 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.831138    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:01:21.857327 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.857285    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7cb7c47b86-p6kg9" podStartSLOduration=33.857269486 podStartE2EDuration="33.857269486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:21.856479194 +0000 UTC m=+67.017729439" watchObservedRunningTime="2026-09-11 20:01:21.857269486 +0000 UTC m=+67.018519746"
Sep 11 20:01:21.892004 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:21.891932    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9776f6448-6mdj2" podStartSLOduration=66.891915411 podStartE2EDuration="1m6.891915411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:21.89183482 +0000 UTC m=+67.053085063" watchObservedRunningTime="2026-09-11 20:01:21.891915411 +0000 UTC m=+67.053165654"
Sep 11 20:01:22.094465 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.094427    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:01:22.097352 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.097141    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:01:22.836509 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.836444    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:01:22.838313 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.838291    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7cb7c47b86-p6kg9"
Sep 11 20:01:22.950853 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.950820    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"]
Sep 11 20:01:22.955204 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.955176    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:22.958123 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.958099    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 20:01:22.960581 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.960186    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 11 20:01:22.960581 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.960181    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"]
Sep 11 20:01:22.960581 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.960395    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 20:01:22.960581 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.960462    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 20:01:22.966022 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.964878    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm"]
Sep 11 20:01:22.966022 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.964981    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:22.981496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.972051    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 20:01:22.981496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.972366    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"]
Sep 11 20:01:22.981496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.972673    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm"
Sep 11 20:01:22.981496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.974344    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 20:01:22.981496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.978505    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 11 20:01:22.981496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.980697    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 20:01:22.981496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.980821    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 20:01:22.986175 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.986146    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-hzt24\""
Sep 11 20:01:22.988385 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.988361    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm"]
Sep 11 20:01:22.988813 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:22.988789    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"]
Sep 11 20:01:23.123383 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.123307    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.123383 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.123354    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.123595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.123410    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2xjz\" (UniqueName: \"kubernetes.io/projected/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-kube-api-access-b2xjz\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.123595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.123451    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnznf\" (UniqueName: \"kubernetes.io/projected/1f9ec0d5-27e4-4327-8416-34e41cf476ae-kube-api-access-dnznf\") pod \"klusterlet-addon-workmgr-5b65b588c5-xpcss\" (UID: \"1f9ec0d5-27e4-4327-8416-34e41cf476ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:23.123595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.123482    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrw78\" (UniqueName: \"kubernetes.io/projected/37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60-kube-api-access-hrw78\") pod \"managed-serviceaccount-addon-agent-748cb8cc46-88lvm\" (UID: \"37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm"
Sep 11 20:01:23.123595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.123535    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-hub\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.123595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.123557    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-748cb8cc46-88lvm\" (UID: \"37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm"
Sep 11 20:01:23.123595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.123590    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.123828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.123613    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1f9ec0d5-27e4-4327-8416-34e41cf476ae-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b65b588c5-xpcss\" (UID: \"1f9ec0d5-27e4-4327-8416-34e41cf476ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:23.123828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.123680    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f9ec0d5-27e4-4327-8416-34e41cf476ae-tmp\") pod \"klusterlet-addon-workmgr-5b65b588c5-xpcss\" (UID: \"1f9ec0d5-27e4-4327-8416-34e41cf476ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:23.123828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.123729    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-ca\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.224626 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.224589    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-hub\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.224821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.224643    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-748cb8cc46-88lvm\" (UID: \"37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm"
Sep 11 20:01:23.224821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.224699    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.224821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.224729    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1f9ec0d5-27e4-4327-8416-34e41cf476ae-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b65b588c5-xpcss\" (UID: \"1f9ec0d5-27e4-4327-8416-34e41cf476ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:23.224821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.224769    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f9ec0d5-27e4-4327-8416-34e41cf476ae-tmp\") pod \"klusterlet-addon-workmgr-5b65b588c5-xpcss\" (UID: \"1f9ec0d5-27e4-4327-8416-34e41cf476ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:23.224821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.224804    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-ca\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.225148 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.224827    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.225148 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.224843    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.225148 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.224859    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2xjz\" (UniqueName: \"kubernetes.io/projected/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-kube-api-access-b2xjz\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.225148 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.224886    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnznf\" (UniqueName: \"kubernetes.io/projected/1f9ec0d5-27e4-4327-8416-34e41cf476ae-kube-api-access-dnznf\") pod \"klusterlet-addon-workmgr-5b65b588c5-xpcss\" (UID: \"1f9ec0d5-27e4-4327-8416-34e41cf476ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:23.225148 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.224914    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrw78\" (UniqueName: \"kubernetes.io/projected/37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60-kube-api-access-hrw78\") pod \"managed-serviceaccount-addon-agent-748cb8cc46-88lvm\" (UID: \"37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm"
Sep 11 20:01:23.225994 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.225942    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f9ec0d5-27e4-4327-8416-34e41cf476ae-tmp\") pod \"klusterlet-addon-workmgr-5b65b588c5-xpcss\" (UID: \"1f9ec0d5-27e4-4327-8416-34e41cf476ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:23.226394 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.226340    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.228947 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.228918    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-748cb8cc46-88lvm\" (UID: \"37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm"
Sep 11 20:01:23.229654 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.229604    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-hub\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.229654 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.229646    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.229935 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.229895    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.231129 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.231095    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1f9ec0d5-27e4-4327-8416-34e41cf476ae-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b65b588c5-xpcss\" (UID: \"1f9ec0d5-27e4-4327-8416-34e41cf476ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:23.231383 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.231360    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-ca\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.242482 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.242163    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2xjz\" (UniqueName: \"kubernetes.io/projected/8f33dd74-a374-4bcc-bf6e-53a516bd4a14-kube-api-access-b2xjz\") pod \"cluster-proxy-proxy-agent-57cb788867-8vjct\" (UID: \"8f33dd74-a374-4bcc-bf6e-53a516bd4a14\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.244315 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.244272    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnznf\" (UniqueName: \"kubernetes.io/projected/1f9ec0d5-27e4-4327-8416-34e41cf476ae-kube-api-access-dnznf\") pod \"klusterlet-addon-workmgr-5b65b588c5-xpcss\" (UID: \"1f9ec0d5-27e4-4327-8416-34e41cf476ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:23.245032 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.245011    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrw78\" (UniqueName: \"kubernetes.io/projected/37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60-kube-api-access-hrw78\") pod \"managed-serviceaccount-addon-agent-748cb8cc46-88lvm\" (UID: \"37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm"
Sep 11 20:01:23.289246 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.289027    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:23.310240 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.310050    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"
Sep 11 20:01:23.318942 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:23.318911    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm"
Sep 11 20:01:27.014861 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.014827    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm"]
Sep 11 20:01:27.034396 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.034150    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"]
Sep 11 20:01:27.036412 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.035908    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct"]
Sep 11 20:01:27.061146 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:27.061115    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37ff7e4a_dcb8_46b9_afc5_0f181d5cdf60.slice/crio-37f4ae6bf562b018518db4da25039e651a2a4ec9e58902838224b90dd39007c0 WatchSource:0}: Error finding container 37f4ae6bf562b018518db4da25039e651a2a4ec9e58902838224b90dd39007c0: Status 404 returned error can't find the container with id 37f4ae6bf562b018518db4da25039e651a2a4ec9e58902838224b90dd39007c0
Sep 11 20:01:27.062183 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:27.062054    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f33dd74_a374_4bcc_bf6e_53a516bd4a14.slice/crio-7dcc12f350be246a2ac95d0570f1d6df8802ccd98a5bc9766b81f6aeb6937d49 WatchSource:0}: Error finding container 7dcc12f350be246a2ac95d0570f1d6df8802ccd98a5bc9766b81f6aeb6937d49: Status 404 returned error can't find the container with id 7dcc12f350be246a2ac95d0570f1d6df8802ccd98a5bc9766b81f6aeb6937d49
Sep 11 20:01:27.063335 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:27.063307    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9ec0d5_27e4_4327_8416_34e41cf476ae.slice/crio-7dc87ccd69fa3f157ec8629d9302c8c0aa0def8384eb2387ab085bbc802125a9 WatchSource:0}: Error finding container 7dc87ccd69fa3f157ec8629d9302c8c0aa0def8384eb2387ab085bbc802125a9: Status 404 returned error can't find the container with id 7dc87ccd69fa3f157ec8629d9302c8c0aa0def8384eb2387ab085bbc802125a9
Sep 11 20:01:27.857730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.857693    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj" event={"ID":"49c83ddc-3e64-44cf-a7be-0284d4c9d91b","Type":"ContainerStarted","Data":"b3555ec22cc0f2b0bf264b259f71486cabf5ada9e603bed2f705886bb0384d0a"}
Sep 11 20:01:27.859331 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.859303    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vsxwz" event={"ID":"f62e8683-1a77-47c2-981b-a832d9df930c","Type":"ContainerStarted","Data":"ba49ed61fe9f5b9f38df59947d119573d249f1c7984ec4441043efc0b66b4168"}
Sep 11 20:01:27.860554 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.860528    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct" event={"ID":"8f33dd74-a374-4bcc-bf6e-53a516bd4a14","Type":"ContainerStarted","Data":"7dcc12f350be246a2ac95d0570f1d6df8802ccd98a5bc9766b81f6aeb6937d49"}
Sep 11 20:01:27.861871 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.861851    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm" event={"ID":"37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60","Type":"ContainerStarted","Data":"37f4ae6bf562b018518db4da25039e651a2a4ec9e58902838224b90dd39007c0"}
Sep 11 20:01:27.863666 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.863643    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zn8nm" event={"ID":"8dd887eb-41d0-4861-a5b8-4be593422241","Type":"ContainerStarted","Data":"f5a386c104460bb114f143f27b0dd54fd8220312cc8f9d6f38b652f648f9ffa0"}
Sep 11 20:01:27.863753 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.863686    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zn8nm" event={"ID":"8dd887eb-41d0-4861-a5b8-4be593422241","Type":"ContainerStarted","Data":"16b1783a7e32b4f6d75bf4623304b1f5c5f6cd62fa596bde4fc921dc8e7372dd"}
Sep 11 20:01:27.865376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.865355    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kc2dt" event={"ID":"2c3afeaa-5162-49cf-b716-f59fcd056613","Type":"ContainerStarted","Data":"961c1dc95edc458408cbe286ab11f729e6abec98a00a9a25a735d9c26eb20443"}
Sep 11 20:01:27.865452 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.865397    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kc2dt" event={"ID":"2c3afeaa-5162-49cf-b716-f59fcd056613","Type":"ContainerStarted","Data":"0e3654e06e4b558993d5de5abcf05352accd270578ae9ad470f9fa6034d71484"}
Sep 11 20:01:27.865452 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.865421    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:01:27.866499 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.866481    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss" event={"ID":"1f9ec0d5-27e4-4327-8416-34e41cf476ae","Type":"ContainerStarted","Data":"7dc87ccd69fa3f157ec8629d9302c8c0aa0def8384eb2387ab085bbc802125a9"}
Sep 11 20:01:27.868200 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.868174    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24" event={"ID":"3b461974-6c6d-4485-bd02-e90bc5fe9ec3","Type":"ContainerStarted","Data":"0ccbd2bd913fd1ea0dd792307aaf18e8b564caaca15f09ea0b3f7b6000053e42"}
Sep 11 20:01:27.868299 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.868213    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24" event={"ID":"3b461974-6c6d-4485-bd02-e90bc5fe9ec3","Type":"ContainerStarted","Data":"64220e8bfea95ecac2ab629cfcee55d83ab69018dd7a77dfe32899c399e080b3"}
Sep 11 20:01:27.875876 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.875832    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4tfj" podStartSLOduration=34.427011639 podStartE2EDuration="39.875814584s" totalImagesPullingTime="5.448802945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:27.874710262 +0000 UTC m=+73.035960516" watchObservedRunningTime="2026-09-11 20:01:27.875814584 +0000 UTC m=+73.037064827"
Sep 11 20:01:27.891018 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.890947    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vsxwz" podStartSLOduration=67.538998753 podStartE2EDuration="1m12.890931574s" totalImagesPullingTime="5.351932821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:27.890665792 +0000 UTC m=+73.051916036" watchObservedRunningTime="2026-09-11 20:01:27.890931574 +0000 UTC m=+73.052181817"
Sep 11 20:01:27.915278 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.915241    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kc2dt" podStartSLOduration=34.283785075 podStartE2EDuration="39.915226431s" totalImagesPullingTime="5.631441356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:27.914498209 +0000 UTC m=+73.075748452" watchObservedRunningTime="2026-09-11 20:01:27.915226431 +0000 UTC m=+73.076476673"
Sep 11 20:01:27.937562 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.937507    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zn8nm" podStartSLOduration=67.661581223 podStartE2EDuration="1m12.937492407s" totalImagesPullingTime="5.275911184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:27.9371116 +0000 UTC m=+73.098361843" watchObservedRunningTime="2026-09-11 20:01:27.937492407 +0000 UTC m=+73.098742650"
Sep 11 20:01:27.959734 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:27.959698    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-n8q24" podStartSLOduration=34.583683296 podStartE2EDuration="39.959684914s" totalImagesPullingTime="5.376001618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:27.958697111 +0000 UTC m=+73.119947353" watchObservedRunningTime="2026-09-11 20:01:27.959684914 +0000 UTC m=+73.120935155"
Sep 11 20:01:29.718194 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:29.718157    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7jr97"
Sep 11 20:01:33.901209 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:33.901171    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct" event={"ID":"8f33dd74-a374-4bcc-bf6e-53a516bd4a14","Type":"ContainerStarted","Data":"e63bd49a62e6bdf39d26e8f04628653d725ecb407d8c2fb0aa2e4696132f41a9"}
Sep 11 20:01:34.906983 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:34.906925    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm" event={"ID":"37ff7e4a-dcb8-46b9-afc5-0f181d5cdf60","Type":"ContainerStarted","Data":"1b0d3e0af449d95e2e1065190269c5f97502f9571f133fa664684b7d6f1ac7bd"}
Sep 11 20:01:34.908926 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:34.908895    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss" event={"ID":"1f9ec0d5-27e4-4327-8416-34e41cf476ae","Type":"ContainerStarted","Data":"3f9b9df2e5ece9d1c092895d0eb3afb6c467b98e0f4fd48396862e189f48b1e4"}
Sep 11 20:01:34.909100 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:34.909014    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:34.910735 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:34.910712    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss"
Sep 11 20:01:34.911395 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:34.911376    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct" event={"ID":"8f33dd74-a374-4bcc-bf6e-53a516bd4a14","Type":"ContainerStarted","Data":"4aa714c71942b991d9cb5c58a0bf56ad921c07cb16afb6536a520472236b67ce"}
Sep 11 20:01:34.911474 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:34.911404    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct" event={"ID":"8f33dd74-a374-4bcc-bf6e-53a516bd4a14","Type":"ContainerStarted","Data":"19277ca8fcafa6d65d94ee26a50862d5ea5c6a19e151739af0c404867f2a7da7"}
Sep 11 20:01:34.925312 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:34.925270    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-748cb8cc46-88lvm" podStartSLOduration=5.299497482 podStartE2EDuration="12.925258751s" totalImagesPullingTime="7.625761269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:34.924402077 +0000 UTC m=+80.085652320" watchObservedRunningTime="2026-09-11 20:01:34.925258751 +0000 UTC m=+80.086508992"
Sep 11 20:01:34.946118 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:34.946039    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b65b588c5-xpcss" podStartSLOduration=5.310267466 podStartE2EDuration="12.946026804s" totalImagesPullingTime="7.635759338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:34.945220805 +0000 UTC m=+80.106471048" watchObservedRunningTime="2026-09-11 20:01:34.946026804 +0000 UTC m=+80.107277045"
Sep 11 20:01:34.966373 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:34.966328    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57cb788867-8vjct" podStartSLOduration=6.962828719 podStartE2EDuration="12.966316419s" totalImagesPullingTime="6.0034877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:34.965324514 +0000 UTC m=+80.126574795" watchObservedRunningTime="2026-09-11 20:01:34.966316419 +0000 UTC m=+80.127566660"
Sep 11 20:01:36.873203 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.873169    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d6wrq"]
Sep 11 20:01:36.877262 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.877238    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:36.880118 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.880096    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 20:01:36.881357 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.881337    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 20:01:36.881470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.881339    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 20:01:36.881470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.881357    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 20:01:36.882130 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.882114    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6rwxf\""
Sep 11 20:01:36.946156 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.946126    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-tls\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:36.946289 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.946177    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-textfile\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:36.946289 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.946229    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thz49\" (UniqueName: \"kubernetes.io/projected/0c7e9773-e797-4383-815b-6f2c84ea6f63-kube-api-access-thz49\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:36.946289 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.946255    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c7e9773-e797-4383-815b-6f2c84ea6f63-root\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:36.946289 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.946271    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:36.946438 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.946365    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c7e9773-e797-4383-815b-6f2c84ea6f63-metrics-client-ca\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:36.946472 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.946445    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-wtmp\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:36.946505 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.946480    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c7e9773-e797-4383-815b-6f2c84ea6f63-sys\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:36.946538 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:36.946508    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.047362 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.047327    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thz49\" (UniqueName: \"kubernetes.io/projected/0c7e9773-e797-4383-815b-6f2c84ea6f63-kube-api-access-thz49\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.047362 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.047366    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c7e9773-e797-4383-815b-6f2c84ea6f63-root\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.047565 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.047386    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.047565 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.047422    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c7e9773-e797-4383-815b-6f2c84ea6f63-metrics-client-ca\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.047565 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.047463    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c7e9773-e797-4383-815b-6f2c84ea6f63-root\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.047687 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.047599    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-wtmp\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.047687 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.047635    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c7e9773-e797-4383-815b-6f2c84ea6f63-sys\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.047687 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.047666    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.047823 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.047712    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-tls\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.047823 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.047735    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c7e9773-e797-4383-815b-6f2c84ea6f63-sys\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.048004 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.047774    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-wtmp\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.048397 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.047801    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-textfile\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.050369 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.048538    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-textfile\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.050369 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.048691    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c7e9773-e797-4383-815b-6f2c84ea6f63-metrics-client-ca\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.053736 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.048652    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.053938 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.053893    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-tls\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.054065 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.053978    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c7e9773-e797-4383-815b-6f2c84ea6f63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.059118 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.057852    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thz49\" (UniqueName: \"kubernetes.io/projected/0c7e9773-e797-4383-815b-6f2c84ea6f63-kube-api-access-thz49\") pod \"node-exporter-d6wrq\" (UID: \"0c7e9773-e797-4383-815b-6f2c84ea6f63\") " pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.188759 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.188691    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d6wrq"
Sep 11 20:01:37.200119 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:01:37.200094    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7e9773_e797_4383_815b_6f2c84ea6f63.slice/crio-6d8d4d80773604222985604d4404644e1ac9760c96e452ba9f3d9231311bcb34 WatchSource:0}: Error finding container 6d8d4d80773604222985604d4404644e1ac9760c96e452ba9f3d9231311bcb34: Status 404 returned error can't find the container with id 6d8d4d80773604222985604d4404644e1ac9760c96e452ba9f3d9231311bcb34
Sep 11 20:01:37.879629 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.879515    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kc2dt"
Sep 11 20:01:37.925659 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:37.925489    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6wrq" event={"ID":"0c7e9773-e797-4383-815b-6f2c84ea6f63","Type":"ContainerStarted","Data":"6d8d4d80773604222985604d4404644e1ac9760c96e452ba9f3d9231311bcb34"}
Sep 11 20:01:38.931368 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:38.931333    2585 generic.go:356] "Generic (PLEG): container finished" podID="0c7e9773-e797-4383-815b-6f2c84ea6f63" containerID="cf65ed8fcf91ad37f17ef0ded031e6dd6caa4eef5f5ef2b0f6477c1d9ea94f5e" exitCode=0
Sep 11 20:01:38.931825 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:38.931409    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6wrq" event={"ID":"0c7e9773-e797-4383-815b-6f2c84ea6f63","Type":"ContainerDied","Data":"cf65ed8fcf91ad37f17ef0ded031e6dd6caa4eef5f5ef2b0f6477c1d9ea94f5e"}
Sep 11 20:01:39.938235 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:39.938194    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6wrq" event={"ID":"0c7e9773-e797-4383-815b-6f2c84ea6f63","Type":"ContainerStarted","Data":"9b9b9221c88c1348b1d79c83d5c432d23cfeb49e52552a91f54da97ec27e1210"}
Sep 11 20:01:39.938637 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:39.938259    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6wrq" event={"ID":"0c7e9773-e797-4383-815b-6f2c84ea6f63","Type":"ContainerStarted","Data":"0a985c5f9eff03b57ec11fd097ad176718479b318179ce0aadce1be667d8f9aa"}
Sep 11 20:01:39.959142 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:39.959096    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d6wrq" podStartSLOduration=2.946767164 podStartE2EDuration="3.959084276s" totalImagesPullingTime="951.759984ms" totalInitContainerRuntime="60.557128ms" isStatefulPod=true podCreationTimestamp="2026-09-11 20:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:39.957571009 +0000 UTC m=+85.118821252" watchObservedRunningTime="2026-09-11 20:01:39.959084276 +0000 UTC m=+85.120334564"
Sep 11 20:01:40.815487 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:40.815451    2585 patch_prober.go:28] interesting pod/image-registry-9776f6448-6mdj2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 20:01:40.815686 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:40.815509    2585 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9776f6448-6mdj2" podUID="d4cd97dc-74f4-46f0-b68e-c349940db6d7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 20:01:42.840539 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:42.840506    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:01:46.785543 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:01:46.785509    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9776f6448-6mdj2"]
Sep 11 20:02:11.804913 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:11.804874    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9776f6448-6mdj2" podUID="d4cd97dc-74f4-46f0-b68e-c349940db6d7" containerName="registry" containerID="cri-o://4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03" gracePeriod=30
Sep 11 20:02:12.046631 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.046609    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:02:12.062668 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.062616    2585 generic.go:356] "Generic (PLEG): container finished" podID="d4cd97dc-74f4-46f0-b68e-c349940db6d7" containerID="4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03" exitCode=0
Sep 11 20:02:12.062668 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.062649    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9776f6448-6mdj2"
Sep 11 20:02:12.062799 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.062705    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9776f6448-6mdj2" event={"ID":"d4cd97dc-74f4-46f0-b68e-c349940db6d7","Type":"ContainerDied","Data":"4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03"}
Sep 11 20:02:12.062799 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.062758    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9776f6448-6mdj2" event={"ID":"d4cd97dc-74f4-46f0-b68e-c349940db6d7","Type":"ContainerDied","Data":"d3a8766dd46b2377bd28650c30c7930e1af7c7af1b981dfb3dd6ac5268932d33"}
Sep 11 20:02:12.062799 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.062781    2585 scope.go:117] "RemoveContainer" containerID="4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03"
Sep 11 20:02:12.073196 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.073175    2585 scope.go:117] "RemoveContainer" containerID="4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03"
Sep 11 20:02:12.073510 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:02:12.073486    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03\": container with ID starting with 4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03 not found: ID does not exist" containerID="4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03"
Sep 11 20:02:12.073570 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.073523    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03"} err="failed to get container status \"4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03\": rpc error: code = NotFound desc = could not find container \"4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03\": container with ID starting with 4f5bea95fefb8df022544c92c16dd474fc83fe0352b35959880efc90ce102e03 not found: ID does not exist"
Sep 11 20:02:12.127405 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.127378    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-bound-sa-token\") pod \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") "
Sep 11 20:02:12.127506 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.127412    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-certificates\") pod \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") "
Sep 11 20:02:12.127506 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.127449    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4cd97dc-74f4-46f0-b68e-c349940db6d7-trusted-ca\") pod \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") "
Sep 11 20:02:12.127506 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.127477    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kknxl\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-kube-api-access-kknxl\") pod \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") "
Sep 11 20:02:12.127608 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.127531    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4cd97dc-74f4-46f0-b68e-c349940db6d7-image-registry-private-configuration\") pod \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") "
Sep 11 20:02:12.127608 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.127561    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls\") pod \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") "
Sep 11 20:02:12.127608 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.127603    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4cd97dc-74f4-46f0-b68e-c349940db6d7-installation-pull-secrets\") pod \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") "
Sep 11 20:02:12.127742 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.127648    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4cd97dc-74f4-46f0-b68e-c349940db6d7-ca-trust-extracted\") pod \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\" (UID: \"d4cd97dc-74f4-46f0-b68e-c349940db6d7\") "
Sep 11 20:02:12.128173 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.127840    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d4cd97dc-74f4-46f0-b68e-c349940db6d7" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:02:12.128173 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.127987    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4cd97dc-74f4-46f0-b68e-c349940db6d7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d4cd97dc-74f4-46f0-b68e-c349940db6d7" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:02:12.129906 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.129854    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-kube-api-access-kknxl" (OuterVolumeSpecName: "kube-api-access-kknxl") pod "d4cd97dc-74f4-46f0-b68e-c349940db6d7" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7"). InnerVolumeSpecName "kube-api-access-kknxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:02:12.130031 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.129897    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d4cd97dc-74f4-46f0-b68e-c349940db6d7" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:02:12.130098 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.130064    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d4cd97dc-74f4-46f0-b68e-c349940db6d7" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:02:12.130159 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.130119    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4cd97dc-74f4-46f0-b68e-c349940db6d7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d4cd97dc-74f4-46f0-b68e-c349940db6d7" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:02:12.130199 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.130183    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4cd97dc-74f4-46f0-b68e-c349940db6d7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d4cd97dc-74f4-46f0-b68e-c349940db6d7" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:02:12.136015 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.135987    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cd97dc-74f4-46f0-b68e-c349940db6d7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d4cd97dc-74f4-46f0-b68e-c349940db6d7" (UID: "d4cd97dc-74f4-46f0-b68e-c349940db6d7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:02:12.228853 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.228817    2585 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4cd97dc-74f4-46f0-b68e-c349940db6d7-ca-trust-extracted\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:02:12.228853 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.228849    2585 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-bound-sa-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:02:12.228853 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.228861    2585 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-certificates\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:02:12.229050 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.228871    2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4cd97dc-74f4-46f0-b68e-c349940db6d7-trusted-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:02:12.229050 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.228880    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kknxl\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-kube-api-access-kknxl\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:02:12.229050 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.228888    2585 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4cd97dc-74f4-46f0-b68e-c349940db6d7-image-registry-private-configuration\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:02:12.229050 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.228897    2585 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4cd97dc-74f4-46f0-b68e-c349940db6d7-registry-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:02:12.229050 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.228905    2585 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4cd97dc-74f4-46f0-b68e-c349940db6d7-installation-pull-secrets\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:02:12.386677 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.386646    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9776f6448-6mdj2"]
Sep 11 20:02:12.388603 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:12.388582    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9776f6448-6mdj2"]
Sep 11 20:02:13.348394 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:13.348363    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4cd97dc-74f4-46f0-b68e-c349940db6d7" path="/var/lib/kubelet/pods/d4cd97dc-74f4-46f0-b68e-c349940db6d7/volumes"
Sep 11 20:02:15.076809 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:15.076774    2585 generic.go:356] "Generic (PLEG): container finished" podID="b2716994-b475-47b5-b27c-ae7df016be23" containerID="dab39409d7ffcb04db926b6a900dce12b030d5587d9538ce07c964d91a2a0eba" exitCode=0
Sep 11 20:02:15.077205 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:15.076836    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f" event={"ID":"b2716994-b475-47b5-b27c-ae7df016be23","Type":"ContainerDied","Data":"dab39409d7ffcb04db926b6a900dce12b030d5587d9538ce07c964d91a2a0eba"}
Sep 11 20:02:15.077205 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:15.077165    2585 scope.go:117] "RemoveContainer" containerID="dab39409d7ffcb04db926b6a900dce12b030d5587d9538ce07c964d91a2a0eba"
Sep 11 20:02:16.082816 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:16.082781    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h6d2f" event={"ID":"b2716994-b475-47b5-b27c-ae7df016be23","Type":"ContainerStarted","Data":"625477eb81b2d14254e1055068c70d11514a56a8929c5276b8a917b0e43fad06"}
Sep 11 20:02:30.142020 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:30.141976    2585 generic.go:356] "Generic (PLEG): container finished" podID="ca1a8908-a5ff-4122-9d3f-5ae60adb45b9" containerID="b842590ddc9ec5107fd46afbcabff9533380f183acfff339d7be32c7454b06dc" exitCode=0
Sep 11 20:02:30.142496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:30.141985    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-9zm9v" event={"ID":"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9","Type":"ContainerDied","Data":"b842590ddc9ec5107fd46afbcabff9533380f183acfff339d7be32c7454b06dc"}
Sep 11 20:02:30.142496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:30.142421    2585 scope.go:117] "RemoveContainer" containerID="b842590ddc9ec5107fd46afbcabff9533380f183acfff339d7be32c7454b06dc"
Sep 11 20:02:30.143886 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:30.143862    2585 generic.go:356] "Generic (PLEG): container finished" podID="452aaf2b-9726-4c46-8fbe-aab42ae6dcc1" containerID="8bffe3c44b72828601f4f2c4c54e7d9e1ab038bc0b7f8ffc0987ffa9723f0be2" exitCode=0
Sep 11 20:02:30.143975 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:30.143934    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7" event={"ID":"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1","Type":"ContainerDied","Data":"8bffe3c44b72828601f4f2c4c54e7d9e1ab038bc0b7f8ffc0987ffa9723f0be2"}
Sep 11 20:02:30.144227 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:30.144214    2585 scope.go:117] "RemoveContainer" containerID="8bffe3c44b72828601f4f2c4c54e7d9e1ab038bc0b7f8ffc0987ffa9723f0be2"
Sep 11 20:02:31.150140 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:31.150095    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-9zm9v" event={"ID":"ca1a8908-a5ff-4122-9d3f-5ae60adb45b9","Type":"ContainerStarted","Data":"fa7c4b118bbc1c0e08d3e7acea8f656d5f42b678f0a586735e7656663e21d344"}
Sep 11 20:02:31.151906 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:02:31.151883    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vtzn7" event={"ID":"452aaf2b-9726-4c46-8fbe-aab42ae6dcc1","Type":"ContainerStarted","Data":"e6121c7cb5c2dfe765396f72a659a71378f47a29fc135f2a8b70a9238617fa37"}
Sep 11 20:05:15.261768 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:05:15.261740    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:05:15.263699 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:05:15.263676    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:05:15.272886 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:05:15.272861    2585 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 20:06:01.948612 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:01.948580    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"]
Sep 11 20:06:01.949061 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:01.948887    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4cd97dc-74f4-46f0-b68e-c349940db6d7" containerName="registry"
Sep 11 20:06:01.949061 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:01.948903    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4cd97dc-74f4-46f0-b68e-c349940db6d7" containerName="registry"
Sep 11 20:06:01.949061 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:01.948950    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4cd97dc-74f4-46f0-b68e-c349940db6d7" containerName="registry"
Sep 11 20:06:01.951857 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:01.951836    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:01.954926 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:01.954909    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 20:06:01.955043 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:01.955022    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jwddf\""
Sep 11 20:06:01.955828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:01.955814    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 20:06:01.956340 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:01.956327    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 20:06:01.960129 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:01.960107    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 20:06:01.997096 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:01.997070    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"]
Sep 11 20:06:02.006614 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.006588    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-manifests\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.006730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.006621    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.006730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.006644    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-tmp\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.006730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.006716    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd7nq\" (UniqueName: \"kubernetes.io/projected/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-kube-api-access-dd7nq\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.006829 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.006758    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.107894 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.107860    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-manifests\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.107894 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.107898    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.108164 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.107919    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-tmp\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.108164 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.107987    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd7nq\" (UniqueName: \"kubernetes.io/projected/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-kube-api-access-dd7nq\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.108164 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.108017    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.108310 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.108254    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-manifests\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.110314 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.110290    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-tmp\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.110462 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.110444    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.110522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.110467    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.119003 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.118979    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd7nq\" (UniqueName: \"kubernetes.io/projected/bb08fa17-f3b6-4e10-b167-58df42b8ecf0-kube-api-access-dd7nq\") pod \"opendatahub-operator-controller-manager-5fdf48ff49-znx4p\" (UID: \"bb08fa17-f3b6-4e10-b167-58df42b8ecf0\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.262102 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.262017    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:02.541774 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.541659    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"]
Sep 11 20:06:02.546318 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:06:02.546295    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb08fa17_f3b6_4e10_b167_58df42b8ecf0.slice/crio-20fd62bbcf2cf683e0e7b0b67193f2447266485b41f86cee672bd8af83a4258e WatchSource:0}: Error finding container 20fd62bbcf2cf683e0e7b0b67193f2447266485b41f86cee672bd8af83a4258e: Status 404 returned error can't find the container with id 20fd62bbcf2cf683e0e7b0b67193f2447266485b41f86cee672bd8af83a4258e
Sep 11 20:06:02.548005 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.547988    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 20:06:02.936276 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:02.936243    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p" event={"ID":"bb08fa17-f3b6-4e10-b167-58df42b8ecf0","Type":"ContainerStarted","Data":"20fd62bbcf2cf683e0e7b0b67193f2447266485b41f86cee672bd8af83a4258e"}
Sep 11 20:06:06.958142 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:06.958104    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p" event={"ID":"bb08fa17-f3b6-4e10-b167-58df42b8ecf0","Type":"ContainerStarted","Data":"ff3e41f915f0ca62dd498992a2287b775a8330416c96e2c15ca057a9ba867c98"}
Sep 11 20:06:07.963392 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:07.963310    2585 generic.go:356] "Generic (PLEG): container finished" podID="bb08fa17-f3b6-4e10-b167-58df42b8ecf0" containerID="ff3e41f915f0ca62dd498992a2287b775a8330416c96e2c15ca057a9ba867c98" exitCode=0
Sep 11 20:06:07.963777 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:07.963398    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p" event={"ID":"bb08fa17-f3b6-4e10-b167-58df42b8ecf0","Type":"ContainerDied","Data":"ff3e41f915f0ca62dd498992a2287b775a8330416c96e2c15ca057a9ba867c98"}
Sep 11 20:06:08.969874 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:08.969843    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p" event={"ID":"bb08fa17-f3b6-4e10-b167-58df42b8ecf0","Type":"ContainerStarted","Data":"c97059fc59f5b872d88b3d345ab3ee5c91fd0537d94b21aba1c517684ecaa18e"}
Sep 11 20:06:08.970287 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:08.969965    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:08.995322 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:08.995268    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p" podStartSLOduration=3.25758221 podStartE2EDuration="7.995252616s" totalImagesPullingTime="3.675042304s" totalInitContainerRuntime="1.062628102s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:06:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:06:08.992912742 +0000 UTC m=+354.154162985" watchObservedRunningTime="2026-09-11 20:06:08.995252616 +0000 UTC m=+354.156502858"
Sep 11 20:06:19.975566 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:19.975538    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fdf48ff49-znx4p"
Sep 11 20:06:28.857882 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.857846    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"]
Sep 11 20:06:28.871792 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.871769    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:28.874444 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.874420    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 20:06:28.874568 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.874522    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7fvxf\""
Sep 11 20:06:28.878065 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.878043    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"]
Sep 11 20:06:28.913710 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.913684    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:28.913814 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.913714    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:28.913814 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.913748    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:28.913907 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.913808    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:28.913907 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.913843    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:28.913907 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.913876    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:28.913907 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.913892    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn4sl\" (UniqueName: \"kubernetes.io/projected/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-kube-api-access-vn4sl\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:28.914127 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.913998    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:28.914127 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:28.914041    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.015407 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.015378    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.015407 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.015409    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn4sl\" (UniqueName: \"kubernetes.io/projected/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-kube-api-access-vn4sl\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.015607 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.015436    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.015607 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.015453    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.015607 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.015475    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.015607 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.015500    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.015607 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.015583    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.015858 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.015637    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.015858 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.015668    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.015974 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.015866    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.016034 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.015980    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.016094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.016040    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.016094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.016049    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.016443 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.016421    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.017843 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.017825    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.017913 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.017897    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.044669 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.044644    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.049114 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.049095    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn4sl\" (UniqueName: \"kubernetes.io/projected/6890f642-17ff-41a0-b8cf-6525cd8ab9d7-kube-api-access-vn4sl\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z\" (UID: \"6890f642-17ff-41a0-b8cf-6525cd8ab9d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.184463 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.184361    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:29.460479 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:29.460397    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"]
Sep 11 20:06:29.463007 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:06:29.462981    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6890f642_17ff_41a0_b8cf_6525cd8ab9d7.slice/crio-cbcdb403375b7b0b2beefc3316a5c41859547aa9a6c4fffd594bf301b1b599ae WatchSource:0}: Error finding container cbcdb403375b7b0b2beefc3316a5c41859547aa9a6c4fffd594bf301b1b599ae: Status 404 returned error can't find the container with id cbcdb403375b7b0b2beefc3316a5c41859547aa9a6c4fffd594bf301b1b599ae
Sep 11 20:06:30.054905 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:30.054870    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z" event={"ID":"6890f642-17ff-41a0-b8cf-6525cd8ab9d7","Type":"ContainerStarted","Data":"cbcdb403375b7b0b2beefc3316a5c41859547aa9a6c4fffd594bf301b1b599ae"}
Sep 11 20:06:32.268658 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:32.268623    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:06:32.268975 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:32.268693    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:06:32.268975 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:32.268719    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:06:33.070002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:33.069940    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z" event={"ID":"6890f642-17ff-41a0-b8cf-6525cd8ab9d7","Type":"ContainerStarted","Data":"21a60658fae79a6d800dabe185bee62023c7dd10c94893de84751ecd4208e386"}
Sep 11 20:06:33.093220 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:33.093168    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z" podStartSLOduration=2.289671623 podStartE2EDuration="5.093153841s" totalImagesPullingTime="2.803482218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:06:33.091024467 +0000 UTC m=+378.252274701" watchObservedRunningTime="2026-09-11 20:06:33.093153841 +0000 UTC m=+378.254404084"
Sep 11 20:06:33.185622 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:33.185588    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:33.190091 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:33.190069    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:34.074380 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:34.074345    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:34.075404 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:34.075383    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z"
Sep 11 20:06:40.717527 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.717495    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-865445d586-vms6h"]
Sep 11 20:06:40.720660 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.720640    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:40.723501 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.723482    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 20:06:40.724654 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.724628    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 20:06:40.725323 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.725303    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 20:06:40.725409 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.725328    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x829v\""
Sep 11 20:06:40.725409 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.725328    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 20:06:40.725645 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.725628    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 20:06:40.735186 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.735167    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-865445d586-vms6h"]
Sep 11 20:06:40.812992 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.812942    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901-metrics-cert\") pod \"lws-controller-manager-865445d586-vms6h\" (UID: \"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901\") " pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:40.812992 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.812993    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5gn7\" (UniqueName: \"kubernetes.io/projected/dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901-kube-api-access-g5gn7\") pod \"lws-controller-manager-865445d586-vms6h\" (UID: \"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901\") " pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:40.813183 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.813032    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901-manager-config\") pod \"lws-controller-manager-865445d586-vms6h\" (UID: \"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901\") " pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:40.813183 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.813049    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901-cert\") pod \"lws-controller-manager-865445d586-vms6h\" (UID: \"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901\") " pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:40.913432 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.913396    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901-metrics-cert\") pod \"lws-controller-manager-865445d586-vms6h\" (UID: \"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901\") " pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:40.913432 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.913434    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5gn7\" (UniqueName: \"kubernetes.io/projected/dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901-kube-api-access-g5gn7\") pod \"lws-controller-manager-865445d586-vms6h\" (UID: \"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901\") " pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:40.913634 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.913476    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901-manager-config\") pod \"lws-controller-manager-865445d586-vms6h\" (UID: \"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901\") " pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:40.913634 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.913501    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901-cert\") pod \"lws-controller-manager-865445d586-vms6h\" (UID: \"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901\") " pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:40.914199 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.914171    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901-manager-config\") pod \"lws-controller-manager-865445d586-vms6h\" (UID: \"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901\") " pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:40.915842 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.915820    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901-metrics-cert\") pod \"lws-controller-manager-865445d586-vms6h\" (UID: \"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901\") " pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:40.916010 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.915992    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901-cert\") pod \"lws-controller-manager-865445d586-vms6h\" (UID: \"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901\") " pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:40.922641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:40.922621    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5gn7\" (UniqueName: \"kubernetes.io/projected/dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901-kube-api-access-g5gn7\") pod \"lws-controller-manager-865445d586-vms6h\" (UID: \"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901\") " pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:41.030047 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:41.029935    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:41.298865 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:41.298841    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-865445d586-vms6h"]
Sep 11 20:06:41.301255 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:06:41.301227    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8800f3_8cf1_4231_9bd2_3ebaf1dc1901.slice/crio-2a44fc383023955928b08c800242ee1e53615c1a9d1e8ae480f9debaa054add6 WatchSource:0}: Error finding container 2a44fc383023955928b08c800242ee1e53615c1a9d1e8ae480f9debaa054add6: Status 404 returned error can't find the container with id 2a44fc383023955928b08c800242ee1e53615c1a9d1e8ae480f9debaa054add6
Sep 11 20:06:42.115652 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:42.115605    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h" event={"ID":"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901","Type":"ContainerStarted","Data":"2a44fc383023955928b08c800242ee1e53615c1a9d1e8ae480f9debaa054add6"}
Sep 11 20:06:44.126438 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:44.126408    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h" event={"ID":"dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901","Type":"ContainerStarted","Data":"4ebd229c23ea5f475b29f54bc4d6e8123511b1933ad4ecd9e5851f1dc9787421"}
Sep 11 20:06:44.126824 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:44.126517    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:06:44.153292 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:44.153238    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h" podStartSLOduration=1.51036148 podStartE2EDuration="4.153218879s" totalImagesPullingTime="2.642857399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:06:44.149928294 +0000 UTC m=+389.311178536" watchObservedRunningTime="2026-09-11 20:06:44.153218879 +0000 UTC m=+389.314469122"
Sep 11 20:06:55.132757 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:06:55.132723    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-865445d586-vms6h"
Sep 11 20:08:08.596028 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:08.595990    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rnt8d"]
Sep 11 20:08:08.599410 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:08.599388    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-rnt8d"
Sep 11 20:08:08.603731 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:08.603712    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lf9vm\""
Sep 11 20:08:08.604049 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:08.604034    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 20:08:08.604488 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:08.604467    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 20:08:08.616159 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:08.616135    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rnt8d"]
Sep 11 20:08:08.709223 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:08.709196    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qscfp\" (UniqueName: \"kubernetes.io/projected/d62949bb-e473-4276-9e78-b97e3a9ef725-kube-api-access-qscfp\") pod \"authorino-operator-76b478bd78-rnt8d\" (UID: \"d62949bb-e473-4276-9e78-b97e3a9ef725\") " pod="kuadrant-system/authorino-operator-76b478bd78-rnt8d"
Sep 11 20:08:08.810165 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:08.810129    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qscfp\" (UniqueName: \"kubernetes.io/projected/d62949bb-e473-4276-9e78-b97e3a9ef725-kube-api-access-qscfp\") pod \"authorino-operator-76b478bd78-rnt8d\" (UID: \"d62949bb-e473-4276-9e78-b97e3a9ef725\") " pod="kuadrant-system/authorino-operator-76b478bd78-rnt8d"
Sep 11 20:08:08.821008 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:08.820976    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qscfp\" (UniqueName: \"kubernetes.io/projected/d62949bb-e473-4276-9e78-b97e3a9ef725-kube-api-access-qscfp\") pod \"authorino-operator-76b478bd78-rnt8d\" (UID: \"d62949bb-e473-4276-9e78-b97e3a9ef725\") " pod="kuadrant-system/authorino-operator-76b478bd78-rnt8d"
Sep 11 20:08:08.909117 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:08.909030    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-rnt8d"
Sep 11 20:08:09.193372 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:09.193342    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rnt8d"]
Sep 11 20:08:09.195562 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:08:09.195537    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62949bb_e473_4276_9e78_b97e3a9ef725.slice/crio-685e923bd70c0dcf242bd4ab93e72f9a2ccd1dbff233d8928ff10dfd0d1abb42 WatchSource:0}: Error finding container 685e923bd70c0dcf242bd4ab93e72f9a2ccd1dbff233d8928ff10dfd0d1abb42: Status 404 returned error can't find the container with id 685e923bd70c0dcf242bd4ab93e72f9a2ccd1dbff233d8928ff10dfd0d1abb42
Sep 11 20:08:09.474704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:09.474622    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rnt8d" event={"ID":"d62949bb-e473-4276-9e78-b97e3a9ef725","Type":"ContainerStarted","Data":"685e923bd70c0dcf242bd4ab93e72f9a2ccd1dbff233d8928ff10dfd0d1abb42"}
Sep 11 20:08:12.491651 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:12.491565    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rnt8d" event={"ID":"d62949bb-e473-4276-9e78-b97e3a9ef725","Type":"ContainerStarted","Data":"5e6dc3a60533bc3b3902c58822157e4cdb1178c9ad479fd51cef305ad9ef088c"}
Sep 11 20:08:12.492016 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:12.491689    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-rnt8d"
Sep 11 20:08:12.522645 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:12.522601    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-rnt8d" podStartSLOduration=1.586375839 podStartE2EDuration="4.522587557s" totalImagesPullingTime="2.936211718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:08:12.521716712 +0000 UTC m=+477.682966964" watchObservedRunningTime="2026-09-11 20:08:12.522587557 +0000 UTC m=+477.683837800"
Sep 11 20:08:23.498440 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:23.498408    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-rnt8d"
Sep 11 20:08:26.063638 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:26.063599    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"]
Sep 11 20:08:26.069873 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:26.069850    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"
Sep 11 20:08:26.072812 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:26.072790    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vn2ls\""
Sep 11 20:08:26.082748 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:26.082722    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"]
Sep 11 20:08:26.141519 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:26.141486    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02b24688-76e2-4ae9-b488-928c0502334a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-t6rx5\" (UID: \"02b24688-76e2-4ae9-b488-928c0502334a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"
Sep 11 20:08:26.141519 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:26.141525    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp26m\" (UniqueName: \"kubernetes.io/projected/02b24688-76e2-4ae9-b488-928c0502334a-kube-api-access-tp26m\") pod \"kuadrant-operator-controller-manager-5769f99d9f-t6rx5\" (UID: \"02b24688-76e2-4ae9-b488-928c0502334a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"
Sep 11 20:08:26.242882 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:26.242852    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp26m\" (UniqueName: \"kubernetes.io/projected/02b24688-76e2-4ae9-b488-928c0502334a-kube-api-access-tp26m\") pod \"kuadrant-operator-controller-manager-5769f99d9f-t6rx5\" (UID: \"02b24688-76e2-4ae9-b488-928c0502334a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"
Sep 11 20:08:26.243012 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:26.242928    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02b24688-76e2-4ae9-b488-928c0502334a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-t6rx5\" (UID: \"02b24688-76e2-4ae9-b488-928c0502334a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"
Sep 11 20:08:26.243245 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:26.243231    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02b24688-76e2-4ae9-b488-928c0502334a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-t6rx5\" (UID: \"02b24688-76e2-4ae9-b488-928c0502334a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"
Sep 11 20:08:26.252129 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:26.252104    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp26m\" (UniqueName: \"kubernetes.io/projected/02b24688-76e2-4ae9-b488-928c0502334a-kube-api-access-tp26m\") pod \"kuadrant-operator-controller-manager-5769f99d9f-t6rx5\" (UID: \"02b24688-76e2-4ae9-b488-928c0502334a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"
Sep 11 20:08:26.379446 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:26.379421    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"
Sep 11 20:08:26.660373 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:26.660304    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"]
Sep 11 20:08:26.664062 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:08:26.664035    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b24688_76e2_4ae9_b488_928c0502334a.slice/crio-6342c747969d09caea7a92f43cbdf1a3fc7ec69a75d32a3934ec437cbc2228a8 WatchSource:0}: Error finding container 6342c747969d09caea7a92f43cbdf1a3fc7ec69a75d32a3934ec437cbc2228a8: Status 404 returned error can't find the container with id 6342c747969d09caea7a92f43cbdf1a3fc7ec69a75d32a3934ec437cbc2228a8
Sep 11 20:08:27.557116 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:27.557079    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5" event={"ID":"02b24688-76e2-4ae9-b488-928c0502334a","Type":"ContainerStarted","Data":"6342c747969d09caea7a92f43cbdf1a3fc7ec69a75d32a3934ec437cbc2228a8"}
Sep 11 20:08:30.573366 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:30.573272    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5" event={"ID":"02b24688-76e2-4ae9-b488-928c0502334a","Type":"ContainerStarted","Data":"dcf23a9ccf3c0eba137f3c1d9ec81444a083f0207929d47aa505b38fb1bcc740"}
Sep 11 20:08:30.573366 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:30.573350    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"
Sep 11 20:08:30.597041 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:30.596993    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5" podStartSLOduration=1.1620966369999999 podStartE2EDuration="4.59697568s" totalImagesPullingTime="3.434879043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:08:30.594946465 +0000 UTC m=+495.756196707" watchObservedRunningTime="2026-09-11 20:08:30.59697568 +0000 UTC m=+495.758225919"
Sep 11 20:08:41.579865 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:08:41.579833    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"
Sep 11 20:09:28.716305 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:28.716272    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d799cf5bb-ldkzg"]
Sep 11 20:09:28.718363 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:28.718347    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d799cf5bb-ldkzg"
Sep 11 20:09:28.722474 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:28.722455    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 20:09:28.722606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:28.722461    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5tkpk\""
Sep 11 20:09:28.728035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:28.728009    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d799cf5bb-ldkzg"]
Sep 11 20:09:28.743833 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:28.743803    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0411eddc-497d-4daf-b89c-ca5d7e77c2c7-tls-cert\") pod \"authorino-7d799cf5bb-ldkzg\" (UID: \"0411eddc-497d-4daf-b89c-ca5d7e77c2c7\") " pod="kuadrant-system/authorino-7d799cf5bb-ldkzg"
Sep 11 20:09:28.743972 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:28.743840    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdhdn\" (UniqueName: \"kubernetes.io/projected/0411eddc-497d-4daf-b89c-ca5d7e77c2c7-kube-api-access-pdhdn\") pod \"authorino-7d799cf5bb-ldkzg\" (UID: \"0411eddc-497d-4daf-b89c-ca5d7e77c2c7\") " pod="kuadrant-system/authorino-7d799cf5bb-ldkzg"
Sep 11 20:09:28.844525 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:28.844492    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0411eddc-497d-4daf-b89c-ca5d7e77c2c7-tls-cert\") pod \"authorino-7d799cf5bb-ldkzg\" (UID: \"0411eddc-497d-4daf-b89c-ca5d7e77c2c7\") " pod="kuadrant-system/authorino-7d799cf5bb-ldkzg"
Sep 11 20:09:28.844525 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:28.844530    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdhdn\" (UniqueName: \"kubernetes.io/projected/0411eddc-497d-4daf-b89c-ca5d7e77c2c7-kube-api-access-pdhdn\") pod \"authorino-7d799cf5bb-ldkzg\" (UID: \"0411eddc-497d-4daf-b89c-ca5d7e77c2c7\") " pod="kuadrant-system/authorino-7d799cf5bb-ldkzg"
Sep 11 20:09:28.846917 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:28.846890    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0411eddc-497d-4daf-b89c-ca5d7e77c2c7-tls-cert\") pod \"authorino-7d799cf5bb-ldkzg\" (UID: \"0411eddc-497d-4daf-b89c-ca5d7e77c2c7\") " pod="kuadrant-system/authorino-7d799cf5bb-ldkzg"
Sep 11 20:09:28.853003 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:28.852978    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdhdn\" (UniqueName: \"kubernetes.io/projected/0411eddc-497d-4daf-b89c-ca5d7e77c2c7-kube-api-access-pdhdn\") pod \"authorino-7d799cf5bb-ldkzg\" (UID: \"0411eddc-497d-4daf-b89c-ca5d7e77c2c7\") " pod="kuadrant-system/authorino-7d799cf5bb-ldkzg"
Sep 11 20:09:29.028371 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:29.028301    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d799cf5bb-ldkzg"
Sep 11 20:09:29.296928 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:29.296847    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d799cf5bb-ldkzg"]
Sep 11 20:09:29.300644 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:09:29.300616    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0411eddc_497d_4daf_b89c_ca5d7e77c2c7.slice/crio-883e97b1d40c7be7a79e3bcb40942e5bea19cbcd3485d88efc5a4acf5ed6de96 WatchSource:0}: Error finding container 883e97b1d40c7be7a79e3bcb40942e5bea19cbcd3485d88efc5a4acf5ed6de96: Status 404 returned error can't find the container with id 883e97b1d40c7be7a79e3bcb40942e5bea19cbcd3485d88efc5a4acf5ed6de96
Sep 11 20:09:29.841996 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:29.841947    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d799cf5bb-ldkzg" event={"ID":"0411eddc-497d-4daf-b89c-ca5d7e77c2c7","Type":"ContainerStarted","Data":"883e97b1d40c7be7a79e3bcb40942e5bea19cbcd3485d88efc5a4acf5ed6de96"}
Sep 11 20:09:31.852265 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:31.852224    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d799cf5bb-ldkzg" event={"ID":"0411eddc-497d-4daf-b89c-ca5d7e77c2c7","Type":"ContainerStarted","Data":"118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0"}
Sep 11 20:09:31.869296 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:09:31.869251    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d799cf5bb-ldkzg" podStartSLOduration=2.319169806 podStartE2EDuration="3.869235924s" totalImagesPullingTime="1.550066118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:09:31.868357387 +0000 UTC m=+557.029607629" watchObservedRunningTime="2026-09-11 20:09:31.869235924 +0000 UTC m=+557.030486165"
Sep 11 20:10:15.291914 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:15.291884    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:10:15.294844 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:15.294819    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:10:46.879707 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.879673    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-64592"]
Sep 11 20:10:46.882062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.882026    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:46.884552 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.884534    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 20:10:46.885689 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.885654    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 20:10:46.885804 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.885686    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 20:10:46.886100 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.886083    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j8965\""
Sep 11 20:10:46.893758 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.893736    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-64592"]
Sep 11 20:10:46.964371 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.964343    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:46.964495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.964379    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh2vs\" (UniqueName: \"kubernetes.io/projected/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-kube-api-access-nh2vs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:46.964495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.964418    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:46.964495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.964470    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:46.964605 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.964503    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:46.964605 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:46.964566    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.064948 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.064916    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.065151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.064979    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.065151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.064999    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.065151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.065022    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.065151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.065079    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.065151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.065117    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh2vs\" (UniqueName: \"kubernetes.io/projected/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-kube-api-access-nh2vs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.065524 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.065493    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.065635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.065529    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.065793 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.065772    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.067322 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.067294    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.067737 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.067718    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.074573 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.074536    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh2vs\" (UniqueName: \"kubernetes.io/projected/9bc2f7a8-a247-4220-84f2-a7506cf1b2f4-kube-api-access-nh2vs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-64592\" (UID: \"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.193246 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.193169    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:47.461636 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:47.461535    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-64592"]
Sep 11 20:10:47.464483 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:10:47.464451    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc2f7a8_a247_4220_84f2_a7506cf1b2f4.slice/crio-9cdc57249e7a63f1f9ed01b9d828c136e12e4add1e8d01f06978c08fb8774dd9 WatchSource:0}: Error finding container 9cdc57249e7a63f1f9ed01b9d828c136e12e4add1e8d01f06978c08fb8774dd9: Status 404 returned error can't find the container with id 9cdc57249e7a63f1f9ed01b9d828c136e12e4add1e8d01f06978c08fb8774dd9
Sep 11 20:10:48.192910 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:48.192872    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592" event={"ID":"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4","Type":"ContainerStarted","Data":"9cdc57249e7a63f1f9ed01b9d828c136e12e4add1e8d01f06978c08fb8774dd9"}
Sep 11 20:10:49.198742 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:49.198702    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592" event={"ID":"9bc2f7a8-a247-4220-84f2-a7506cf1b2f4","Type":"ContainerStarted","Data":"dde99ce0805b4428fcf1bb6cf742d0f8a634d4e99c6ceb45ccf3d0a0e133430f"}
Sep 11 20:10:49.215914 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:49.215863    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592" podStartSLOduration=2.17472403 podStartE2EDuration="3.215849828s" totalImagesPullingTime="1.041125798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:10:49.214536565 +0000 UTC m=+634.375786807" watchObservedRunningTime="2026-09-11 20:10:49.215849828 +0000 UTC m=+634.377100084"
Sep 11 20:10:55.682314 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.682279    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"]
Sep 11 20:10:55.685648 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.685629    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.688095 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.688078    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 20:10:55.696223 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.696199    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"]
Sep 11 20:10:55.736094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.736069    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de497d69-9d2a-4e12-b1a4-7f1fb1138765-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.736189 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.736111    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de497d69-9d2a-4e12-b1a4-7f1fb1138765-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.736233 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.736182    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de497d69-9d2a-4e12-b1a4-7f1fb1138765-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.736268 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.736259    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6qqq\" (UniqueName: \"kubernetes.io/projected/de497d69-9d2a-4e12-b1a4-7f1fb1138765-kube-api-access-j6qqq\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.736302 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.736283    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de497d69-9d2a-4e12-b1a4-7f1fb1138765-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.736340 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.736317    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de497d69-9d2a-4e12-b1a4-7f1fb1138765-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.837615 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.837580    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de497d69-9d2a-4e12-b1a4-7f1fb1138765-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.837774 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.837626    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6qqq\" (UniqueName: \"kubernetes.io/projected/de497d69-9d2a-4e12-b1a4-7f1fb1138765-kube-api-access-j6qqq\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.837774 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.837649    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de497d69-9d2a-4e12-b1a4-7f1fb1138765-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.837774 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.837679    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de497d69-9d2a-4e12-b1a4-7f1fb1138765-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.837774 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.837702    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de497d69-9d2a-4e12-b1a4-7f1fb1138765-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.837774 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.837729    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de497d69-9d2a-4e12-b1a4-7f1fb1138765-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.838082 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.838059    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de497d69-9d2a-4e12-b1a4-7f1fb1138765-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.838141 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.838105    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de497d69-9d2a-4e12-b1a4-7f1fb1138765-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.838185 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.838173    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de497d69-9d2a-4e12-b1a4-7f1fb1138765-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.840027 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.840007    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de497d69-9d2a-4e12-b1a4-7f1fb1138765-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.840226 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.840212    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de497d69-9d2a-4e12-b1a4-7f1fb1138765-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.847687 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.847664    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6qqq\" (UniqueName: \"kubernetes.io/projected/de497d69-9d2a-4e12-b1a4-7f1fb1138765-kube-api-access-j6qqq\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr\" (UID: \"de497d69-9d2a-4e12-b1a4-7f1fb1138765\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:55.996018 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:55.995924    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:10:56.266892 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:56.266863    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"]
Sep 11 20:10:56.269041 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:10:56.269014    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde497d69_9d2a_4e12_b1a4_7f1fb1138765.slice/crio-0f1d4731ec0ba07f5f3feb53644706eefee91a1d0cf1f8595486f2b93dd2c97a WatchSource:0}: Error finding container 0f1d4731ec0ba07f5f3feb53644706eefee91a1d0cf1f8595486f2b93dd2c97a: Status 404 returned error can't find the container with id 0f1d4731ec0ba07f5f3feb53644706eefee91a1d0cf1f8595486f2b93dd2c97a
Sep 11 20:10:57.193829 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:57.193788    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:57.194257 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:57.193853    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:57.206799 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:57.206773    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:57.235496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:57.235464    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr" event={"ID":"de497d69-9d2a-4e12-b1a4-7f1fb1138765","Type":"ContainerStarted","Data":"98c5e57141480f1232b30f9622cb090e30d4695fac7f8b5be37430f4162ad0d9"}
Sep 11 20:10:57.235674 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:57.235510    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr" event={"ID":"de497d69-9d2a-4e12-b1a4-7f1fb1138765","Type":"ContainerStarted","Data":"0f1d4731ec0ba07f5f3feb53644706eefee91a1d0cf1f8595486f2b93dd2c97a"}
Sep 11 20:10:57.247292 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:57.247266    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-64592"
Sep 11 20:10:57.255847 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:10:57.255805    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr" podStartSLOduration=2.075505811 podStartE2EDuration="2.255789822s" totalImagesPullingTime="180.284011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:10:57.254331995 +0000 UTC m=+642.415582249" watchObservedRunningTime="2026-09-11 20:10:57.255789822 +0000 UTC m=+642.417040063"
Sep 11 20:11:05.997008 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:11:05.996945    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:11:05.997621 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:11:05.997027    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:11:06.010003 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:11:06.009972    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:11:06.291883 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:11:06.291804    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr"
Sep 11 20:12:37.859942 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:37.859911    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d799cf5bb-ldkzg"]
Sep 11 20:12:37.860575 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:37.860111    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7d799cf5bb-ldkzg" podUID="0411eddc-497d-4daf-b89c-ca5d7e77c2c7" containerName="authorino" containerID="cri-o://118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0" gracePeriod=30
Sep 11 20:12:38.105441 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.105418    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d799cf5bb-ldkzg"
Sep 11 20:12:38.173864 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.173791    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdhdn\" (UniqueName: \"kubernetes.io/projected/0411eddc-497d-4daf-b89c-ca5d7e77c2c7-kube-api-access-pdhdn\") pod \"0411eddc-497d-4daf-b89c-ca5d7e77c2c7\" (UID: \"0411eddc-497d-4daf-b89c-ca5d7e77c2c7\") "
Sep 11 20:12:38.173864 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.173823    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0411eddc-497d-4daf-b89c-ca5d7e77c2c7-tls-cert\") pod \"0411eddc-497d-4daf-b89c-ca5d7e77c2c7\" (UID: \"0411eddc-497d-4daf-b89c-ca5d7e77c2c7\") "
Sep 11 20:12:38.175996 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.175943    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0411eddc-497d-4daf-b89c-ca5d7e77c2c7-kube-api-access-pdhdn" (OuterVolumeSpecName: "kube-api-access-pdhdn") pod "0411eddc-497d-4daf-b89c-ca5d7e77c2c7" (UID: "0411eddc-497d-4daf-b89c-ca5d7e77c2c7"). InnerVolumeSpecName "kube-api-access-pdhdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:12:38.184517 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.184490    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0411eddc-497d-4daf-b89c-ca5d7e77c2c7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0411eddc-497d-4daf-b89c-ca5d7e77c2c7" (UID: "0411eddc-497d-4daf-b89c-ca5d7e77c2c7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:12:38.274942 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.274911    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdhdn\" (UniqueName: \"kubernetes.io/projected/0411eddc-497d-4daf-b89c-ca5d7e77c2c7-kube-api-access-pdhdn\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:12:38.274942 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.274940    2585 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0411eddc-497d-4daf-b89c-ca5d7e77c2c7-tls-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:12:38.686528 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.686491    2585 generic.go:356] "Generic (PLEG): container finished" podID="0411eddc-497d-4daf-b89c-ca5d7e77c2c7" containerID="118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0" exitCode=0
Sep 11 20:12:38.686528 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.686530    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d799cf5bb-ldkzg"
Sep 11 20:12:38.686528 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.686533    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d799cf5bb-ldkzg" event={"ID":"0411eddc-497d-4daf-b89c-ca5d7e77c2c7","Type":"ContainerDied","Data":"118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0"}
Sep 11 20:12:38.686817 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.686572    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d799cf5bb-ldkzg" event={"ID":"0411eddc-497d-4daf-b89c-ca5d7e77c2c7","Type":"ContainerDied","Data":"883e97b1d40c7be7a79e3bcb40942e5bea19cbcd3485d88efc5a4acf5ed6de96"}
Sep 11 20:12:38.686817 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.686591    2585 scope.go:117] "RemoveContainer" containerID="118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0"
Sep 11 20:12:38.695592 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.695577    2585 scope.go:117] "RemoveContainer" containerID="118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0"
Sep 11 20:12:38.695835 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:12:38.695818    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0\": container with ID starting with 118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0 not found: ID does not exist" containerID="118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0"
Sep 11 20:12:38.695881 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.695844    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0"} err="failed to get container status \"118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0\": rpc error: code = NotFound desc = could not find container \"118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0\": container with ID starting with 118aa4793eff27a9f1ef0d6fbb6f7b9fe81a66733d43992b6a57a2860df04ca0 not found: ID does not exist"
Sep 11 20:12:38.708321 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.708297    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d799cf5bb-ldkzg"]
Sep 11 20:12:38.712363 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:38.712343    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d799cf5bb-ldkzg"]
Sep 11 20:12:39.349707 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:39.349677    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0411eddc-497d-4daf-b89c-ca5d7e77c2c7" path="/var/lib/kubelet/pods/0411eddc-497d-4daf-b89c-ca5d7e77c2c7/volumes"
Sep 11 20:12:54.732370 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.732335    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"]
Sep 11 20:12:54.732733 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.732655    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0411eddc-497d-4daf-b89c-ca5d7e77c2c7" containerName="authorino"
Sep 11 20:12:54.732733 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.732666    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0411eddc-497d-4daf-b89c-ca5d7e77c2c7" containerName="authorino"
Sep 11 20:12:54.732804 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.732741    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0411eddc-497d-4daf-b89c-ca5d7e77c2c7" containerName="authorino"
Sep 11 20:12:54.735804 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.735785    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.739374 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.739353    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-b3e1dd-openshift-default-dockercfg-5cfgc\""
Sep 11 20:12:54.750860 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.750840    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"]
Sep 11 20:12:54.808995 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.808946    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-podinfo\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.809146 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.809023    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istiod-ca-cert\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.809146 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.809054    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jfwg\" (UniqueName: \"kubernetes.io/projected/4e2e5a77-1709-41bc-a41d-d1ac31a77698-kube-api-access-8jfwg\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.809146 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.809094    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-workload-certs\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.809146 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.809131    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-data\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.809310 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.809163    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-credential-socket\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.809310 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.809240    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-workload-socket\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.809310 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.809268    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-token\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.809414 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.809355    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-envoy\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.819943 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.819922    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"]
Sep 11 20:12:54.823276 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.823260    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:54.826168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.826147    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-22fc84-openshift-default-dockercfg-9gmsk\""
Sep 11 20:12:54.839932 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.839910    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"]
Sep 11 20:12:54.909919 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.909866    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-podinfo\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.909919 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.909904    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-workload-socket\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:54.910160 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.909933    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istiod-ca-cert\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.910160 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.909996    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jfwg\" (UniqueName: \"kubernetes.io/projected/4e2e5a77-1709-41bc-a41d-d1ac31a77698-kube-api-access-8jfwg\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.910160 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910026    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-workload-certs\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.910160 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910040    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-token\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:54.910160 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910072    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-data\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.910160 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910097    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-podinfo\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:54.910464 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910350    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97sw8\" (UniqueName: \"kubernetes.io/projected/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-kube-api-access-97sw8\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:54.910464 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910407    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-credential-socket\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.910573 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910485    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-workload-certs\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.910573 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910518    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-workload-socket\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.910682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910571    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-token\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.910682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910604    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-workload-certs\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:54.910682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910648    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-envoy\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:54.910831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910689    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-credential-socket\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.910831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910687    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-data\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:54.910831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910728    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istiod-ca-cert\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:54.910831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910785    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-envoy\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.910831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910823    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-credential-socket\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:54.911136 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.910949    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-workload-socket\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.911196 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.911182    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-data\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.911361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.911319    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istiod-ca-cert\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.913282 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.913262    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-podinfo\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.913367 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.913302    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-envoy\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.926190 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.926157    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jfwg\" (UniqueName: \"kubernetes.io/projected/4e2e5a77-1709-41bc-a41d-d1ac31a77698-kube-api-access-8jfwg\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:54.926327 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:54.926309    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-token\") pod \"e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") " pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:55.011675 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.011585    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-token\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.011675 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.011625    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-podinfo\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.011675 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.011646    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97sw8\" (UniqueName: \"kubernetes.io/projected/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-kube-api-access-97sw8\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.011929 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.011701    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-workload-certs\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.011929 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.011716    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-envoy\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.011929 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.011745    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-data\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.011929 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.011760    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istiod-ca-cert\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.011929 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.011790    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-credential-socket\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.011929 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.011833    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-workload-socket\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.013062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.012224    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-workload-socket\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.013062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.012417    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-workload-certs\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.013062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.012492    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-data\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.013062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.012742    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-credential-socket\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.013062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.013009    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istiod-ca-cert\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.014607 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.014573    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-envoy\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.015465 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.015443    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-podinfo\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.021717 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.021665    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-token\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.023374 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.023343    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97sw8\" (UniqueName: \"kubernetes.io/projected/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-kube-api-access-97sw8\") pod \"e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") " pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.047151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.047128    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:55.135068 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.135036    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:55.336445 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.336411    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"]
Sep 11 20:12:55.346826 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:12:55.346801    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2e5a77_1709_41bc_a41d_d1ac31a77698.slice/crio-1a1745dca747dbf76e6b93d5702f29d756b2a44614d82370d435d2b7cb4f4125 WatchSource:0}: Error finding container 1a1745dca747dbf76e6b93d5702f29d756b2a44614d82370d435d2b7cb4f4125: Status 404 returned error can't find the container with id 1a1745dca747dbf76e6b93d5702f29d756b2a44614d82370d435d2b7cb4f4125
Sep 11 20:12:55.348881 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.348841    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:12:55.348988 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.348937    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:12:55.349048 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.349026    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:12:55.417758 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.417733    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"]
Sep 11 20:12:55.419410 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:12:55.419388    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0681da_eb0a_4b97_af37_58c08b0fc2d1.slice/crio-3fb2d7dae91a424859fc52e5ccdff8e65c520775b9dc79488ccc5e0a75de928a WatchSource:0}: Error finding container 3fb2d7dae91a424859fc52e5ccdff8e65c520775b9dc79488ccc5e0a75de928a: Status 404 returned error can't find the container with id 3fb2d7dae91a424859fc52e5ccdff8e65c520775b9dc79488ccc5e0a75de928a
Sep 11 20:12:55.421656 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.421626    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:12:55.421731 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.421699    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:12:55.421769 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.421736    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:12:55.763784 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.763685    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" event={"ID":"ef0681da-eb0a-4b97-af37-58c08b0fc2d1","Type":"ContainerStarted","Data":"c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7"}
Sep 11 20:12:55.763784 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.763750    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" event={"ID":"ef0681da-eb0a-4b97-af37-58c08b0fc2d1","Type":"ContainerStarted","Data":"3fb2d7dae91a424859fc52e5ccdff8e65c520775b9dc79488ccc5e0a75de928a"}
Sep 11 20:12:55.765597 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.765569    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" event={"ID":"4e2e5a77-1709-41bc-a41d-d1ac31a77698","Type":"ContainerStarted","Data":"0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6"}
Sep 11 20:12:55.765744 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.765620    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" event={"ID":"4e2e5a77-1709-41bc-a41d-d1ac31a77698","Type":"ContainerStarted","Data":"1a1745dca747dbf76e6b93d5702f29d756b2a44614d82370d435d2b7cb4f4125"}
Sep 11 20:12:55.842244 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.842185    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" podStartSLOduration=1.842164399 podStartE2EDuration="1.842164399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:12:55.84039654 +0000 UTC m=+761.001646843" watchObservedRunningTime="2026-09-11 20:12:55.842164399 +0000 UTC m=+761.003414641"
Sep 11 20:12:55.902373 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:55.902325    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" podStartSLOduration=1.902310848 podStartE2EDuration="1.902310848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:12:55.901839249 +0000 UTC m=+761.063089491" watchObservedRunningTime="2026-09-11 20:12:55.902310848 +0000 UTC m=+761.063561090"
Sep 11 20:12:56.048108 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:56.048019    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:56.049712 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:56.049683    2585 patch_prober.go:28] interesting pod/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 11 20:12:56.049874 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:56.049751    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 11 20:12:56.135361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:56.135237    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:56.140429 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:56.140403    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:56.771886 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:56.771847    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:56.772773 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:56.772752    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:12:57.052228 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:57.052159    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:57.776462 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:57.776427    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:12:57.777409 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:12:57.777385    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:13:03.428677 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.428643    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"]
Sep 11 20:13:03.432238 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.432218    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.435197 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.435174    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-46da77-openshift-default-dockercfg-5964w\""
Sep 11 20:13:03.450303 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.450278    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"]
Sep 11 20:13:03.487706 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.487671    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-credential-socket\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.487863 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.487712    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-token\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.487863 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.487797    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istiod-ca-cert\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.487863 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.487844    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-data\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.488011 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.487869    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-envoy\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.488011 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.487937    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-workload-socket\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.488011 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.487991    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hvqz\" (UniqueName: \"kubernetes.io/projected/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-kube-api-access-8hvqz\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.488125 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.488016    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-workload-certs\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.488125 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.488047    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-podinfo\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.588881 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.588847    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-podinfo\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.589096 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.588899    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-credential-socket\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.589096 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.588922    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-token\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.589096 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.588989    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istiod-ca-cert\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.589096 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.589016    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-data\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.589096 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.589049    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-envoy\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.589363 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.589107    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-workload-socket\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.589363 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.589130    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hvqz\" (UniqueName: \"kubernetes.io/projected/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-kube-api-access-8hvqz\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.589363 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.589160    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-workload-certs\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.589528 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.589505    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-credential-socket\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.589594 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.589546    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-data\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.589594 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.589583    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-workload-certs\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.589836 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.589813    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-workload-socket\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.590248 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.590227    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istiod-ca-cert\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.591244 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.591224    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-envoy\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.591521 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.591505    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-podinfo\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.597923 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.597898    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-token\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.598097 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.598078    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hvqz\" (UniqueName: \"kubernetes.io/projected/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-kube-api-access-8hvqz\") pod \"e2e-autores-46da77-openshift-default-5b49fcc868-cpv45\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") " pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.743312 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.743213    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:03.856156 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.856124    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"]
Sep 11 20:13:03.859980 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.859926    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:03.862797 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.862773    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8e5fddd7-openshift-default-dockercfg-pq44n\""
Sep 11 20:13:03.875595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.875575    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"]
Sep 11 20:13:03.992563 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.992524    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-workload-socket\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:03.992563 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.992562    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-credential-socket\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:03.992765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.992579    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-podinfo\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:03.992765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.992626    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istiod-ca-cert\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:03.992765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.992695    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-envoy\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:03.992765 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.992719    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-workload-certs\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:03.992893 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.992778    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-token\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:03.992893 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.992806    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-data\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:03.992893 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:03.992859    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r7r5\" (UniqueName: \"kubernetes.io/projected/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-kube-api-access-8r7r5\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.022556 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.022532    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"]
Sep 11 20:13:04.024633 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:13:04.024604    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f7d03b_d573_47e9_9dde_a80ddbd7f9b3.slice/crio-eb34433eaaaf32a6bbacd23e262ba0239e5d769be338f0155530dfb87e598ea5 WatchSource:0}: Error finding container eb34433eaaaf32a6bbacd23e262ba0239e5d769be338f0155530dfb87e598ea5: Status 404 returned error can't find the container with id eb34433eaaaf32a6bbacd23e262ba0239e5d769be338f0155530dfb87e598ea5
Sep 11 20:13:04.026991 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.026943    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:04.027089 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.027028    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:04.027089 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.027056    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:04.093476 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.093450    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-token\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.093606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.093480    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-data\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.093606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.093522    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r7r5\" (UniqueName: \"kubernetes.io/projected/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-kube-api-access-8r7r5\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.093606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.093562    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-workload-socket\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.093606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.093579    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-credential-socket\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.093606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.093597    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-podinfo\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.093853 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.093621    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istiod-ca-cert\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.093853 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.093680    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-envoy\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.093941 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.093881    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-data\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.094176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.094111    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-workload-certs\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.094176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.094164    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-workload-socket\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.094402 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.094383    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-workload-certs\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.094475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.094457    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-credential-socket\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.094521 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.094485    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istiod-ca-cert\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.096171 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.096153    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-envoy\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.096353 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.096321    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-podinfo\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.104056 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.104008    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r7r5\" (UniqueName: \"kubernetes.io/projected/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-kube-api-access-8r7r5\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.104306 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.104282    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-token\") pod \"e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") " pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.172348 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.172307    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:04.455264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.455181    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"]
Sep 11 20:13:04.457424 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:13:04.457400    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7676c7_ca2f_405b_9fd9_a51f805ff54d.slice/crio-03a02ef73d5aa20ba8429e77b8d5db45a635d57506aaf604b555a37320f15bda WatchSource:0}: Error finding container 03a02ef73d5aa20ba8429e77b8d5db45a635d57506aaf604b555a37320f15bda: Status 404 returned error can't find the container with id 03a02ef73d5aa20ba8429e77b8d5db45a635d57506aaf604b555a37320f15bda
Sep 11 20:13:04.459723 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.459687    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:04.459831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.459761    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:04.459831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.459807    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:04.809741 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.809647    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" event={"ID":"5c7676c7-ca2f-405b-9fd9-a51f805ff54d","Type":"ContainerStarted","Data":"9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f"}
Sep 11 20:13:04.809741 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.809706    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" event={"ID":"5c7676c7-ca2f-405b-9fd9-a51f805ff54d","Type":"ContainerStarted","Data":"03a02ef73d5aa20ba8429e77b8d5db45a635d57506aaf604b555a37320f15bda"}
Sep 11 20:13:04.811245 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.811214    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" event={"ID":"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3","Type":"ContainerStarted","Data":"9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade"}
Sep 11 20:13:04.811379 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.811266    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" event={"ID":"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3","Type":"ContainerStarted","Data":"eb34433eaaaf32a6bbacd23e262ba0239e5d769be338f0155530dfb87e598ea5"}
Sep 11 20:13:04.859073 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.859023    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" podStartSLOduration=1.8590088599999999 podStartE2EDuration="1.85900886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:13:04.857239852 +0000 UTC m=+770.018490106" watchObservedRunningTime="2026-09-11 20:13:04.85900886 +0000 UTC m=+770.020259102"
Sep 11 20:13:04.859223 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:04.859129    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" podStartSLOduration=1.859121735 podStartE2EDuration="1.859121735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:13:04.836702197 +0000 UTC m=+769.997952438" watchObservedRunningTime="2026-09-11 20:13:04.859121735 +0000 UTC m=+770.020371980"
Sep 11 20:13:05.172562 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:05.172532    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:05.177456 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:05.177431    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:05.743803 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:05.743763    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:05.748730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:05.748702    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:05.816396 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:05.816364    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:05.816575 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:05.816421    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:05.817321 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:05.817301    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:05.817386 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:05.817372    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:13.169606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.169570    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"]
Sep 11 20:13:13.179979 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.179288    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.183056 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.182726    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4f9558-openshift-default-dockercfg-jwf9p\""
Sep 11 20:13:13.187709 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.187690    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"]
Sep 11 20:13:13.306265 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.306190    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-envoy\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.306487 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.306467    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-token\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.306589 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.306578    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istiod-ca-cert\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.306722 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.306701    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-workload-certs\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.306775 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.306758    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-credential-socket\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.306820 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.306808    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-data\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.306858 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.306840    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-workload-socket\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.306973 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.306933    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-585t4\" (UniqueName: \"kubernetes.io/projected/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-kube-api-access-585t4\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.307020 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.306990    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-podinfo\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.408230 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.408197    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-credential-socket\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.408230 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.408244    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-data\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.408487 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.408270    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-workload-socket\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.408487 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.408302    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-585t4\" (UniqueName: \"kubernetes.io/projected/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-kube-api-access-585t4\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.408487 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.408329    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-podinfo\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.408487 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.408400    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-envoy\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.408487 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.408422    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-token\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.408487 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.408448    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istiod-ca-cert\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.408790 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.408493    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-workload-certs\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.408790 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.408681    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-data\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.408925 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.408899    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-credential-socket\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.409076 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.409054    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-workload-socket\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.409530 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.409505    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istiod-ca-cert\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.409787 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.409766    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-workload-certs\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.411067 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.411037    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-envoy\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.411173 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.411098    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-podinfo\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.418070 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.418047    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-token\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.418490 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.418469    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-585t4\" (UniqueName: \"kubernetes.io/projected/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-kube-api-access-585t4\") pod \"e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") " pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.497414 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.497381    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:13.815715 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:13:13.815669    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a89f095_92c7_4564_9cfb_43bd0c4f17d8.slice/crio-55281bbc76e14ee159efeb0328918228f7008b3340ced0084f9a23321078a5c1 WatchSource:0}: Error finding container 55281bbc76e14ee159efeb0328918228f7008b3340ced0084f9a23321078a5c1: Status 404 returned error can't find the container with id 55281bbc76e14ee159efeb0328918228f7008b3340ced0084f9a23321078a5c1
Sep 11 20:13:13.817443 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.817415    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"]
Sep 11 20:13:13.818704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.818666    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:13.818809 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.818744    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:13.818809 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.818789    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:13.877992 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:13.877938    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" event={"ID":"1a89f095-92c7-4564-9cfb-43bd0c4f17d8","Type":"ContainerStarted","Data":"55281bbc76e14ee159efeb0328918228f7008b3340ced0084f9a23321078a5c1"}
Sep 11 20:13:14.886380 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:14.886338    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" event={"ID":"1a89f095-92c7-4564-9cfb-43bd0c4f17d8","Type":"ContainerStarted","Data":"ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde"}
Sep 11 20:13:14.913410 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:14.913367    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" podStartSLOduration=1.913351936 podStartE2EDuration="1.913351936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:13:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:13:14.911532119 +0000 UTC m=+780.072782390" watchObservedRunningTime="2026-09-11 20:13:14.913351936 +0000 UTC m=+780.074602177"
Sep 11 20:13:15.497563 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:15.497527    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:15.504413 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:15.504378    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:15.892464 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:15.892428    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:15.893558 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:15.893534    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:16.898989 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:16.898943    2585 generic.go:356] "Generic (PLEG): container finished" podID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerID="0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6" exitCode=0
Sep 11 20:13:16.899462 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:16.899024    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" event={"ID":"4e2e5a77-1709-41bc-a41d-d1ac31a77698","Type":"ContainerDied","Data":"0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6"}
Sep 11 20:13:16.899589 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:16.899569    2585 scope.go:117] "RemoveContainer" containerID="0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6"
Sep 11 20:13:16.900628 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:16.900600    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:16.900711 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:16.900662    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:16.900711 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:16.900692    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:17.904973 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:17.904864    2585 generic.go:356] "Generic (PLEG): container finished" podID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerID="c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7" exitCode=0
Sep 11 20:13:17.905417 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:17.904945    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" event={"ID":"ef0681da-eb0a-4b97-af37-58c08b0fc2d1","Type":"ContainerDied","Data":"c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7"}
Sep 11 20:13:17.905477 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:17.905429    2585 scope.go:117] "RemoveContainer" containerID="c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7"
Sep 11 20:13:17.906646 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:17.906613    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:17.906751 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:17.906692    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:17.906751 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:17.906722    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:17.906994 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:17.906973    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" event={"ID":"4e2e5a77-1709-41bc-a41d-d1ac31a77698","Type":"ContainerStarted","Data":"de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9"}
Sep 11 20:13:18.057166 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:18.057080    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:13:18.057434 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:18.057409    2585 patch_prober.go:28] interesting pod/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 11 20:13:18.057571 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:18.057544    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 11 20:13:18.915682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:18.915630    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" event={"ID":"ef0681da-eb0a-4b97-af37-58c08b0fc2d1","Type":"ContainerStarted","Data":"ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b"}
Sep 11 20:13:19.048624 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:19.048580    2585 patch_prober.go:28] interesting pod/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 11 20:13:19.048819 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:19.048650    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 11 20:13:19.136034 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:19.136004    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:13:19.136190 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:19.136139    2585 patch_prober.go:28] interesting pod/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 11 20:13:19.136231 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:19.136187    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 11 20:13:20.048562 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:20.048524    2585 patch_prober.go:28] interesting pod/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 11 20:13:20.049157 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:20.049125    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 11 20:13:20.135873 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:20.135823    2585 patch_prober.go:28] interesting pod/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 11 20:13:20.136072 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:20.135891    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 11 20:13:21.048403 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.048366    2585 patch_prober.go:28] interesting pod/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 11 20:13:21.048705 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.048667    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 11 20:13:21.135858 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.135826    2585 patch_prober.go:28] interesting pod/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 11 20:13:21.136049 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.135879    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 11 20:13:21.420442 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.420388    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"]
Sep 11 20:13:21.427704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.427679    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:21.431980 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.431760    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vrkb7\""
Sep 11 20:13:21.434350 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.433361    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 20:13:21.434350 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.433577    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 20:13:21.434350 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.433775    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 20:13:21.434350 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.433971    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-4f9558-serving-cert\""
Sep 11 20:13:21.438303 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.438280    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"]
Sep 11 20:13:21.511648 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.511614    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:21.512035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.511994    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-metrics-certs\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:21.512265 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.512236    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/523159c5-afc1-4a65-a4cb-e3c30c2b364d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:21.512400 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.512385    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpbm6\" (UniqueName: \"kubernetes.io/projected/523159c5-afc1-4a65-a4cb-e3c30c2b364d-kube-api-access-mpbm6\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:21.613376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.613324    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-metrics-certs\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:21.613698 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.613659    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/523159c5-afc1-4a65-a4cb-e3c30c2b364d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:21.613858 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.613833    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpbm6\" (UniqueName: \"kubernetes.io/projected/523159c5-afc1-4a65-a4cb-e3c30c2b364d-kube-api-access-mpbm6\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:21.614206 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.614186    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:21.614563 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:13:21.614531    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-serving-cert: secret "maas-api-e2e-inf-b-4f9558-serving-cert" not found
Sep 11 20:13:21.614771 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:13:21.614759    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls podName:523159c5-afc1-4a65-a4cb-e3c30c2b364d nodeName:}" failed. No retries permitted until 2026-09-11 20:13:22.114718114 +0000 UTC m=+787.275968340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls") pod "maas-api-e2e-inf-b-4f9558-594749478b-jxhz9" (UID: "523159c5-afc1-4a65-a4cb-e3c30c2b364d") : secret "maas-api-e2e-inf-b-4f9558-serving-cert" not found
Sep 11 20:13:21.616721 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.616699    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/523159c5-afc1-4a65-a4cb-e3c30c2b364d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:21.619979 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.618462    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-metrics-certs\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:21.633632 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:21.633604    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpbm6\" (UniqueName: \"kubernetes.io/projected/523159c5-afc1-4a65-a4cb-e3c30c2b364d-kube-api-access-mpbm6\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:22.050425 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:22.050379    2585 patch_prober.go:28] interesting pod/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 11 20:13:22.050984 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:22.050457    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 11 20:13:22.120044 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:22.119371    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:22.120044 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:13:22.119590    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-serving-cert: secret "maas-api-e2e-inf-b-4f9558-serving-cert" not found
Sep 11 20:13:22.120044 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:13:22.119656    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls podName:523159c5-afc1-4a65-a4cb-e3c30c2b364d nodeName:}" failed. No retries permitted until 2026-09-11 20:13:23.119635559 +0000 UTC m=+788.280885783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls") pod "maas-api-e2e-inf-b-4f9558-594749478b-jxhz9" (UID: "523159c5-afc1-4a65-a4cb-e3c30c2b364d") : secret "maas-api-e2e-inf-b-4f9558-serving-cert" not found
Sep 11 20:13:22.139011 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:22.138543    2585 patch_prober.go:28] interesting pod/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 11 20:13:22.139011 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:22.138609    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 11 20:13:23.048211 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:23.048169    2585 patch_prober.go:28] interesting pod/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 11 20:13:23.048533 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:23.048495    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 11 20:13:23.141192 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:23.141154    2585 patch_prober.go:28] interesting pod/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 11 20:13:23.141819 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:23.141772    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 11 20:13:23.157493 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:13:23.157456    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-serving-cert: secret "maas-api-e2e-inf-b-4f9558-serving-cert" not found
Sep 11 20:13:23.157642 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:13:23.157532    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls podName:523159c5-afc1-4a65-a4cb-e3c30c2b364d nodeName:}" failed. No retries permitted until 2026-09-11 20:13:25.157511786 +0000 UTC m=+790.318762011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls") pod "maas-api-e2e-inf-b-4f9558-594749478b-jxhz9" (UID: "523159c5-afc1-4a65-a4cb-e3c30c2b364d") : secret "maas-api-e2e-inf-b-4f9558-serving-cert" not found
Sep 11 20:13:23.157642 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:23.157574    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:24.139446 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:24.139406    2585 patch_prober.go:28] interesting pod/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 11 20:13:24.139751 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:24.139722    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 11 20:13:24.259599 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:24.259555    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:13:24.261020 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:24.260993    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:13:24.266393 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:24.266370    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:13:25.135866 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:25.135827    2585 patch_prober.go:28] interesting pod/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 11 20:13:25.136090 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:25.136070    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 11 20:13:25.191734 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:25.191697    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:25.218786 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:25.218746    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls\") pod \"maas-api-e2e-inf-b-4f9558-594749478b-jxhz9\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:25.366982 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:25.365318    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:25.684454 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:25.684359    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"]
Sep 11 20:13:25.700187 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:25.699537    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 20:13:25.965164 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:25.965049    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9" event={"ID":"523159c5-afc1-4a65-a4cb-e3c30c2b364d","Type":"ContainerStarted","Data":"19005c5e8c41161da831f2f5db71042d16fbd567b10113f10320ea57843415bd"}
Sep 11 20:13:26.141867 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:26.141843    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:13:26.142398 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:26.142288    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:13:26.143112 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:26.143042    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:13:29.002227 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:29.002116    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9" event={"ID":"523159c5-afc1-4a65-a4cb-e3c30c2b364d","Type":"ContainerStarted","Data":"d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327"}
Sep 11 20:13:29.002653 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:29.002234    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:29.022704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:29.022651    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9" podStartSLOduration=5.016907031 podStartE2EDuration="8.022629529s" totalImagesPullingTime="3.005722498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:13:29.02070097 +0000 UTC m=+794.181951212" watchObservedRunningTime="2026-09-11 20:13:29.022629529 +0000 UTC m=+794.183879772"
Sep 11 20:13:31.013024 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:31.012993    2585 generic.go:356] "Generic (PLEG): container finished" podID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerID="9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f" exitCode=0
Sep 11 20:13:31.013459 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:31.013044    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" event={"ID":"5c7676c7-ca2f-405b-9fd9-a51f805ff54d","Type":"ContainerDied","Data":"9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f"}
Sep 11 20:13:31.013538 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:31.013476    2585 scope.go:117] "RemoveContainer" containerID="9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f"
Sep 11 20:13:31.014711 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:31.014684    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:31.014793 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:31.014756    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:31.014852 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:31.014794    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:31.014936 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:31.014916    2585 generic.go:356] "Generic (PLEG): container finished" podID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerID="9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade" exitCode=0
Sep 11 20:13:31.015027 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:31.014981    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" event={"ID":"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3","Type":"ContainerDied","Data":"9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade"}
Sep 11 20:13:31.015345 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:31.015328    2585 scope.go:117] "RemoveContainer" containerID="9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade"
Sep 11 20:13:31.016406 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:31.016382    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:31.016489 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:31.016440    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:31.016489 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:31.016476    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:32.021612 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:32.021578    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" event={"ID":"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3","Type":"ContainerStarted","Data":"a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f"}
Sep 11 20:13:32.023382 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:32.023357    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" event={"ID":"5c7676c7-ca2f-405b-9fd9-a51f805ff54d","Type":"ContainerStarted","Data":"0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859"}
Sep 11 20:13:32.172757 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:32.172706    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:32.174499 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:32.174467    2585 patch_prober.go:28] interesting pod/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 11 20:13:32.174751 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:32.174710    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 11 20:13:32.744360 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:32.744319    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:32.745710 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:32.745409    2585 patch_prober.go:28] interesting pod/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 11 20:13:32.745710 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:32.745478    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 11 20:13:33.173717 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:33.173676    2585 patch_prober.go:28] interesting pod/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 11 20:13:33.174234 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:33.173743    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 11 20:13:33.743656 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:33.743623    2585 patch_prober.go:28] interesting pod/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 11 20:13:33.743889 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:33.743864    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 11 20:13:34.177980 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:34.176331    2585 patch_prober.go:28] interesting pod/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 11 20:13:34.177980 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:34.176394    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 11 20:13:34.744594 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:34.744548    2585 patch_prober.go:28] interesting pod/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 11 20:13:34.744768 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:34.744619    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 11 20:13:35.012089 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:35.012003    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:13:35.177520 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:35.177443    2585 patch_prober.go:28] interesting pod/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 11 20:13:35.177785 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:35.177742    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 11 20:13:35.744369 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:35.744329    2585 patch_prober.go:28] interesting pod/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 11 20:13:35.744759 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:35.744394    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 11 20:13:35.816557 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:35.816526    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:35.816715 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:35.816608    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:36.173642 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:36.173600    2585 patch_prober.go:28] interesting pod/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 11 20:13:36.173906 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:36.173877    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 11 20:13:36.744297 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:36.744258    2585 patch_prober.go:28] interesting pod/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 11 20:13:36.744473 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:36.744338    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 11 20:13:37.175565 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:37.175508    2585 patch_prober.go:28] interesting pod/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 11 20:13:37.175918 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:37.175885    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 11 20:13:37.420579 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:37.420528    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"]
Sep 11 20:13:37.420937 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:37.420906    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy" containerID="cri-o://0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859" gracePeriod=30
Sep 11 20:13:37.759984 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:37.759878    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:37.767061 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:37.767039    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:13:42.788303 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.788278    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:42.852805 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.852769    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-workload-socket\") pod \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") "
Sep 11 20:13:42.853009 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.852843    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-credential-socket\") pod \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") "
Sep 11 20:13:42.853009 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.852863    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istiod-ca-cert\") pod \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") "
Sep 11 20:13:42.853009 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.852894    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-podinfo\") pod \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") "
Sep 11 20:13:42.853009 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.852917    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-workload-certs\") pod \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") "
Sep 11 20:13:42.853009 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.852950    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-envoy\") pod \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") "
Sep 11 20:13:42.853288 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.853016    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-data\") pod \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") "
Sep 11 20:13:42.853288 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.853067    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-token\") pod \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") "
Sep 11 20:13:42.853288 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.853101    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r7r5\" (UniqueName: \"kubernetes.io/projected/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-kube-api-access-8r7r5\") pod \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\" (UID: \"5c7676c7-ca2f-405b-9fd9-a51f805ff54d\") "
Sep 11 20:13:42.853288 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.853109    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c7676c7-ca2f-405b-9fd9-a51f805ff54d" (UID: "5c7676c7-ca2f-405b-9fd9-a51f805ff54d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:13:42.853288 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.853123    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c7676c7-ca2f-405b-9fd9-a51f805ff54d" (UID: "5c7676c7-ca2f-405b-9fd9-a51f805ff54d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:13:42.853288 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.853209    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c7676c7-ca2f-405b-9fd9-a51f805ff54d" (UID: "5c7676c7-ca2f-405b-9fd9-a51f805ff54d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:13:42.853288 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.853278    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c7676c7-ca2f-405b-9fd9-a51f805ff54d" (UID: "5c7676c7-ca2f-405b-9fd9-a51f805ff54d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:13:42.853636 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.853457    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:13:42.853636 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.853481    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:13:42.853636 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.853495    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:13:42.853636 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.853507    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:13:42.853842 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.853819    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c7676c7-ca2f-405b-9fd9-a51f805ff54d" (UID: "5c7676c7-ca2f-405b-9fd9-a51f805ff54d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:13:42.855776 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.855745    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c7676c7-ca2f-405b-9fd9-a51f805ff54d" (UID: "5c7676c7-ca2f-405b-9fd9-a51f805ff54d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:13:42.855924 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.855849    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-kube-api-access-8r7r5" (OuterVolumeSpecName: "kube-api-access-8r7r5") pod "5c7676c7-ca2f-405b-9fd9-a51f805ff54d" (UID: "5c7676c7-ca2f-405b-9fd9-a51f805ff54d"). InnerVolumeSpecName "kube-api-access-8r7r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:13:42.856189 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.856162    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c7676c7-ca2f-405b-9fd9-a51f805ff54d" (UID: "5c7676c7-ca2f-405b-9fd9-a51f805ff54d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:13:42.856567 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.856536    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c7676c7-ca2f-405b-9fd9-a51f805ff54d" (UID: "5c7676c7-ca2f-405b-9fd9-a51f805ff54d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:13:42.954555 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.954522    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:13:42.954555 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.954550    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:13:42.954555 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.954560    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:13:42.954555 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.954569    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:13:42.954871 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:42.954578    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r7r5\" (UniqueName: \"kubernetes.io/projected/5c7676c7-ca2f-405b-9fd9-a51f805ff54d-kube-api-access-8r7r5\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:13:43.103484 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.103408    2585 generic.go:356] "Generic (PLEG): container finished" podID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerID="0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859" exitCode=0
Sep 11 20:13:43.103484 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.103470    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"
Sep 11 20:13:43.103716 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.103491    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" event={"ID":"5c7676c7-ca2f-405b-9fd9-a51f805ff54d","Type":"ContainerDied","Data":"0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859"}
Sep 11 20:13:43.103716 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.103543    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b" event={"ID":"5c7676c7-ca2f-405b-9fd9-a51f805ff54d","Type":"ContainerDied","Data":"03a02ef73d5aa20ba8429e77b8d5db45a635d57506aaf604b555a37320f15bda"}
Sep 11 20:13:43.103716 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.103566    2585 scope.go:117] "RemoveContainer" containerID="0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859"
Sep 11 20:13:43.112879 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.112864    2585 scope.go:117] "RemoveContainer" containerID="9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f"
Sep 11 20:13:43.121750 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.121730    2585 scope.go:117] "RemoveContainer" containerID="0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859"
Sep 11 20:13:43.122041 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:13:43.122020    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859\": container with ID starting with 0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859 not found: ID does not exist" containerID="0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859"
Sep 11 20:13:43.122126 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.122047    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859"} err="failed to get container status \"0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859\": rpc error: code = NotFound desc = could not find container \"0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859\": container with ID starting with 0e5abc2220ddc18b45f663a955b043bb0748d47525a0b0aee7485a6bd4131859 not found: ID does not exist"
Sep 11 20:13:43.122126 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.122063    2585 scope.go:117] "RemoveContainer" containerID="9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f"
Sep 11 20:13:43.122356 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:13:43.122318    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f\": container with ID starting with 9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f not found: ID does not exist" containerID="9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f"
Sep 11 20:13:43.122413 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.122364    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f"} err="failed to get container status \"9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f\": rpc error: code = NotFound desc = could not find container \"9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f\": container with ID starting with 9fd81b3fdc134a5320b0b1b0f196d98fab8fd804087a756491df42ae9002d44f not found: ID does not exist"
Sep 11 20:13:43.137655 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.137631    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"]
Sep 11 20:13:43.148100 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.148077    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8e5fddd7-openshift-default-659dc8bc46-mtx2b"]
Sep 11 20:13:43.203376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.203140    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"]
Sep 11 20:13:43.203667 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.203646    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy"
Sep 11 20:13:43.203667 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.203666    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy"
Sep 11 20:13:43.203852 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.203757    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy"
Sep 11 20:13:43.203852 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.203767    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy"
Sep 11 20:13:43.208553 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.208532    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.211273 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.211255    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c83b7433-serving-cert\""
Sep 11 20:13:43.222220 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.222191    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"]
Sep 11 20:13:43.257198 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.257170    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a16a442-7bff-40d8-8a1a-c1085502fb1c-openshift-service-ca\") pod \"maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.257332 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.257235    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a16a442-7bff-40d8-8a1a-c1085502fb1c-maas-api-tls\") pod \"maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.257332 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.257309    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a16a442-7bff-40d8-8a1a-c1085502fb1c-metrics-certs\") pod \"maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.257452 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.257345    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh5xx\" (UniqueName: \"kubernetes.io/projected/5a16a442-7bff-40d8-8a1a-c1085502fb1c-kube-api-access-vh5xx\") pod \"maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.351564 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.351531    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" path="/var/lib/kubelet/pods/5c7676c7-ca2f-405b-9fd9-a51f805ff54d/volumes"
Sep 11 20:13:43.358369 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.358309    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh5xx\" (UniqueName: \"kubernetes.io/projected/5a16a442-7bff-40d8-8a1a-c1085502fb1c-kube-api-access-vh5xx\") pod \"maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.358505 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.358423    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a16a442-7bff-40d8-8a1a-c1085502fb1c-openshift-service-ca\") pod \"maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.358621 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.358535    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a16a442-7bff-40d8-8a1a-c1085502fb1c-maas-api-tls\") pod \"maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.358621 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.358578    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a16a442-7bff-40d8-8a1a-c1085502fb1c-metrics-certs\") pod \"maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.359321 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.359295    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a16a442-7bff-40d8-8a1a-c1085502fb1c-openshift-service-ca\") pod \"maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.361146 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.361120    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a16a442-7bff-40d8-8a1a-c1085502fb1c-metrics-certs\") pod \"maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.361437 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.361215    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a16a442-7bff-40d8-8a1a-c1085502fb1c-maas-api-tls\") pod \"maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.367495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.367474    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh5xx\" (UniqueName: \"kubernetes.io/projected/5a16a442-7bff-40d8-8a1a-c1085502fb1c-kube-api-access-vh5xx\") pod \"maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.523733 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.523703    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:43.802089 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:43.800758    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"]
Sep 11 20:13:43.806837 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:13:43.806804    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a16a442_7bff_40d8_8a1a_c1085502fb1c.slice/crio-85614da27894436fd8d48d69ae2bc29034dbf18a8c4babf711b3bcb1c3e054ed WatchSource:0}: Error finding container 85614da27894436fd8d48d69ae2bc29034dbf18a8c4babf711b3bcb1c3e054ed: Status 404 returned error can't find the container with id 85614da27894436fd8d48d69ae2bc29034dbf18a8c4babf711b3bcb1c3e054ed
Sep 11 20:13:44.111375 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:44.111341    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6" event={"ID":"5a16a442-7bff-40d8-8a1a-c1085502fb1c","Type":"ContainerStarted","Data":"85614da27894436fd8d48d69ae2bc29034dbf18a8c4babf711b3bcb1c3e054ed"}
Sep 11 20:13:45.121346 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:45.121310    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6" event={"ID":"5a16a442-7bff-40d8-8a1a-c1085502fb1c","Type":"ContainerStarted","Data":"a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832"}
Sep 11 20:13:45.121818 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:45.121418    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:45.122933 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:45.122911    2585 generic.go:356] "Generic (PLEG): container finished" podID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerID="ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde" exitCode=0
Sep 11 20:13:45.123071 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:45.122981    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" event={"ID":"1a89f095-92c7-4564-9cfb-43bd0c4f17d8","Type":"ContainerDied","Data":"ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde"}
Sep 11 20:13:45.123324 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:45.123310    2585 scope.go:117] "RemoveContainer" containerID="ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde"
Sep 11 20:13:45.124470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:45.124445    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:45.124538 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:45.124519    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:45.124574 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:45.124555    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:13:45.139628 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:45.139588    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6" podStartSLOduration=1.723298209 podStartE2EDuration="2.139575264s" totalImagesPullingTime="416.277055ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:13:45.138088953 +0000 UTC m=+810.299339196" watchObservedRunningTime="2026-09-11 20:13:45.139575264 +0000 UTC m=+810.300825507"
Sep 11 20:13:45.892350 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:45.892316    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:46.130504 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:46.130463    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" event={"ID":"1a89f095-92c7-4564-9cfb-43bd0c4f17d8","Type":"ContainerStarted","Data":"16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad"}
Sep 11 20:13:46.497851 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:46.497817    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:46.499221 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:46.499191    2585 patch_prober.go:28] interesting pod/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 11 20:13:46.499351 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:46.499239    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 11 20:13:47.498111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:47.498070    2585 patch_prober.go:28] interesting pod/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 11 20:13:47.498527 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:47.498129    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 11 20:13:48.498258 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:48.498221    2585 patch_prober.go:28] interesting pod/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 11 20:13:48.498658 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:48.498280    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 11 20:13:49.498056 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:49.498025    2585 patch_prober.go:28] interesting pod/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 11 20:13:49.498263 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:49.498078    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 11 20:13:50.498254 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:50.498222    2585 patch_prober.go:28] interesting pod/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 11 20:13:50.498638 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:50.498273    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 11 20:13:51.135920 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:51.135889    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:13:51.502466 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:51.502381    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:51.502844 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:51.502667    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:13:51.503405 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:13:51.503385    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:14:06.575978 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.575910    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"]
Sep 11 20:14:06.576457 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.576425    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy"
Sep 11 20:14:06.576457 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.576442    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7676c7-ca2f-405b-9fd9-a51f805ff54d" containerName="istio-proxy"
Sep 11 20:14:06.579812 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.579798    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.583557 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.583527    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-22fc84\"/\"openshift-service-ca.crt\""
Sep 11 20:14:06.583705 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.583594    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-22fc84\"/\"default-dockercfg-gk4zr\""
Sep 11 20:14:06.583705 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.583621    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-22fc84\"/\"simulator-w4-22fc84-kserve-self-signed-certs\""
Sep 11 20:14:06.583705 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.583676    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-22fc84\"/\"kube-root-ca.crt\""
Sep 11 20:14:06.589996 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.589969    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"]
Sep 11 20:14:06.668309 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.668279    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-tmp-dir\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.668468 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.668317    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq7t2\" (UniqueName: \"kubernetes.io/projected/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-kube-api-access-zq7t2\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.668468 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.668392    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-home\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.668468 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.668412    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-dshm\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.668617 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.668482    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-tls-certs\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.668617 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.668521    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-model-cache\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.769816 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.769779    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-dshm\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.769816 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.769822    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-tls-certs\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.770051 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.769912    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-model-cache\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.770051 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.769983    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-tmp-dir\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.770051 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.770007    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq7t2\" (UniqueName: \"kubernetes.io/projected/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-kube-api-access-zq7t2\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.770247 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.770061    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-home\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.770309 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.770298    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-model-cache\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.770387 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.770355    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-tmp-dir\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.770492 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.770470    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-home\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.772217 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.772189    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-dshm\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.772412 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.772396    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-tls-certs\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.778221 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.778195    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq7t2\" (UniqueName: \"kubernetes.io/projected/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-kube-api-access-zq7t2\") pod \"simulator-w4-22fc84-kserve-5fc47558d4-4rmrh\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") " pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:06.890684 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:06.890653    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:07.162796 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:07.162768    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"]
Sep 11 20:14:07.165264 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:14:07.165236    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a58691d_c9e2_4d3b_9d15_d5da543fd29e.slice/crio-3726500d3d32a92190b2598f6716d7e2c54e0f0a8cd860d654fd63c24bb921d1 WatchSource:0}: Error finding container 3726500d3d32a92190b2598f6716d7e2c54e0f0a8cd860d654fd63c24bb921d1: Status 404 returned error can't find the container with id 3726500d3d32a92190b2598f6716d7e2c54e0f0a8cd860d654fd63c24bb921d1
Sep 11 20:14:07.239340 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:07.239296    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh" event={"ID":"4a58691d-c9e2-4d3b-9d15-d5da543fd29e","Type":"ContainerStarted","Data":"a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0"}
Sep 11 20:14:07.239480 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:07.239356    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh" event={"ID":"4a58691d-c9e2-4d3b-9d15-d5da543fd29e","Type":"ContainerStarted","Data":"3726500d3d32a92190b2598f6716d7e2c54e0f0a8cd860d654fd63c24bb921d1"}
Sep 11 20:14:07.260043 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:07.259992    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh" podStartSLOduration=1.2599724700000001 podStartE2EDuration="1.25997247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:14:07.259150249 +0000 UTC m=+832.420400518" watchObservedRunningTime="2026-09-11 20:14:07.25997247 +0000 UTC m=+832.421222712"
Sep 11 20:14:12.197037 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.195146    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"]
Sep 11 20:14:12.197037 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.195462    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6" podUID="5a16a442-7bff-40d8-8a1a-c1085502fb1c" containerName="maas-api" containerID="cri-o://a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832" gracePeriod=30
Sep 11 20:14:12.459107 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.459043    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:14:12.627914 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.627882    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a16a442-7bff-40d8-8a1a-c1085502fb1c-metrics-certs\") pod \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") "
Sep 11 20:14:12.628102 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.627947    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh5xx\" (UniqueName: \"kubernetes.io/projected/5a16a442-7bff-40d8-8a1a-c1085502fb1c-kube-api-access-vh5xx\") pod \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") "
Sep 11 20:14:12.628102 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.628008    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a16a442-7bff-40d8-8a1a-c1085502fb1c-openshift-service-ca\") pod \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") "
Sep 11 20:14:12.628102 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.628073    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a16a442-7bff-40d8-8a1a-c1085502fb1c-maas-api-tls\") pod \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\" (UID: \"5a16a442-7bff-40d8-8a1a-c1085502fb1c\") "
Sep 11 20:14:12.628461 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.628432    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a16a442-7bff-40d8-8a1a-c1085502fb1c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5a16a442-7bff-40d8-8a1a-c1085502fb1c" (UID: "5a16a442-7bff-40d8-8a1a-c1085502fb1c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:14:12.630030 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.630007    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a16a442-7bff-40d8-8a1a-c1085502fb1c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5a16a442-7bff-40d8-8a1a-c1085502fb1c" (UID: "5a16a442-7bff-40d8-8a1a-c1085502fb1c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:14:12.630116 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.630080    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a16a442-7bff-40d8-8a1a-c1085502fb1c-kube-api-access-vh5xx" (OuterVolumeSpecName: "kube-api-access-vh5xx") pod "5a16a442-7bff-40d8-8a1a-c1085502fb1c" (UID: "5a16a442-7bff-40d8-8a1a-c1085502fb1c"). InnerVolumeSpecName "kube-api-access-vh5xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:14:12.630161 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.630109    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a16a442-7bff-40d8-8a1a-c1085502fb1c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5a16a442-7bff-40d8-8a1a-c1085502fb1c" (UID: "5a16a442-7bff-40d8-8a1a-c1085502fb1c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:14:12.729157 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.729072    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a16a442-7bff-40d8-8a1a-c1085502fb1c-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:12.729157 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.729099    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a16a442-7bff-40d8-8a1a-c1085502fb1c-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:12.729157 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.729109    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh5xx\" (UniqueName: \"kubernetes.io/projected/5a16a442-7bff-40d8-8a1a-c1085502fb1c-kube-api-access-vh5xx\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:12.729157 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:12.729119    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a16a442-7bff-40d8-8a1a-c1085502fb1c-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:13.272432 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.272392    2585 generic.go:356] "Generic (PLEG): container finished" podID="5a16a442-7bff-40d8-8a1a-c1085502fb1c" containerID="a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832" exitCode=0
Sep 11 20:14:13.272922 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.272457    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"
Sep 11 20:14:13.272922 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.272473    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6" event={"ID":"5a16a442-7bff-40d8-8a1a-c1085502fb1c","Type":"ContainerDied","Data":"a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832"}
Sep 11 20:14:13.272922 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.272557    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6" event={"ID":"5a16a442-7bff-40d8-8a1a-c1085502fb1c","Type":"ContainerDied","Data":"85614da27894436fd8d48d69ae2bc29034dbf18a8c4babf711b3bcb1c3e054ed"}
Sep 11 20:14:13.272922 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.272594    2585 scope.go:117] "RemoveContainer" containerID="a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832"
Sep 11 20:14:13.275090 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.275065    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"]
Sep 11 20:14:13.275626 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.275604    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a16a442-7bff-40d8-8a1a-c1085502fb1c" containerName="maas-api"
Sep 11 20:14:13.275626 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.275627    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a16a442-7bff-40d8-8a1a-c1085502fb1c" containerName="maas-api"
Sep 11 20:14:13.275812 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.275761    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a16a442-7bff-40d8-8a1a-c1085502fb1c" containerName="maas-api"
Sep 11 20:14:13.279277 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.279261    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.282125 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.282107    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-16cd58ce-openshift-default-dockercfg-wfgsw\""
Sep 11 20:14:13.282859 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.282844    2585 scope.go:117] "RemoveContainer" containerID="a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832"
Sep 11 20:14:13.283257 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:14:13.283201    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832\": container with ID starting with a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832 not found: ID does not exist" containerID="a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832"
Sep 11 20:14:13.283257 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.283234    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832"} err="failed to get container status \"a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832\": rpc error: code = NotFound desc = could not find container \"a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832\": container with ID starting with a034a815d4f88bda27ecdd4bb6b025f1aac0017cdd20c550a6e61c7a6192b832 not found: ID does not exist"
Sep 11 20:14:13.291052 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.291031    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"]
Sep 11 20:14:13.323347 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.323322    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"]
Sep 11 20:14:13.333457 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.333430    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c83b7433-76646d4fdf-s5dz6"]
Sep 11 20:14:13.349380 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.349353    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a16a442-7bff-40d8-8a1a-c1085502fb1c" path="/var/lib/kubelet/pods/5a16a442-7bff-40d8-8a1a-c1085502fb1c/volumes"
Sep 11 20:14:13.436386 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.436356    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-workload-certs\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.436386 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.436394    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-token\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.436611 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.436436    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6n2k\" (UniqueName: \"kubernetes.io/projected/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-kube-api-access-v6n2k\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.436663 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.436638    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-credential-socket\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.436770 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.436751    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-workload-socket\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.436838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.436816    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istiod-ca-cert\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.436900 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.436850    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-envoy\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.437020 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.437000    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-data\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.437020 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.437016    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-podinfo\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.538309 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.538225    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-workload-socket\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.538309 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.538264    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istiod-ca-cert\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.538309 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.538285    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-envoy\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.538583 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.538328    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-data\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.538583 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.538344    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-podinfo\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.538583 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.538393    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-workload-certs\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.538583 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.538428    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-token\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.538583 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.538479    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6n2k\" (UniqueName: \"kubernetes.io/projected/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-kube-api-access-v6n2k\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.538583 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.538548    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-credential-socket\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.538880 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.538792    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-data\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.538880 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.538826    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-workload-certs\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.539004 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.538886    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-credential-socket\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.539065 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.539041    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-workload-socket\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.539065 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.539048    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istiod-ca-cert\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.541211 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.541185    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-envoy\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.541550 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.541520    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-podinfo\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.547838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.547816    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-token\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.547928 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.547838    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6n2k\" (UniqueName: \"kubernetes.io/projected/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-kube-api-access-v6n2k\") pod \"e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") " pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.591657 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.591633    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:13.870849 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.870824    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"]
Sep 11 20:14:13.872546 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:14:13.872521    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960a4cb3_d077_4bcf_9305_85cb8ebd0c85.slice/crio-5f264e0261d71771ff5113ce233e2c35aeb4faa1ca7a433c802ea22feb156cc0 WatchSource:0}: Error finding container 5f264e0261d71771ff5113ce233e2c35aeb4faa1ca7a433c802ea22feb156cc0: Status 404 returned error can't find the container with id 5f264e0261d71771ff5113ce233e2c35aeb4faa1ca7a433c802ea22feb156cc0
Sep 11 20:14:13.875005 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.874948    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:14:13.875070 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.875055    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:14:13.875111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:13.875099    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:14:14.280421 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:14.280342    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" event={"ID":"960a4cb3-d077-4bcf-9305-85cb8ebd0c85","Type":"ContainerStarted","Data":"886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349"}
Sep 11 20:14:14.280421 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:14.280388    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" event={"ID":"960a4cb3-d077-4bcf-9305-85cb8ebd0c85","Type":"ContainerStarted","Data":"5f264e0261d71771ff5113ce233e2c35aeb4faa1ca7a433c802ea22feb156cc0"}
Sep 11 20:14:14.301728 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:14.301684    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" podStartSLOduration=1.301669905 podStartE2EDuration="1.301669905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:14:14.300350264 +0000 UTC m=+839.461600506" watchObservedRunningTime="2026-09-11 20:14:14.301669905 +0000 UTC m=+839.462920146"
Sep 11 20:14:14.592002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:14.591976    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:14.597164 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:14.597139    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:15.285567 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:15.285540    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:15.286660 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:15.286638    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:16.890803 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:16.890770    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:16.891185 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:16.890818    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:16.903161 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:16.903137    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:17.306837 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:17.306743    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:14:18.420240 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.420203    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"]
Sep 11 20:14:18.425063 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.425041    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.427440 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.427414    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-16cd58ce-serving-cert\""
Sep 11 20:14:18.436508 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.436480    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"]
Sep 11 20:14:18.584553 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.584519    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/283f9f49-8c34-4a2b-8a79-cd849af91200-maas-api-tls\") pod \"maas-api-e2e-ait-16cd58ce-69598fc576-wppr5\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.584766 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.584636    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/283f9f49-8c34-4a2b-8a79-cd849af91200-openshift-service-ca\") pod \"maas-api-e2e-ait-16cd58ce-69598fc576-wppr5\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.584766 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.584691    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zvr9\" (UniqueName: \"kubernetes.io/projected/283f9f49-8c34-4a2b-8a79-cd849af91200-kube-api-access-5zvr9\") pod \"maas-api-e2e-ait-16cd58ce-69598fc576-wppr5\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.584884 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.584777    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/283f9f49-8c34-4a2b-8a79-cd849af91200-metrics-certs\") pod \"maas-api-e2e-ait-16cd58ce-69598fc576-wppr5\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.685880 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.685799    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/283f9f49-8c34-4a2b-8a79-cd849af91200-metrics-certs\") pod \"maas-api-e2e-ait-16cd58ce-69598fc576-wppr5\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.685880 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.685844    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/283f9f49-8c34-4a2b-8a79-cd849af91200-maas-api-tls\") pod \"maas-api-e2e-ait-16cd58ce-69598fc576-wppr5\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.686122 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.685933    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/283f9f49-8c34-4a2b-8a79-cd849af91200-openshift-service-ca\") pod \"maas-api-e2e-ait-16cd58ce-69598fc576-wppr5\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.686122 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.686005    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zvr9\" (UniqueName: \"kubernetes.io/projected/283f9f49-8c34-4a2b-8a79-cd849af91200-kube-api-access-5zvr9\") pod \"maas-api-e2e-ait-16cd58ce-69598fc576-wppr5\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.686653 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.686628    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/283f9f49-8c34-4a2b-8a79-cd849af91200-openshift-service-ca\") pod \"maas-api-e2e-ait-16cd58ce-69598fc576-wppr5\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.688538 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.688517    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/283f9f49-8c34-4a2b-8a79-cd849af91200-maas-api-tls\") pod \"maas-api-e2e-ait-16cd58ce-69598fc576-wppr5\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.688647 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.688630    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/283f9f49-8c34-4a2b-8a79-cd849af91200-metrics-certs\") pod \"maas-api-e2e-ait-16cd58ce-69598fc576-wppr5\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.694516 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.694492    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zvr9\" (UniqueName: \"kubernetes.io/projected/283f9f49-8c34-4a2b-8a79-cd849af91200-kube-api-access-5zvr9\") pod \"maas-api-e2e-ait-16cd58ce-69598fc576-wppr5\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:18.737628 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:18.737607    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:19.017821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:19.017793    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"]
Sep 11 20:14:19.019871 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:14:19.019843    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod283f9f49_8c34_4a2b_8a79_cd849af91200.slice/crio-2be8171579513e4913501f7834010fe934f0ce28e3a683de678c9af0e59a6023 WatchSource:0}: Error finding container 2be8171579513e4913501f7834010fe934f0ce28e3a683de678c9af0e59a6023: Status 404 returned error can't find the container with id 2be8171579513e4913501f7834010fe934f0ce28e3a683de678c9af0e59a6023
Sep 11 20:14:19.307593 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:19.307512    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5" event={"ID":"283f9f49-8c34-4a2b-8a79-cd849af91200","Type":"ContainerStarted","Data":"2be8171579513e4913501f7834010fe934f0ce28e3a683de678c9af0e59a6023"}
Sep 11 20:14:20.314492 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:20.314453    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5" event={"ID":"283f9f49-8c34-4a2b-8a79-cd849af91200","Type":"ContainerStarted","Data":"d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a"}
Sep 11 20:14:20.314987 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:20.314592    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:20.334058 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:20.334014    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5" podStartSLOduration=1.898494173 podStartE2EDuration="2.334001718s" totalImagesPullingTime="435.507545ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:14:20.331845684 +0000 UTC m=+845.493095928" watchObservedRunningTime="2026-09-11 20:14:20.334001718 +0000 UTC m=+845.495251959"
Sep 11 20:14:26.324878 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:26.324845    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:35.399580 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:35.399548    2585 generic.go:356] "Generic (PLEG): container finished" podID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerID="886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349" exitCode=0
Sep 11 20:14:35.400020 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:35.399629    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" event={"ID":"960a4cb3-d077-4bcf-9305-85cb8ebd0c85","Type":"ContainerDied","Data":"886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349"}
Sep 11 20:14:35.400070 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:35.400033    2585 scope.go:117] "RemoveContainer" containerID="886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349"
Sep 11 20:14:35.401172 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:35.401143    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:14:35.401293 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:35.401225    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:14:35.401293 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:35.401271    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:14:36.406852 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:36.406820    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" event={"ID":"960a4cb3-d077-4bcf-9305-85cb8ebd0c85","Type":"ContainerStarted","Data":"dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f"}
Sep 11 20:14:36.592631 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:36.592594    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:36.592830 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:36.592808    2585 patch_prober.go:28] interesting pod/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 11 20:14:36.592880 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:36.592857    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 11 20:14:37.592991 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:37.592932    2585 patch_prober.go:28] interesting pod/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 11 20:14:37.593370 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:37.593023    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 11 20:14:38.592549 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:38.592512    2585 patch_prober.go:28] interesting pod/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 11 20:14:38.592732 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:38.592576    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 11 20:14:39.592751 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:39.592713    2585 patch_prober.go:28] interesting pod/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 11 20:14:39.593173 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:39.592775    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 11 20:14:40.592297 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:40.592261    2585 patch_prober.go:28] interesting pod/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 11 20:14:40.592472 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:40.592323    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 11 20:14:41.669597 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:41.669561    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:41.670080 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:41.669985    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:41.670808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:41.670788    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:47.695347 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:47.695316    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"]
Sep 11 20:14:47.695861 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:47.695497    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5" podUID="283f9f49-8c34-4a2b-8a79-cd849af91200" containerName="maas-api" containerID="cri-o://d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a" gracePeriod=30
Sep 11 20:14:47.937826 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:47.937803    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:48.076608 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.076515    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zvr9\" (UniqueName: \"kubernetes.io/projected/283f9f49-8c34-4a2b-8a79-cd849af91200-kube-api-access-5zvr9\") pod \"283f9f49-8c34-4a2b-8a79-cd849af91200\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") "
Sep 11 20:14:48.076608 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.076577    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/283f9f49-8c34-4a2b-8a79-cd849af91200-maas-api-tls\") pod \"283f9f49-8c34-4a2b-8a79-cd849af91200\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") "
Sep 11 20:14:48.076838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.076629    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/283f9f49-8c34-4a2b-8a79-cd849af91200-metrics-certs\") pod \"283f9f49-8c34-4a2b-8a79-cd849af91200\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") "
Sep 11 20:14:48.076838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.076657    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/283f9f49-8c34-4a2b-8a79-cd849af91200-openshift-service-ca\") pod \"283f9f49-8c34-4a2b-8a79-cd849af91200\" (UID: \"283f9f49-8c34-4a2b-8a79-cd849af91200\") "
Sep 11 20:14:48.077475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.077444    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/283f9f49-8c34-4a2b-8a79-cd849af91200-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "283f9f49-8c34-4a2b-8a79-cd849af91200" (UID: "283f9f49-8c34-4a2b-8a79-cd849af91200"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:14:48.080723 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.080665    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/283f9f49-8c34-4a2b-8a79-cd849af91200-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "283f9f49-8c34-4a2b-8a79-cd849af91200" (UID: "283f9f49-8c34-4a2b-8a79-cd849af91200"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:14:48.081555 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.081515    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/283f9f49-8c34-4a2b-8a79-cd849af91200-kube-api-access-5zvr9" (OuterVolumeSpecName: "kube-api-access-5zvr9") pod "283f9f49-8c34-4a2b-8a79-cd849af91200" (UID: "283f9f49-8c34-4a2b-8a79-cd849af91200"). InnerVolumeSpecName "kube-api-access-5zvr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:14:48.095028 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.094983    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/283f9f49-8c34-4a2b-8a79-cd849af91200-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "283f9f49-8c34-4a2b-8a79-cd849af91200" (UID: "283f9f49-8c34-4a2b-8a79-cd849af91200"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:14:48.178492 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.178459    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/283f9f49-8c34-4a2b-8a79-cd849af91200-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:48.178492 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.178486    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/283f9f49-8c34-4a2b-8a79-cd849af91200-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:48.178492 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.178495    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/283f9f49-8c34-4a2b-8a79-cd849af91200-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:48.178715 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.178506    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zvr9\" (UniqueName: \"kubernetes.io/projected/283f9f49-8c34-4a2b-8a79-cd849af91200-kube-api-access-5zvr9\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:48.467701 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.467665    2585 generic.go:356] "Generic (PLEG): container finished" podID="283f9f49-8c34-4a2b-8a79-cd849af91200" containerID="d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a" exitCode=0
Sep 11 20:14:48.467701 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.467706    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5" event={"ID":"283f9f49-8c34-4a2b-8a79-cd849af91200","Type":"ContainerDied","Data":"d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a"}
Sep 11 20:14:48.467993 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.467745    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5" event={"ID":"283f9f49-8c34-4a2b-8a79-cd849af91200","Type":"ContainerDied","Data":"2be8171579513e4913501f7834010fe934f0ce28e3a683de678c9af0e59a6023"}
Sep 11 20:14:48.467993 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.467743    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"
Sep 11 20:14:48.467993 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.467761    2585 scope.go:117] "RemoveContainer" containerID="d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a"
Sep 11 20:14:48.481820 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.481799    2585 scope.go:117] "RemoveContainer" containerID="d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a"
Sep 11 20:14:48.482190 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:14:48.482167    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a\": container with ID starting with d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a not found: ID does not exist" containerID="d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a"
Sep 11 20:14:48.482422 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.482201    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a"} err="failed to get container status \"d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a\": rpc error: code = NotFound desc = could not find container \"d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a\": container with ID starting with d8e28a7220d40274d91a09d7afcf22b35c70fa86a4c20a2a1aa514e0b2efc36a not found: ID does not exist"
Sep 11 20:14:48.495240 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.495214    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"]
Sep 11 20:14:48.499011 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.498984    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16cd58ce-69598fc576-wppr5"]
Sep 11 20:14:48.999843 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:48.999805    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"]
Sep 11 20:14:49.000206 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:49.000034    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerName="istio-proxy" containerID="cri-o://dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f" gracePeriod=30
Sep 11 20:14:49.349730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:49.349695    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="283f9f49-8c34-4a2b-8a79-cd849af91200" path="/var/lib/kubelet/pods/283f9f49-8c34-4a2b-8a79-cd849af91200/volumes"
Sep 11 20:14:53.413056 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.413022    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"]
Sep 11 20:14:53.413656 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.413637    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="283f9f49-8c34-4a2b-8a79-cd849af91200" containerName="maas-api"
Sep 11 20:14:53.413749 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.413657    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="283f9f49-8c34-4a2b-8a79-cd849af91200" containerName="maas-api"
Sep 11 20:14:53.413816 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.413748    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="283f9f49-8c34-4a2b-8a79-cd849af91200" containerName="maas-api"
Sep 11 20:14:53.422295 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.422256    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:53.429351 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.429323    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f5b4f720-serving-cert\""
Sep 11 20:14:53.434145 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.434119    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"]
Sep 11 20:14:53.529399 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.529361    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-metrics-certs\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:53.529766 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.529737    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-maas-api-tls\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:53.529979 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.529943    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3bba6d3-a736-4b37-ace6-9d89894adf44-openshift-service-ca\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:53.530146 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.530129    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdhzj\" (UniqueName: \"kubernetes.io/projected/f3bba6d3-a736-4b37-ace6-9d89894adf44-kube-api-access-mdhzj\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:53.631335 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.631305    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdhzj\" (UniqueName: \"kubernetes.io/projected/f3bba6d3-a736-4b37-ace6-9d89894adf44-kube-api-access-mdhzj\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:53.631503 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.631455    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-metrics-certs\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:53.631550 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.631517    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-maas-api-tls\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:53.631601 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.631568    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3bba6d3-a736-4b37-ace6-9d89894adf44-openshift-service-ca\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:53.631681 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:14:53.631659    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-serving-cert: secret "maas-api-e2e-derive-f5b4f720-serving-cert" not found
Sep 11 20:14:53.631746 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:14:53.631736    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-maas-api-tls podName:f3bba6d3-a736-4b37-ace6-9d89894adf44 nodeName:}" failed. No retries permitted until 2026-09-11 20:14:54.131717209 +0000 UTC m=+879.292967442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-maas-api-tls") pod "maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn" (UID: "f3bba6d3-a736-4b37-ace6-9d89894adf44") : secret "maas-api-e2e-derive-f5b4f720-serving-cert" not found
Sep 11 20:14:53.632264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.632243    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3bba6d3-a736-4b37-ace6-9d89894adf44-openshift-service-ca\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:53.633746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.633723    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-metrics-certs\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:53.640054 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:53.640032    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdhzj\" (UniqueName: \"kubernetes.io/projected/f3bba6d3-a736-4b37-ace6-9d89894adf44-kube-api-access-mdhzj\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:54.136438 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.136401    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-maas-api-tls\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:54.138861 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.138830    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-maas-api-tls\") pod \"maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:54.276905 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.276431    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:54.337641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.337614    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istiod-ca-cert\") pod \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") "
Sep 11 20:14:54.337789 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.337739    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6n2k\" (UniqueName: \"kubernetes.io/projected/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-kube-api-access-v6n2k\") pod \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") "
Sep 11 20:14:54.337789 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.337772    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-podinfo\") pod \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") "
Sep 11 20:14:54.337903 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.337802    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-token\") pod \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") "
Sep 11 20:14:54.337903 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.337831    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-data\") pod \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") "
Sep 11 20:14:54.337903 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.337870    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-workload-socket\") pod \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") "
Sep 11 20:14:54.338057 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.337925    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-credential-socket\") pod \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") "
Sep 11 20:14:54.338057 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.337995    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-workload-certs\") pod \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") "
Sep 11 20:14:54.338057 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.338035    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-envoy\") pod \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\" (UID: \"960a4cb3-d077-4bcf-9305-85cb8ebd0c85\") "
Sep 11 20:14:54.338057 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.338037    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "960a4cb3-d077-4bcf-9305-85cb8ebd0c85" (UID: "960a4cb3-d077-4bcf-9305-85cb8ebd0c85"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:14:54.338217 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.338127    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-data" (OuterVolumeSpecName: "istio-data") pod "960a4cb3-d077-4bcf-9305-85cb8ebd0c85" (UID: "960a4cb3-d077-4bcf-9305-85cb8ebd0c85"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:14:54.338331 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.338299    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "960a4cb3-d077-4bcf-9305-85cb8ebd0c85" (UID: "960a4cb3-d077-4bcf-9305-85cb8ebd0c85"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:14:54.338331 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.338316    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "960a4cb3-d077-4bcf-9305-85cb8ebd0c85" (UID: "960a4cb3-d077-4bcf-9305-85cb8ebd0c85"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:14:54.338475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.338361    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "960a4cb3-d077-4bcf-9305-85cb8ebd0c85" (UID: "960a4cb3-d077-4bcf-9305-85cb8ebd0c85"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:14:54.338475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.338415    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:54.338475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.338444    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:54.338475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.338460    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:54.338475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.338477    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:54.340105 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.340082    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-kube-api-access-v6n2k" (OuterVolumeSpecName: "kube-api-access-v6n2k") pod "960a4cb3-d077-4bcf-9305-85cb8ebd0c85" (UID: "960a4cb3-d077-4bcf-9305-85cb8ebd0c85"). InnerVolumeSpecName "kube-api-access-v6n2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:14:54.340212 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.340141    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "960a4cb3-d077-4bcf-9305-85cb8ebd0c85" (UID: "960a4cb3-d077-4bcf-9305-85cb8ebd0c85"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:14:54.340358 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.340342    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "960a4cb3-d077-4bcf-9305-85cb8ebd0c85" (UID: "960a4cb3-d077-4bcf-9305-85cb8ebd0c85"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:14:54.340416 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.340356    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-token" (OuterVolumeSpecName: "istio-token") pod "960a4cb3-d077-4bcf-9305-85cb8ebd0c85" (UID: "960a4cb3-d077-4bcf-9305-85cb8ebd0c85"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:14:54.342542 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.342522    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:54.439746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.439709    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6n2k\" (UniqueName: \"kubernetes.io/projected/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-kube-api-access-v6n2k\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:54.439746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.439746    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:54.439746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.439760    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:54.440358 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.439775    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:54.440358 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.439788    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960a4cb3-d077-4bcf-9305-85cb8ebd0c85-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:14:54.498595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.498563    2585 generic.go:356] "Generic (PLEG): container finished" podID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerID="dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f" exitCode=0
Sep 11 20:14:54.498768 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.498613    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"
Sep 11 20:14:54.498768 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.498646    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" event={"ID":"960a4cb3-d077-4bcf-9305-85cb8ebd0c85","Type":"ContainerDied","Data":"dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f"}
Sep 11 20:14:54.498768 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.498696    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9" event={"ID":"960a4cb3-d077-4bcf-9305-85cb8ebd0c85","Type":"ContainerDied","Data":"5f264e0261d71771ff5113ce233e2c35aeb4faa1ca7a433c802ea22feb156cc0"}
Sep 11 20:14:54.498768 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.498718    2585 scope.go:117] "RemoveContainer" containerID="dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f"
Sep 11 20:14:54.508732 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.508716    2585 scope.go:117] "RemoveContainer" containerID="886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349"
Sep 11 20:14:54.516703 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.516686    2585 scope.go:117] "RemoveContainer" containerID="dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f"
Sep 11 20:14:54.516968 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:14:54.516938    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f\": container with ID starting with dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f not found: ID does not exist" containerID="dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f"
Sep 11 20:14:54.517052 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.516983    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f"} err="failed to get container status \"dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f\": rpc error: code = NotFound desc = could not find container \"dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f\": container with ID starting with dba8a61f6f42fd6668a456cd67de9e5d3f259ed74983f100ecccf8f9b416d55f not found: ID does not exist"
Sep 11 20:14:54.517052 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.517007    2585 scope.go:117] "RemoveContainer" containerID="886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349"
Sep 11 20:14:54.517263 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:14:54.517245    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349\": container with ID starting with 886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349 not found: ID does not exist" containerID="886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349"
Sep 11 20:14:54.517301 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.517268    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349"} err="failed to get container status \"886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349\": rpc error: code = NotFound desc = could not find container \"886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349\": container with ID starting with 886fbb7d3362616eee60d02dada8ec280e9b89c346eff717f2c8b53580fbe349 not found: ID does not exist"
Sep 11 20:14:54.524109 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.524090    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"]
Sep 11 20:14:54.528735 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.528681    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-16cd58ce-openshift-default-74fcdd866-j9qs9"]
Sep 11 20:14:54.617043 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:54.617018    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"]
Sep 11 20:14:54.618675 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:14:54.618649    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3bba6d3_a736_4b37_ace6_9d89894adf44.slice/crio-cf8a8695ed40c6d7214bf1a452ee40ec9c6130ba30eed7d452515a4f0d3bbd63 WatchSource:0}: Error finding container cf8a8695ed40c6d7214bf1a452ee40ec9c6130ba30eed7d452515a4f0d3bbd63: Status 404 returned error can't find the container with id cf8a8695ed40c6d7214bf1a452ee40ec9c6130ba30eed7d452515a4f0d3bbd63
Sep 11 20:14:55.349838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:55.349810    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" path="/var/lib/kubelet/pods/960a4cb3-d077-4bcf-9305-85cb8ebd0c85/volumes"
Sep 11 20:14:55.504878 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:55.504835    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn" event={"ID":"f3bba6d3-a736-4b37-ace6-9d89894adf44","Type":"ContainerStarted","Data":"526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b"}
Sep 11 20:14:55.505292 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:55.504894    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn" event={"ID":"f3bba6d3-a736-4b37-ace6-9d89894adf44","Type":"ContainerStarted","Data":"cf8a8695ed40c6d7214bf1a452ee40ec9c6130ba30eed7d452515a4f0d3bbd63"}
Sep 11 20:14:55.505292 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:55.504922    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:14:55.524304 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:14:55.524255    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn" podStartSLOduration=2.218936732 podStartE2EDuration="2.524240881s" totalImagesPullingTime="305.304149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:14:55.522696192 +0000 UTC m=+880.683946435" watchObservedRunningTime="2026-09-11 20:14:55.524240881 +0000 UTC m=+880.685491126"
Sep 11 20:15:00.152169 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.152131    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq"]
Sep 11 20:15:00.152563 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.152528    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerName="istio-proxy"
Sep 11 20:15:00.152563 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.152540    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerName="istio-proxy"
Sep 11 20:15:00.152563 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.152556    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerName="istio-proxy"
Sep 11 20:15:00.152563 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.152562    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerName="istio-proxy"
Sep 11 20:15:00.152694 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.152622    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerName="istio-proxy"
Sep 11 20:15:00.155784 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.155768    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd"]
Sep 11 20:15:00.155901 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.155881    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq"
Sep 11 20:15:00.156269 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.156243    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="960a4cb3-d077-4bcf-9305-85cb8ebd0c85" containerName="istio-proxy"
Sep 11 20:15:00.158451 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.158424    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7dbs5\""
Sep 11 20:15:00.159074 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.159058    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd"
Sep 11 20:15:00.168853 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.168754    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq"
Sep 11 20:15:00.168853 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.168778    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd"]
Sep 11 20:15:00.171747 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.171037    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq"]
Sep 11 20:15:00.177576 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.177558    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd"
Sep 11 20:15:00.183169 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.183146    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819295-92zzf"]
Sep 11 20:15:00.191230 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.191208    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819295-92zzf"
Sep 11 20:15:00.198742 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.198716    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819295-92zzf"]
Sep 11 20:15:00.226344 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.226259    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819295-92zzf"
Sep 11 20:15:00.457271 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.457205    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq"]
Sep 11 20:15:00.459444 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:15:00.459418    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45251f5b_9028_421e_af30_746c584ce5c5.slice/crio-9b5795e2ebe8a3431934fa4b7bbc87fea253fc6eda77992f60deba6e521e998b WatchSource:0}: Error finding container 9b5795e2ebe8a3431934fa4b7bbc87fea253fc6eda77992f60deba6e521e998b: Status 404 returned error can't find the container with id 9b5795e2ebe8a3431934fa4b7bbc87fea253fc6eda77992f60deba6e521e998b
Sep 11 20:15:00.467805 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.467785    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd"]
Sep 11 20:15:00.469696 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:15:00.469672    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157e8aa9_3604_484e_9ca6_3eda8aa2abd7.slice/crio-c00b556d3db9de4cb48f9a8ea236e47333b679d31bf321e692c1a12f3c636de1 WatchSource:0}: Error finding container c00b556d3db9de4cb48f9a8ea236e47333b679d31bf321e692c1a12f3c636de1: Status 404 returned error can't find the container with id c00b556d3db9de4cb48f9a8ea236e47333b679d31bf321e692c1a12f3c636de1
Sep 11 20:15:00.520757 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.520734    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819295-92zzf"]
Sep 11 20:15:00.522475 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:15:00.522451    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec51b7d_0f97_4418_a6ef_99292ad76f57.slice/crio-934cc65b628ff59e52d69ec8f1341e8182d4c69ff7616058bc77e4b012a81845 WatchSource:0}: Error finding container 934cc65b628ff59e52d69ec8f1341e8182d4c69ff7616058bc77e4b012a81845: Status 404 returned error can't find the container with id 934cc65b628ff59e52d69ec8f1341e8182d4c69ff7616058bc77e4b012a81845
Sep 11 20:15:00.533084 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.533057    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819295-92zzf" event={"ID":"bec51b7d-0f97-4418-a6ef-99292ad76f57","Type":"ContainerStarted","Data":"934cc65b628ff59e52d69ec8f1341e8182d4c69ff7616058bc77e4b012a81845"}
Sep 11 20:15:00.534326 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.534302    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq" event={"ID":"45251f5b-9028-421e-af30-746c584ce5c5","Type":"ContainerStarted","Data":"9b5795e2ebe8a3431934fa4b7bbc87fea253fc6eda77992f60deba6e521e998b"}
Sep 11 20:15:00.535489 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:00.535470    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd" event={"ID":"157e8aa9-3604-484e-9ca6-3eda8aa2abd7","Type":"ContainerStarted","Data":"c00b556d3db9de4cb48f9a8ea236e47333b679d31bf321e692c1a12f3c636de1"}
Sep 11 20:15:01.519185 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:01.519156    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:15:03.563784 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:03.563687    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd" event={"ID":"157e8aa9-3604-484e-9ca6-3eda8aa2abd7","Type":"ContainerStarted","Data":"957bbde8c7849c0bfd5bcc1283ccbc4331659853c6bacd632f28a231cbe7c448"}
Sep 11 20:15:03.565456 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:03.565431    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819295-92zzf" event={"ID":"bec51b7d-0f97-4418-a6ef-99292ad76f57","Type":"ContainerStarted","Data":"16da85329ed1ec8a0c3bb1bd46519cc080b885873557f66391f591ff6b140cb0"}
Sep 11 20:15:03.567198 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:03.567167    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq" event={"ID":"45251f5b-9028-421e-af30-746c584ce5c5","Type":"ContainerStarted","Data":"b9982ed5c467436cec6d5e9c56ac966de899964161536620cc5bd14c0cdf66ce"}
Sep 11 20:15:03.579505 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:03.579439    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd" podStartSLOduration=1.052583336 podStartE2EDuration="3.579424693s" totalImagesPullingTime="2.526841357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:15:03.577858986 +0000 UTC m=+888.739109238" watchObservedRunningTime="2026-09-11 20:15:03.579424693 +0000 UTC m=+888.740674935"
Sep 11 20:15:03.592866 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:03.592826    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq" podStartSLOduration=1.060163708 podStartE2EDuration="3.592813179s" totalImagesPullingTime="2.532649471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:15:03.591054313 +0000 UTC m=+888.752304556" watchObservedRunningTime="2026-09-11 20:15:03.592813179 +0000 UTC m=+888.754063465"
Sep 11 20:15:03.606442 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:03.606397    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819295-92zzf" podStartSLOduration=1.150398375 podStartE2EDuration="3.606383482s" totalImagesPullingTime="2.455985107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:15:03.605538804 +0000 UTC m=+888.766789061" watchObservedRunningTime="2026-09-11 20:15:03.606383482 +0000 UTC m=+888.767633724"
Sep 11 20:15:04.573932 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:04.573892    2585 generic.go:356] "Generic (PLEG): container finished" podID="157e8aa9-3604-484e-9ca6-3eda8aa2abd7" containerID="957bbde8c7849c0bfd5bcc1283ccbc4331659853c6bacd632f28a231cbe7c448" exitCode=0
Sep 11 20:15:04.574384 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:04.573998    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd" event={"ID":"157e8aa9-3604-484e-9ca6-3eda8aa2abd7","Type":"ContainerDied","Data":"957bbde8c7849c0bfd5bcc1283ccbc4331659853c6bacd632f28a231cbe7c448"}
Sep 11 20:15:04.575542 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:04.575522    2585 generic.go:356] "Generic (PLEG): container finished" podID="bec51b7d-0f97-4418-a6ef-99292ad76f57" containerID="16da85329ed1ec8a0c3bb1bd46519cc080b885873557f66391f591ff6b140cb0" exitCode=0
Sep 11 20:15:04.575598 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:04.575590    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819295-92zzf" event={"ID":"bec51b7d-0f97-4418-a6ef-99292ad76f57","Type":"ContainerDied","Data":"16da85329ed1ec8a0c3bb1bd46519cc080b885873557f66391f591ff6b140cb0"}
Sep 11 20:15:04.577014 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:04.576993    2585 generic.go:356] "Generic (PLEG): container finished" podID="45251f5b-9028-421e-af30-746c584ce5c5" containerID="b9982ed5c467436cec6d5e9c56ac966de899964161536620cc5bd14c0cdf66ce" exitCode=0
Sep 11 20:15:04.577108 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:04.577025    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq" event={"ID":"45251f5b-9028-421e-af30-746c584ce5c5","Type":"ContainerDied","Data":"b9982ed5c467436cec6d5e9c56ac966de899964161536620cc5bd14c0cdf66ce"}
Sep 11 20:15:05.744418 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:05.744394    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd"
Sep 11 20:15:05.748276 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:05.748243    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq"
Sep 11 20:15:05.789308 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:05.789282    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819295-92zzf"
Sep 11 20:15:06.588617 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:06.588589    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd"
Sep 11 20:15:06.588617 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:06.588603    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd" event={"ID":"157e8aa9-3604-484e-9ca6-3eda8aa2abd7","Type":"ContainerDied","Data":"c00b556d3db9de4cb48f9a8ea236e47333b679d31bf321e692c1a12f3c636de1"}
Sep 11 20:15:06.588879 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:06.588651    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c00b556d3db9de4cb48f9a8ea236e47333b679d31bf321e692c1a12f3c636de1"
Sep 11 20:15:06.589989 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:06.589947    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819295-92zzf" event={"ID":"bec51b7d-0f97-4418-a6ef-99292ad76f57","Type":"ContainerDied","Data":"934cc65b628ff59e52d69ec8f1341e8182d4c69ff7616058bc77e4b012a81845"}
Sep 11 20:15:06.590108 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:06.590020    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="934cc65b628ff59e52d69ec8f1341e8182d4c69ff7616058bc77e4b012a81845"
Sep 11 20:15:06.590108 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:06.589976    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819295-92zzf"
Sep 11 20:15:06.591359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:06.591323    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq" event={"ID":"45251f5b-9028-421e-af30-746c584ce5c5","Type":"ContainerDied","Data":"9b5795e2ebe8a3431934fa4b7bbc87fea253fc6eda77992f60deba6e521e998b"}
Sep 11 20:15:06.591359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:06.591346    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq"
Sep 11 20:15:06.591507 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:06.591371    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b5795e2ebe8a3431934fa4b7bbc87fea253fc6eda77992f60deba6e521e998b"
Sep 11 20:15:15.326632 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:15.326563    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:15:15.327070 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:15.326754    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:15:26.265359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.265314    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"]
Sep 11 20:15:26.265936 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.265554    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn" podUID="f3bba6d3-a736-4b37-ace6-9d89894adf44" containerName="maas-api" containerID="cri-o://526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b" gracePeriod=30
Sep 11 20:15:26.296105 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.296075    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq"]
Sep 11 20:15:26.298610 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.298587    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5b4f720-29819295-vq6sq"]
Sep 11 20:15:26.513046 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.513021    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:15:26.631176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.631150    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3bba6d3-a736-4b37-ace6-9d89894adf44-openshift-service-ca\") pod \"f3bba6d3-a736-4b37-ace6-9d89894adf44\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") "
Sep 11 20:15:26.631347 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.631235    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-metrics-certs\") pod \"f3bba6d3-a736-4b37-ace6-9d89894adf44\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") "
Sep 11 20:15:26.631347 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.631331    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdhzj\" (UniqueName: \"kubernetes.io/projected/f3bba6d3-a736-4b37-ace6-9d89894adf44-kube-api-access-mdhzj\") pod \"f3bba6d3-a736-4b37-ace6-9d89894adf44\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") "
Sep 11 20:15:26.631504 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.631357    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-maas-api-tls\") pod \"f3bba6d3-a736-4b37-ace6-9d89894adf44\" (UID: \"f3bba6d3-a736-4b37-ace6-9d89894adf44\") "
Sep 11 20:15:26.631550 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.631500    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3bba6d3-a736-4b37-ace6-9d89894adf44-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3bba6d3-a736-4b37-ace6-9d89894adf44" (UID: "f3bba6d3-a736-4b37-ace6-9d89894adf44"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:15:26.631691 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.631675    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3bba6d3-a736-4b37-ace6-9d89894adf44-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:15:26.633391 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.633365    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f3bba6d3-a736-4b37-ace6-9d89894adf44" (UID: "f3bba6d3-a736-4b37-ace6-9d89894adf44"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:15:26.633509 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.633491    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3bba6d3-a736-4b37-ace6-9d89894adf44" (UID: "f3bba6d3-a736-4b37-ace6-9d89894adf44"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:15:26.633571 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.633532    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3bba6d3-a736-4b37-ace6-9d89894adf44-kube-api-access-mdhzj" (OuterVolumeSpecName: "kube-api-access-mdhzj") pod "f3bba6d3-a736-4b37-ace6-9d89894adf44" (UID: "f3bba6d3-a736-4b37-ace6-9d89894adf44"). InnerVolumeSpecName "kube-api-access-mdhzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:15:26.695715 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.695683    2585 generic.go:356] "Generic (PLEG): container finished" podID="f3bba6d3-a736-4b37-ace6-9d89894adf44" containerID="526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b" exitCode=0
Sep 11 20:15:26.695903 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.695734    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"
Sep 11 20:15:26.695903 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.695778    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn" event={"ID":"f3bba6d3-a736-4b37-ace6-9d89894adf44","Type":"ContainerDied","Data":"526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b"}
Sep 11 20:15:26.695903 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.695833    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn" event={"ID":"f3bba6d3-a736-4b37-ace6-9d89894adf44","Type":"ContainerDied","Data":"cf8a8695ed40c6d7214bf1a452ee40ec9c6130ba30eed7d452515a4f0d3bbd63"}
Sep 11 20:15:26.695903 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.695858    2585 scope.go:117] "RemoveContainer" containerID="526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b"
Sep 11 20:15:26.705152 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.705133    2585 scope.go:117] "RemoveContainer" containerID="526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b"
Sep 11 20:15:26.705419 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:15:26.705400    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b\": container with ID starting with 526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b not found: ID does not exist" containerID="526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b"
Sep 11 20:15:26.705480 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.705432    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b"} err="failed to get container status \"526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b\": rpc error: code = NotFound desc = could not find container \"526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b\": container with ID starting with 526b01e7ac73626501f8b695cc1240cbc2c58d6042c8efe83bb06fdb8263049b not found: ID does not exist"
Sep 11 20:15:26.722214 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.722189    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"]
Sep 11 20:15:26.727358 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.727324    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f5b4f720-5797c78d84-lmwkn"]
Sep 11 20:15:26.732872 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.732854    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:15:26.732929 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.732874    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdhzj\" (UniqueName: \"kubernetes.io/projected/f3bba6d3-a736-4b37-ace6-9d89894adf44-kube-api-access-mdhzj\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:15:26.732929 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:26.732884    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3bba6d3-a736-4b37-ace6-9d89894adf44-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:15:27.349742 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:27.349713    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45251f5b-9028-421e-af30-746c584ce5c5" path="/var/lib/kubelet/pods/45251f5b-9028-421e-af30-746c584ce5c5/volumes"
Sep 11 20:15:27.350160 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:15:27.350144    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3bba6d3-a736-4b37-ace6-9d89894adf44" path="/var/lib/kubelet/pods/f3bba6d3-a736-4b37-ace6-9d89894adf44/volumes"
Sep 11 20:16:12.975632 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:12.975591    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"]
Sep 11 20:16:12.976303 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:12.975926    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerName="istio-proxy" containerID="cri-o://a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f" gracePeriod=30
Sep 11 20:16:13.673496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.673457    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"]
Sep 11 20:16:13.674029 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.674013    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45251f5b-9028-421e-af30-746c584ce5c5" containerName="cleanup"
Sep 11 20:16:13.674094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.674032    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="45251f5b-9028-421e-af30-746c584ce5c5" containerName="cleanup"
Sep 11 20:16:13.674094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.674060    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="157e8aa9-3604-484e-9ca6-3eda8aa2abd7" containerName="cleanup"
Sep 11 20:16:13.674094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.674069    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="157e8aa9-3604-484e-9ca6-3eda8aa2abd7" containerName="cleanup"
Sep 11 20:16:13.674094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.674083    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec51b7d-0f97-4418-a6ef-99292ad76f57" containerName="cleanup"
Sep 11 20:16:13.674226 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.674094    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec51b7d-0f97-4418-a6ef-99292ad76f57" containerName="cleanup"
Sep 11 20:16:13.674226 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.674113    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3bba6d3-a736-4b37-ace6-9d89894adf44" containerName="maas-api"
Sep 11 20:16:13.674226 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.674121    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3bba6d3-a736-4b37-ace6-9d89894adf44" containerName="maas-api"
Sep 11 20:16:13.674226 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.674213    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="45251f5b-9028-421e-af30-746c584ce5c5" containerName="cleanup"
Sep 11 20:16:13.674226 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.674225    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3bba6d3-a736-4b37-ace6-9d89894adf44" containerName="maas-api"
Sep 11 20:16:13.674376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.674235    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="bec51b7d-0f97-4418-a6ef-99292ad76f57" containerName="cleanup"
Sep 11 20:16:13.674376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.674247    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="157e8aa9-3604-484e-9ca6-3eda8aa2abd7" containerName="cleanup"
Sep 11 20:16:13.677725 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.677707    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.680445 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.680421    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-3c2adb-openshift-default-dockercfg-fhzwh\""
Sep 11 20:16:13.692319 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.692294    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"]
Sep 11 20:16:13.766192 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.766158    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-workload-certs\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.766387 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.766257    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-token\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.766387 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.766320    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-credential-socket\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.766387 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.766343    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvpq6\" (UniqueName: \"kubernetes.io/projected/66a959ce-f8b1-4348-824d-7c70a9b3ba05-kube-api-access-qvpq6\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.766387 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.766361    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-envoy\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.766597 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.766390    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istiod-ca-cert\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.766597 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.766469    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-workload-socket\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.766597 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.766502    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-podinfo\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.766731 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.766593    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-data\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.867669 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.867629    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-data\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.867875 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.867706    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-workload-certs\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.867875 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.867782    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-token\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.867875 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.867843    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-credential-socket\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.867875 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.867870    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvpq6\" (UniqueName: \"kubernetes.io/projected/66a959ce-f8b1-4348-824d-7c70a9b3ba05-kube-api-access-qvpq6\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.868161 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.867898    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-envoy\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.868161 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.867932    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istiod-ca-cert\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.868161 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.867993    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-workload-socket\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.868161 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.868019    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-podinfo\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.868392 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.868184    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-workload-certs\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.868836 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.868814    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-data\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.869032 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.868948    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-credential-socket\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.869237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.869193    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-workload-socket\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.869990 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.869949    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istiod-ca-cert\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.871786 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.871726    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-envoy\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.871786 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.871780    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-podinfo\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.877713 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.877670    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvpq6\" (UniqueName: \"kubernetes.io/projected/66a959ce-f8b1-4348-824d-7c70a9b3ba05-kube-api-access-qvpq6\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.879023 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.878998    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-token\") pod \"e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") " pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:13.989902 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:13.989819    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:14.269253 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:14.269032    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"]
Sep 11 20:16:14.271470 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:16:14.271442    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a959ce_f8b1_4348_824d_7c70a9b3ba05.slice/crio-f475f1cfbb497fa4e87f5fd828574aad00de7f1fbd9314fc2279b4cb8f219051 WatchSource:0}: Error finding container f475f1cfbb497fa4e87f5fd828574aad00de7f1fbd9314fc2279b4cb8f219051: Status 404 returned error can't find the container with id f475f1cfbb497fa4e87f5fd828574aad00de7f1fbd9314fc2279b4cb8f219051
Sep 11 20:16:14.273775 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:14.273746    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:16:14.273838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:14.273813    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:16:14.273879 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:14.273838    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:16:14.938797 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:14.938762    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" event={"ID":"66a959ce-f8b1-4348-824d-7c70a9b3ba05","Type":"ContainerStarted","Data":"764236da3b254ee0aa4d9b5f89e6823d3b99533b67399fc04b26c78686435814"}
Sep 11 20:16:14.939002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:14.938826    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" event={"ID":"66a959ce-f8b1-4348-824d-7c70a9b3ba05","Type":"ContainerStarted","Data":"f475f1cfbb497fa4e87f5fd828574aad00de7f1fbd9314fc2279b4cb8f219051"}
Sep 11 20:16:14.963153 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:14.963102    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" podStartSLOduration=1.963083468 podStartE2EDuration="1.963083468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:16:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:16:14.96106927 +0000 UTC m=+960.122319506" watchObservedRunningTime="2026-09-11 20:16:14.963083468 +0000 UTC m=+960.124333710"
Sep 11 20:16:14.990631 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:14.990603    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:15.996114 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:15.996087    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:16.949587 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:16.949554    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:16.950543 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:16.950523    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:18.235924 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.235902    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:16:18.310496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310412    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-token\") pod \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") "
Sep 11 20:16:18.310496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310466    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-data\") pod \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") "
Sep 11 20:16:18.310496 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310486    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istiod-ca-cert\") pod \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") "
Sep 11 20:16:18.310777 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310504    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-envoy\") pod \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") "
Sep 11 20:16:18.310777 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310628    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-workload-socket\") pod \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") "
Sep 11 20:16:18.310777 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310674    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-credential-socket\") pod \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") "
Sep 11 20:16:18.310777 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310709    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-podinfo\") pod \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") "
Sep 11 20:16:18.310777 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310729    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-data" (OuterVolumeSpecName: "istio-data") pod "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" (UID: "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:16:18.311083 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310781    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hvqz\" (UniqueName: \"kubernetes.io/projected/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-kube-api-access-8hvqz\") pod \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") "
Sep 11 20:16:18.311083 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310824    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-workload-certs\") pod \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\" (UID: \"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3\") "
Sep 11 20:16:18.311083 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310860    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" (UID: "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:16:18.311083 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310971    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" (UID: "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:16:18.311083 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.310975    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" (UID: "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:16:18.311409 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.311198    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" (UID: "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:16:18.311409 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.311321    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:16:18.311409 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.311342    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:16:18.311409 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.311355    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:16:18.311409 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.311369    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:16:18.311409 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.311382    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:16:18.312751 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.312720    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" (UID: "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:16:18.312845 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.312792    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" (UID: "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:16:18.312845 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.312811    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-token" (OuterVolumeSpecName: "istio-token") pod "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" (UID: "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:16:18.312845 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.312818    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-kube-api-access-8hvqz" (OuterVolumeSpecName: "kube-api-access-8hvqz") pod "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" (UID: "c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3"). InnerVolumeSpecName "kube-api-access-8hvqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:16:18.412361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.412333    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:16:18.412361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.412358    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hvqz\" (UniqueName: \"kubernetes.io/projected/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-kube-api-access-8hvqz\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:16:18.412518 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.412368    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:16:18.412518 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.412377    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:16:18.961216 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.961178    2585 generic.go:356] "Generic (PLEG): container finished" podID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerID="a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f" exitCode=0
Sep 11 20:16:18.961368 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.961229    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"
Sep 11 20:16:18.961368 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.961258    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" event={"ID":"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3","Type":"ContainerDied","Data":"a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f"}
Sep 11 20:16:18.961368 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.961312    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45" event={"ID":"c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3","Type":"ContainerDied","Data":"eb34433eaaaf32a6bbacd23e262ba0239e5d769be338f0155530dfb87e598ea5"}
Sep 11 20:16:18.961368 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.961335    2585 scope.go:117] "RemoveContainer" containerID="a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f"
Sep 11 20:16:18.970965 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.970938    2585 scope.go:117] "RemoveContainer" containerID="9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade"
Sep 11 20:16:18.979004 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.978987    2585 scope.go:117] "RemoveContainer" containerID="a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f"
Sep 11 20:16:18.979270 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:16:18.979252    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f\": container with ID starting with a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f not found: ID does not exist" containerID="a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f"
Sep 11 20:16:18.979311 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.979280    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f"} err="failed to get container status \"a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f\": rpc error: code = NotFound desc = could not find container \"a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f\": container with ID starting with a8a8b899855c539537047ca2e65bd3e15b7e0345ebef165d8888abd5f53da26f not found: ID does not exist"
Sep 11 20:16:18.979311 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.979299    2585 scope.go:117] "RemoveContainer" containerID="9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade"
Sep 11 20:16:18.979543 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:16:18.979530    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade\": container with ID starting with 9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade not found: ID does not exist" containerID="9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade"
Sep 11 20:16:18.979583 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.979547    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade"} err="failed to get container status \"9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade\": rpc error: code = NotFound desc = could not find container \"9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade\": container with ID starting with 9b6226c4c5dc9a1115372f9036ea7933014def58aa0aebf5cf4c9973ca580ade not found: ID does not exist"
Sep 11 20:16:18.984050 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.984024    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"]
Sep 11 20:16:18.988805 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:18.988783    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-46da77-openshift-default-5b49fcc868-cpv45"]
Sep 11 20:16:19.350932 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:19.350893    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" path="/var/lib/kubelet/pods/c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3/volumes"
Sep 11 20:16:20.077395 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.077364    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"]
Sep 11 20:16:20.077717 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.077705    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerName="istio-proxy"
Sep 11 20:16:20.077767 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.077718    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerName="istio-proxy"
Sep 11 20:16:20.077767 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.077731    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerName="istio-proxy"
Sep 11 20:16:20.077767 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.077736    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerName="istio-proxy"
Sep 11 20:16:20.077857 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.077807    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerName="istio-proxy"
Sep 11 20:16:20.077857 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.077815    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f7d03b-d573-47e9-9dde-a80ddbd7f9b3" containerName="istio-proxy"
Sep 11 20:16:20.082548 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.082530    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.086384 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.086364    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-9d9abb\"/\"premium-w0-9d9abb-kserve-self-signed-certs\""
Sep 11 20:16:20.086494 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.086386    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-9d9abb\"/\"default-dockercfg-56qbm\""
Sep 11 20:16:20.086494 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.086477    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-9d9abb\"/\"openshift-service-ca.crt\""
Sep 11 20:16:20.086605 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.086478    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-9d9abb\"/\"kube-root-ca.crt\""
Sep 11 20:16:20.095430 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.095412    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"]
Sep 11 20:16:20.209198 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.209164    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"]
Sep 11 20:16:20.212764 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.212741    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.215967 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.215931    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-3c2adb-serving-cert\""
Sep 11 20:16:20.230465 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.230438    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-tmp-dir\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.230551 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.230479    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-tls-certs\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.230551 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.230512    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpm7v\" (UniqueName: \"kubernetes.io/projected/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-kube-api-access-zpm7v\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.230551 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.230534    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-model-cache\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.230654 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.230622    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-home\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.230654 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.230648    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-dshm\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.235478 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.235455    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"]
Sep 11 20:16:20.331344 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331260    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-maas-api-tls\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.331344 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331299    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-dshm\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.331566 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331375    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-tmp-dir\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.331566 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331432    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-tls-certs\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.331566 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331461    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpm7v\" (UniqueName: \"kubernetes.io/projected/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-kube-api-access-zpm7v\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.331566 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331479    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-model-cache\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.331566 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331505    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-metrics-certs\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.331838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331588    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-openshift-service-ca\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.331838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331660    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-home\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.331838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331690    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsv5c\" (UniqueName: \"kubernetes.io/projected/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-kube-api-access-zsv5c\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.331838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331730    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-tmp-dir\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.331838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331813    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-model-cache\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.332124 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.331926    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-home\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.333730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.333709    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-dshm\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.334121 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.334101    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-tls-certs\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.339156 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.339138    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpm7v\" (UniqueName: \"kubernetes.io/projected/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-kube-api-access-zpm7v\") pod \"premium-w0-9d9abb-kserve-5595cc8577-6d5gn\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") " pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.391406 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.391366    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:20.432587 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.432558    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsv5c\" (UniqueName: \"kubernetes.io/projected/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-kube-api-access-zsv5c\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.432733 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.432596    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-maas-api-tls\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.432733 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.432665    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-metrics-certs\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.432733 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.432705    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-openshift-service-ca\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.432913 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:16:20.432806    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-serving-cert: secret "maas-api-e2e-explicit-3c2adb-serving-cert" not found
Sep 11 20:16:20.432913 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:16:20.432884    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-maas-api-tls podName:338aa9ac-4fad-40f6-b1c9-de4a2b3d9997 nodeName:}" failed. No retries permitted until 2026-09-11 20:16:20.932864081 +0000 UTC m=+966.094114310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-maas-api-tls") pod "maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv" (UID: "338aa9ac-4fad-40f6-b1c9-de4a2b3d9997") : secret "maas-api-e2e-explicit-3c2adb-serving-cert" not found
Sep 11 20:16:20.433438 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.433415    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-openshift-service-ca\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.435205 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.435173    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-metrics-certs\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.443556 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.442361    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsv5c\" (UniqueName: \"kubernetes.io/projected/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-kube-api-access-zsv5c\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.669123 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.668925    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"]
Sep 11 20:16:20.672052 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:16:20.672023    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fc56545_f1a9_4dad_8b28_8f8afbdaf2ef.slice/crio-6f4057a0d1e1342a739d250405f5a3754b592ed93a638a6b04ef0326e768269f WatchSource:0}: Error finding container 6f4057a0d1e1342a739d250405f5a3754b592ed93a638a6b04ef0326e768269f: Status 404 returned error can't find the container with id 6f4057a0d1e1342a739d250405f5a3754b592ed93a638a6b04ef0326e768269f
Sep 11 20:16:20.937667 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.937573    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-maas-api-tls\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:20.938116 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:16:20.937995    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-serving-cert: secret "maas-api-e2e-explicit-3c2adb-serving-cert" not found
Sep 11 20:16:20.938353 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:16:20.938339    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-maas-api-tls podName:338aa9ac-4fad-40f6-b1c9-de4a2b3d9997 nodeName:}" failed. No retries permitted until 2026-09-11 20:16:21.938299427 +0000 UTC m=+967.099549663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-maas-api-tls") pod "maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv" (UID: "338aa9ac-4fad-40f6-b1c9-de4a2b3d9997") : secret "maas-api-e2e-explicit-3c2adb-serving-cert" not found
Sep 11 20:16:20.974313 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.974280    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn" event={"ID":"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef","Type":"ContainerStarted","Data":"547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144"}
Sep 11 20:16:20.974313 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.974325    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn" event={"ID":"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef","Type":"ContainerStarted","Data":"6f4057a0d1e1342a739d250405f5a3754b592ed93a638a6b04ef0326e768269f"}
Sep 11 20:16:20.992773 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:20.992726    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn" podStartSLOduration=0.992711962 podStartE2EDuration="992.711962ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:16:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:16:20.99072096 +0000 UTC m=+966.151971206" watchObservedRunningTime="2026-09-11 20:16:20.992711962 +0000 UTC m=+966.153962228"
Sep 11 20:16:21.949187 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:21.949149    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-maas-api-tls\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:21.951689 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:21.951658    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-maas-api-tls\") pod \"maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:22.022851 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:22.022829    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:22.301875 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:22.301845    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"]
Sep 11 20:16:22.303821 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:16:22.303791    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338aa9ac_4fad_40f6_b1c9_de4a2b3d9997.slice/crio-11678428d608583d15f0b3570d5f512d9f9afa0a8a54308e295713bb471fd524 WatchSource:0}: Error finding container 11678428d608583d15f0b3570d5f512d9f9afa0a8a54308e295713bb471fd524: Status 404 returned error can't find the container with id 11678428d608583d15f0b3570d5f512d9f9afa0a8a54308e295713bb471fd524
Sep 11 20:16:22.987525 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:22.987491    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv" event={"ID":"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997","Type":"ContainerStarted","Data":"e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6"}
Sep 11 20:16:22.987910 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:22.987546    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv" event={"ID":"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997","Type":"ContainerStarted","Data":"11678428d608583d15f0b3570d5f512d9f9afa0a8a54308e295713bb471fd524"}
Sep 11 20:16:22.987910 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:22.987607    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:23.030144 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:23.030097    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv" podStartSLOduration=2.455144678 podStartE2EDuration="3.030081304s" totalImagesPullingTime="574.936626ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:16:23.029480353 +0000 UTC m=+968.190730594" watchObservedRunningTime="2026-09-11 20:16:23.030081304 +0000 UTC m=+968.191331546"
Sep 11 20:16:28.998265 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:28.998238    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:16:30.391573 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:30.391537    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:30.391945 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:30.391590    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:30.404484 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:30.404453    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:31.039325 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:31.039292    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:16:40.081290 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:40.081186    2585 generic.go:356] "Generic (PLEG): container finished" podID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerID="764236da3b254ee0aa4d9b5f89e6823d3b99533b67399fc04b26c78686435814" exitCode=0
Sep 11 20:16:40.081290 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:40.081267    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" event={"ID":"66a959ce-f8b1-4348-824d-7c70a9b3ba05","Type":"ContainerDied","Data":"764236da3b254ee0aa4d9b5f89e6823d3b99533b67399fc04b26c78686435814"}
Sep 11 20:16:40.081890 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:40.081801    2585 scope.go:117] "RemoveContainer" containerID="764236da3b254ee0aa4d9b5f89e6823d3b99533b67399fc04b26c78686435814"
Sep 11 20:16:40.083032 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:40.083006    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:16:40.083130 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:40.083075    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:16:40.083130 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:40.083105    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:16:41.089116 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:41.089081    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" event={"ID":"66a959ce-f8b1-4348-824d-7c70a9b3ba05","Type":"ContainerStarted","Data":"99ee57c57ebe69f8bf1cad86845de08e3d8f8d65c94c90ecdacfe49093e497c0"}
Sep 11 20:16:41.990361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:41.990317    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:41.990576 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:41.990523    2585 patch_prober.go:28] interesting pod/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 11 20:16:41.990660 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:41.990583    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 11 20:16:42.990490 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:42.990454    2585 patch_prober.go:28] interesting pod/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 11 20:16:42.990905 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:42.990519    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 11 20:16:43.990642 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:43.990605    2585 patch_prober.go:28] interesting pod/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 11 20:16:43.991128 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:43.990691    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 11 20:16:44.991082 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:44.991038    2585 patch_prober.go:28] interesting pod/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 11 20:16:44.991560 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:44.991102    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 11 20:16:45.991051 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:45.991015    2585 patch_prober.go:28] interesting pod/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 11 20:16:45.991232 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:45.991070    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 11 20:16:46.950274 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:46.950241    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:46.995124 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:46.995092    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:16:47.119930 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:16:47.119904    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:17:02.161221 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.161188    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"]
Sep 11 20:17:02.166181 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.166160    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.168973 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.168935    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6344a120-openshift-default-dockercfg-bcdpr\""
Sep 11 20:17:02.181404 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.181380    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"]
Sep 11 20:17:02.264002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.263937    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-credential-socket\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.264211 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.264021    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht2lt\" (UniqueName: \"kubernetes.io/projected/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-kube-api-access-ht2lt\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.264211 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.264072    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-envoy\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.264211 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.264114    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-data\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.264211 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.264141    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-podinfo\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.264211 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.264202    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-token\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.264551 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.264258    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-workload-certs\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.264551 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.264297    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istiod-ca-cert\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.264551 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.264340    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-workload-socket\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.364874 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.364830    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-token\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365073 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.364907    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-workload-certs\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365073 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.364943    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istiod-ca-cert\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365073 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.365005    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-workload-socket\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365073 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.365048    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-credential-socket\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365304 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.365076    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht2lt\" (UniqueName: \"kubernetes.io/projected/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-kube-api-access-ht2lt\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365304 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.365120    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-envoy\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365304 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.365161    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-data\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365304 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.365186    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-podinfo\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365515 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.365457    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-workload-certs\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365596 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.365571    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-credential-socket\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365648 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.365627    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-workload-socket\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365721 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.365695    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-data\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.365899 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.365879    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istiod-ca-cert\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.367617 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.367595    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-envoy\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.367913 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.367893    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-podinfo\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.373460 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.373431    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-token\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.373731 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.373711    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht2lt\" (UniqueName: \"kubernetes.io/projected/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-kube-api-access-ht2lt\") pod \"e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") " pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.476914 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.476827    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:02.761185 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:17:02.761155    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59fdbf06_1c4c_4fca_9e0b_14a7d82ca2b9.slice/crio-9a67caff124a05a2b5cc6d1a732c94f959a7e3e0bb22e784d75506e98192797b WatchSource:0}: Error finding container 9a67caff124a05a2b5cc6d1a732c94f959a7e3e0bb22e784d75506e98192797b: Status 404 returned error can't find the container with id 9a67caff124a05a2b5cc6d1a732c94f959a7e3e0bb22e784d75506e98192797b
Sep 11 20:17:02.762651 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.762627    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"]
Sep 11 20:17:02.763641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.763613    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:17:02.763710 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.763672    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:17:02.763710 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:02.763699    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:17:03.204135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:03.204092    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" event={"ID":"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9","Type":"ContainerStarted","Data":"992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b"}
Sep 11 20:17:03.204556 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:03.204146    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" event={"ID":"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9","Type":"ContainerStarted","Data":"9a67caff124a05a2b5cc6d1a732c94f959a7e3e0bb22e784d75506e98192797b"}
Sep 11 20:17:03.228840 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:03.228792    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" podStartSLOduration=1.2287772160000001 podStartE2EDuration="1.228777216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:17:03.226632624 +0000 UTC m=+1008.387882891" watchObservedRunningTime="2026-09-11 20:17:03.228777216 +0000 UTC m=+1008.390027458"
Sep 11 20:17:03.477931 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:03.477840    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:03.483000 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:03.482972    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:04.209286 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:04.209252    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:04.210323 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:04.210298    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:12.309609 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.309578    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"]
Sep 11 20:17:12.313834 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.313801    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.317224 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.317202    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6344a120-serving-cert\""
Sep 11 20:17:12.325946 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.325902    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"]
Sep 11 20:17:12.362094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.362066    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-maas-api-tls\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.362247 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.362136    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfvjp\" (UniqueName: \"kubernetes.io/projected/d87509e5-fd37-4886-8613-2fcc1dfab341-kube-api-access-dfvjp\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.362247 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.362190    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d87509e5-fd37-4886-8613-2fcc1dfab341-openshift-service-ca\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.362427 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.362402    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-metrics-certs\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.463552 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.463510    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d87509e5-fd37-4886-8613-2fcc1dfab341-openshift-service-ca\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.463753 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.463604    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-metrics-certs\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.463753 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.463656    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-maas-api-tls\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.463753 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.463726    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfvjp\" (UniqueName: \"kubernetes.io/projected/d87509e5-fd37-4886-8613-2fcc1dfab341-kube-api-access-dfvjp\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.463925 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:17:12.463825    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-serving-cert: secret "maas-api-e2e-mt-6344a120-serving-cert" not found
Sep 11 20:17:12.463925 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:17:12.463888    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-maas-api-tls podName:d87509e5-fd37-4886-8613-2fcc1dfab341 nodeName:}" failed. No retries permitted until 2026-09-11 20:17:12.96387263 +0000 UTC m=+1018.125122854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-maas-api-tls") pod "maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s" (UID: "d87509e5-fd37-4886-8613-2fcc1dfab341") : secret "maas-api-e2e-mt-6344a120-serving-cert" not found
Sep 11 20:17:12.464373 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.464351    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d87509e5-fd37-4886-8613-2fcc1dfab341-openshift-service-ca\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.466032 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.466011    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-metrics-certs\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.473400 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.473379    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfvjp\" (UniqueName: \"kubernetes.io/projected/d87509e5-fd37-4886-8613-2fcc1dfab341-kube-api-access-dfvjp\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.970280 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.970238    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-maas-api-tls\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:12.972647 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:12.972620    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-maas-api-tls\") pod \"maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:13.226820 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:13.226722    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:13.512406 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:13.512381    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"]
Sep 11 20:17:13.514368 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:17:13.514335    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87509e5_fd37_4886_8613_2fcc1dfab341.slice/crio-c014a3dc85fb54365dafea6ff214f03116d3ea0f6d779da1df5c9d26395c7841 WatchSource:0}: Error finding container c014a3dc85fb54365dafea6ff214f03116d3ea0f6d779da1df5c9d26395c7841: Status 404 returned error can't find the container with id c014a3dc85fb54365dafea6ff214f03116d3ea0f6d779da1df5c9d26395c7841
Sep 11 20:17:14.273208 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:14.273128    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s" event={"ID":"d87509e5-fd37-4886-8613-2fcc1dfab341","Type":"ContainerStarted","Data":"880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f"}
Sep 11 20:17:14.273208 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:14.273180    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s" event={"ID":"d87509e5-fd37-4886-8613-2fcc1dfab341","Type":"ContainerStarted","Data":"c014a3dc85fb54365dafea6ff214f03116d3ea0f6d779da1df5c9d26395c7841"}
Sep 11 20:17:14.273391 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:14.273239    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:14.291881 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:14.291839    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s" podStartSLOduration=1.960037426 podStartE2EDuration="2.291824339s" totalImagesPullingTime="331.786913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:17:14.289822918 +0000 UTC m=+1019.451073160" watchObservedRunningTime="2026-09-11 20:17:14.291824339 +0000 UTC m=+1019.453074580"
Sep 11 20:17:20.284087 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:20.284054    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:32.369446 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:32.369408    2585 generic.go:356] "Generic (PLEG): container finished" podID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerID="992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b" exitCode=0
Sep 11 20:17:32.369978 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:32.369484    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" event={"ID":"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9","Type":"ContainerDied","Data":"992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b"}
Sep 11 20:17:32.369978 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:32.369866    2585 scope.go:117] "RemoveContainer" containerID="992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b"
Sep 11 20:17:32.371118 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:32.371090    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:17:32.371201 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:32.371166    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:17:32.371201 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:32.371197    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:17:33.378201 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:33.378157    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" event={"ID":"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9","Type":"ContainerStarted","Data":"2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a"}
Sep 11 20:17:33.477186 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:33.477156    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:33.478296 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:33.478272    2585 patch_prober.go:28] interesting pod/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 11 20:17:33.478355 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:33.478331    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 11 20:17:34.209556 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:34.209517    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:34.478176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:34.478085    2585 patch_prober.go:28] interesting pod/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 11 20:17:34.478176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:34.478147    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 11 20:17:35.477574 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:35.477534    2585 patch_prober.go:28] interesting pod/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 11 20:17:35.477759 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:35.477604    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 11 20:17:36.477421 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:36.477383    2585 patch_prober.go:28] interesting pod/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 11 20:17:36.477865 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:36.477445    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 11 20:17:37.477355 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:37.477318    2585 patch_prober.go:28] interesting pod/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 11 20:17:37.477529 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:37.477371    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 11 20:17:38.485588 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:38.485551    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:38.487537 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:38.487510    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:17:55.995094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:55.995060    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"]
Sep 11 20:17:55.995634 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:55.995287    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s" podUID="d87509e5-fd37-4886-8613-2fcc1dfab341" containerName="maas-api" containerID="cri-o://880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f" gracePeriod=30
Sep 11 20:17:56.246301 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.246235    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:56.308556 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.307305    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-maas-api-tls\") pod \"d87509e5-fd37-4886-8613-2fcc1dfab341\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") "
Sep 11 20:17:56.308556 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.307379    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfvjp\" (UniqueName: \"kubernetes.io/projected/d87509e5-fd37-4886-8613-2fcc1dfab341-kube-api-access-dfvjp\") pod \"d87509e5-fd37-4886-8613-2fcc1dfab341\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") "
Sep 11 20:17:56.308556 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.307551    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d87509e5-fd37-4886-8613-2fcc1dfab341-openshift-service-ca\") pod \"d87509e5-fd37-4886-8613-2fcc1dfab341\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") "
Sep 11 20:17:56.308556 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.307716    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-metrics-certs\") pod \"d87509e5-fd37-4886-8613-2fcc1dfab341\" (UID: \"d87509e5-fd37-4886-8613-2fcc1dfab341\") "
Sep 11 20:17:56.309622 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.309582    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d87509e5-fd37-4886-8613-2fcc1dfab341-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d87509e5-fd37-4886-8613-2fcc1dfab341" (UID: "d87509e5-fd37-4886-8613-2fcc1dfab341"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:17:56.318425 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.318385    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d87509e5-fd37-4886-8613-2fcc1dfab341" (UID: "d87509e5-fd37-4886-8613-2fcc1dfab341"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:17:56.325332 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.324498    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d87509e5-fd37-4886-8613-2fcc1dfab341" (UID: "d87509e5-fd37-4886-8613-2fcc1dfab341"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:17:56.325987 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.325925    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d87509e5-fd37-4886-8613-2fcc1dfab341-kube-api-access-dfvjp" (OuterVolumeSpecName: "kube-api-access-dfvjp") pod "d87509e5-fd37-4886-8613-2fcc1dfab341" (UID: "d87509e5-fd37-4886-8613-2fcc1dfab341"). InnerVolumeSpecName "kube-api-access-dfvjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:17:56.409286 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.409250    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d87509e5-fd37-4886-8613-2fcc1dfab341-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:17:56.409286 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.409280    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:17:56.409286 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.409290    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d87509e5-fd37-4886-8613-2fcc1dfab341-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:17:56.410162 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.409298    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfvjp\" (UniqueName: \"kubernetes.io/projected/d87509e5-fd37-4886-8613-2fcc1dfab341-kube-api-access-dfvjp\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:17:56.501158 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.501076    2585 generic.go:356] "Generic (PLEG): container finished" podID="d87509e5-fd37-4886-8613-2fcc1dfab341" containerID="880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f" exitCode=0
Sep 11 20:17:56.501158 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.501123    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"
Sep 11 20:17:56.501320 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.501160    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s" event={"ID":"d87509e5-fd37-4886-8613-2fcc1dfab341","Type":"ContainerDied","Data":"880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f"}
Sep 11 20:17:56.501320 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.501215    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s" event={"ID":"d87509e5-fd37-4886-8613-2fcc1dfab341","Type":"ContainerDied","Data":"c014a3dc85fb54365dafea6ff214f03116d3ea0f6d779da1df5c9d26395c7841"}
Sep 11 20:17:56.501320 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.501238    2585 scope.go:117] "RemoveContainer" containerID="880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f"
Sep 11 20:17:56.510926 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.510909    2585 scope.go:117] "RemoveContainer" containerID="880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f"
Sep 11 20:17:56.511219 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:17:56.511202    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f\": container with ID starting with 880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f not found: ID does not exist" containerID="880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f"
Sep 11 20:17:56.511269 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.511228    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f"} err="failed to get container status \"880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f\": rpc error: code = NotFound desc = could not find container \"880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f\": container with ID starting with 880498540cf0d932e7ffcd773c95896d37b78ca86018838b8f26de2237c97c7f not found: ID does not exist"
Sep 11 20:17:56.522766 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.522739    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"]
Sep 11 20:17:56.526664 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:56.526646    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6344a120-8d9f44ff7-kk52s"]
Sep 11 20:17:57.350074 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:57.350038    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d87509e5-fd37-4886-8613-2fcc1dfab341" path="/var/lib/kubelet/pods/d87509e5-fd37-4886-8613-2fcc1dfab341/volumes"
Sep 11 20:17:59.483361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.483327    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"]
Sep 11 20:17:59.484266 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.484242    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87509e5-fd37-4886-8613-2fcc1dfab341" containerName="maas-api"
Sep 11 20:17:59.484266 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.484267    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87509e5-fd37-4886-8613-2fcc1dfab341" containerName="maas-api"
Sep 11 20:17:59.484467 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.484454    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d87509e5-fd37-4886-8613-2fcc1dfab341" containerName="maas-api"
Sep 11 20:17:59.489984 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.489940    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.492981 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.492929    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-22fc84\"/\"e2e-conflict-a-cb87ecd4-kserve-self-signed-certs\""
Sep 11 20:17:59.493203 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.493184    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"]
Sep 11 20:17:59.538486 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.538447    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-tls-certs\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.538646 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.538518    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tjtg\" (UniqueName: \"kubernetes.io/projected/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-kube-api-access-8tjtg\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.538646 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.538569    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-tmp-dir\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.538752 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.538656    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-home\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.538752 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.538725    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-model-cache\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.538846 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.538777    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-dshm\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.639871 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.639835    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tjtg\" (UniqueName: \"kubernetes.io/projected/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-kube-api-access-8tjtg\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.640072 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.639880    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-tmp-dir\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.640072 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.639999    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-home\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.640072 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.640053    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-model-cache\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.640229 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.640107    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-dshm\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.640229 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.640140    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-tls-certs\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.640312 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.640299    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-home\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.640423 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.640404    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-tmp-dir\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.640470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.640455    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-model-cache\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.642319 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.642287    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-dshm\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.642563 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.642548    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-tls-certs\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.648172 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.648143    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tjtg\" (UniqueName: \"kubernetes.io/projected/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-kube-api-access-8tjtg\") pod \"e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") " pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:17:59.800428 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:17:59.800344    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:18:00.080029 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:00.080000    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"]
Sep 11 20:18:00.082006 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:18:00.081974    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02bd5bb1_73b0_47b8_9f52_1e238ed7a93f.slice/crio-5042305bb67bc231bf4dcd16ceb124d699a68295be2d165b1d75e7f2cd41dc2f WatchSource:0}: Error finding container 5042305bb67bc231bf4dcd16ceb124d699a68295be2d165b1d75e7f2cd41dc2f: Status 404 returned error can't find the container with id 5042305bb67bc231bf4dcd16ceb124d699a68295be2d165b1d75e7f2cd41dc2f
Sep 11 20:18:00.524947 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:00.524911    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6" event={"ID":"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f","Type":"ContainerStarted","Data":"527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172"}
Sep 11 20:18:00.525447 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:00.524979    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6" event={"ID":"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f","Type":"ContainerStarted","Data":"5042305bb67bc231bf4dcd16ceb124d699a68295be2d165b1d75e7f2cd41dc2f"}
Sep 11 20:18:00.543859 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:00.543803    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6" podStartSLOduration=1.5437881519999999 podStartE2EDuration="1.543788152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:17:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:18:00.541202754 +0000 UTC m=+1065.702452996" watchObservedRunningTime="2026-09-11 20:18:00.543788152 +0000 UTC m=+1065.705038428"
Sep 11 20:18:03.475201 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:03.475164    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"]
Sep 11 20:18:03.475682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:03.475429    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy" containerID="cri-o://2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a" gracePeriod=30
Sep 11 20:18:08.487021 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.486919    2585 patch_prober.go:28] interesting pod/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 11 20:18:08.487021 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.486997    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 11 20:18:08.524822 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:18:08.524786    2585 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59fdbf06_1c4c_4fca_9e0b_14a7d82ca2b9.slice/crio-2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59fdbf06_1c4c_4fca_9e0b_14a7d82ca2b9.slice/crio-conmon-2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 20:18:08.738880 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.738828    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:18:08.833091 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833062    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-workload-certs\") pod \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") "
Sep 11 20:18:08.833256 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833098    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-workload-socket\") pod \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") "
Sep 11 20:18:08.833256 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833155    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istiod-ca-cert\") pod \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") "
Sep 11 20:18:08.833256 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833177    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-envoy\") pod \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") "
Sep 11 20:18:08.833256 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833201    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-podinfo\") pod \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") "
Sep 11 20:18:08.833256 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833227    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-token\") pod \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") "
Sep 11 20:18:08.833529 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833294    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-data\") pod \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") "
Sep 11 20:18:08.833529 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833323    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-credential-socket\") pod \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") "
Sep 11 20:18:08.833529 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833342    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" (UID: "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:18:08.833529 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833359    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht2lt\" (UniqueName: \"kubernetes.io/projected/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-kube-api-access-ht2lt\") pod \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\" (UID: \"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9\") "
Sep 11 20:18:08.833529 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833459    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" (UID: "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:18:08.833788 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833569    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" (UID: "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:18:08.833788 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833687    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" (UID: "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:18:08.833788 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833768    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" (UID: "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:18:08.833971 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833925    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:08.834023 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833979    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:08.834023 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.833996    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:08.834023 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.834010    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:08.834120 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.834023    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:08.835553 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.835521    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" (UID: "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:18:08.835553 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.835535    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" (UID: "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:18:08.835830 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.835812    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-kube-api-access-ht2lt" (OuterVolumeSpecName: "kube-api-access-ht2lt") pod "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" (UID: "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9"). InnerVolumeSpecName "kube-api-access-ht2lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:18:08.835897 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.835834    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" (UID: "59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:18:08.934891 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.934866    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:08.934891 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.934888    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:08.934891 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.934896    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:08.935119 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:08.934905    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht2lt\" (UniqueName: \"kubernetes.io/projected/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9-kube-api-access-ht2lt\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:09.575419 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.575385    2585 generic.go:356] "Generic (PLEG): container finished" podID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerID="2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a" exitCode=0
Sep 11 20:18:09.575799 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.575470    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"
Sep 11 20:18:09.575799 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.575474    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" event={"ID":"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9","Type":"ContainerDied","Data":"2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a"}
Sep 11 20:18:09.575799 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.575608    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb" event={"ID":"59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9","Type":"ContainerDied","Data":"9a67caff124a05a2b5cc6d1a732c94f959a7e3e0bb22e784d75506e98192797b"}
Sep 11 20:18:09.576607 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.575629    2585 scope.go:117] "RemoveContainer" containerID="2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a"
Sep 11 20:18:09.586211 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.586196    2585 scope.go:117] "RemoveContainer" containerID="992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b"
Sep 11 20:18:09.594362 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.594226    2585 scope.go:117] "RemoveContainer" containerID="2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a"
Sep 11 20:18:09.594509 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:18:09.594490    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a\": container with ID starting with 2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a not found: ID does not exist" containerID="2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a"
Sep 11 20:18:09.594555 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.594516    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a"} err="failed to get container status \"2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a\": rpc error: code = NotFound desc = could not find container \"2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a\": container with ID starting with 2abfa5bf4ff0656c1c572bf3fb7ea03b9d4bdcbe5f0d8b1968e8b13ff367bd6a not found: ID does not exist"
Sep 11 20:18:09.594555 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.594534    2585 scope.go:117] "RemoveContainer" containerID="992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b"
Sep 11 20:18:09.594794 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:18:09.594776    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b\": container with ID starting with 992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b not found: ID does not exist" containerID="992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b"
Sep 11 20:18:09.594845 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.594801    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b"} err="failed to get container status \"992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b\": rpc error: code = NotFound desc = could not find container \"992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b\": container with ID starting with 992f75e75b469baa50c533328d2ffb16e2de13cb6c96848db2ce05348164389b not found: ID does not exist"
Sep 11 20:18:09.594845 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.594784    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"]
Sep 11 20:18:09.599308 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.599287    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6344a120-openshift-default-7f4b7546fb-pkdqb"]
Sep 11 20:18:09.801170 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.801087    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:18:09.801313 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.801171    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:18:09.813368 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:09.813348    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:18:10.592692 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:10.592660    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:18:11.349942 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:11.349911    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" path="/var/lib/kubelet/pods/59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9/volumes"
Sep 11 20:18:13.025494 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.025459    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"]
Sep 11 20:18:13.025979 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.025724    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv" podUID="338aa9ac-4fad-40f6-b1c9-de4a2b3d9997" containerName="maas-api" containerID="cri-o://e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6" gracePeriod=30
Sep 11 20:18:13.285887 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.285824    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:18:13.371603 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.371575    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-maas-api-tls\") pod \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") "
Sep 11 20:18:13.371792 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.371615    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsv5c\" (UniqueName: \"kubernetes.io/projected/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-kube-api-access-zsv5c\") pod \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") "
Sep 11 20:18:13.371792 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.371636    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-openshift-service-ca\") pod \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") "
Sep 11 20:18:13.371792 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.371704    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-metrics-certs\") pod \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\" (UID: \"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997\") "
Sep 11 20:18:13.372060 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.372039    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "338aa9ac-4fad-40f6-b1c9-de4a2b3d9997" (UID: "338aa9ac-4fad-40f6-b1c9-de4a2b3d9997"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:18:13.373738 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.373703    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "338aa9ac-4fad-40f6-b1c9-de4a2b3d9997" (UID: "338aa9ac-4fad-40f6-b1c9-de4a2b3d9997"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:18:13.373849 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.373800    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-kube-api-access-zsv5c" (OuterVolumeSpecName: "kube-api-access-zsv5c") pod "338aa9ac-4fad-40f6-b1c9-de4a2b3d9997" (UID: "338aa9ac-4fad-40f6-b1c9-de4a2b3d9997"). InnerVolumeSpecName "kube-api-access-zsv5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:18:13.373849 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.373816    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "338aa9ac-4fad-40f6-b1c9-de4a2b3d9997" (UID: "338aa9ac-4fad-40f6-b1c9-de4a2b3d9997"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:18:13.473355 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.473319    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:13.473355 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.473349    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsv5c\" (UniqueName: \"kubernetes.io/projected/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-kube-api-access-zsv5c\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:13.473355 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.473359    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:13.473355 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.473368    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:13.601791 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.601759    2585 generic.go:356] "Generic (PLEG): container finished" podID="338aa9ac-4fad-40f6-b1c9-de4a2b3d9997" containerID="e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6" exitCode=0
Sep 11 20:18:13.601992 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.601800    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"
Sep 11 20:18:13.601992 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.601804    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv" event={"ID":"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997","Type":"ContainerDied","Data":"e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6"}
Sep 11 20:18:13.601992 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.601906    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv" event={"ID":"338aa9ac-4fad-40f6-b1c9-de4a2b3d9997","Type":"ContainerDied","Data":"11678428d608583d15f0b3570d5f512d9f9afa0a8a54308e295713bb471fd524"}
Sep 11 20:18:13.601992 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.601927    2585 scope.go:117] "RemoveContainer" containerID="e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6"
Sep 11 20:18:13.611094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.611077    2585 scope.go:117] "RemoveContainer" containerID="e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6"
Sep 11 20:18:13.611388 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:18:13.611368    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6\": container with ID starting with e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6 not found: ID does not exist" containerID="e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6"
Sep 11 20:18:13.611441 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.611395    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6"} err="failed to get container status \"e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6\": rpc error: code = NotFound desc = could not find container \"e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6\": container with ID starting with e0726a713aac4043c5f79a5061273573d1d76d985454ae2aa6c5e9d4f8ade5c6 not found: ID does not exist"
Sep 11 20:18:13.623313 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.623291    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"]
Sep 11 20:18:13.627432 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:13.627411    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3c2adb-5f459cbbcd-2c8kv"]
Sep 11 20:18:15.351764 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:15.351732    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="338aa9ac-4fad-40f6-b1c9-de4a2b3d9997" path="/var/lib/kubelet/pods/338aa9ac-4fad-40f6-b1c9-de4a2b3d9997/volumes"
Sep 11 20:18:17.885218 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.885185    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"]
Sep 11 20:18:17.885751 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.885730    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy"
Sep 11 20:18:17.885842 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.885755    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy"
Sep 11 20:18:17.885842 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.885768    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="338aa9ac-4fad-40f6-b1c9-de4a2b3d9997" containerName="maas-api"
Sep 11 20:18:17.885842 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.885777    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="338aa9ac-4fad-40f6-b1c9-de4a2b3d9997" containerName="maas-api"
Sep 11 20:18:17.885842 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.885793    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy"
Sep 11 20:18:17.885842 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.885801    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy"
Sep 11 20:18:17.886107 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.885905    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="338aa9ac-4fad-40f6-b1c9-de4a2b3d9997" containerName="maas-api"
Sep 11 20:18:17.886107 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.885923    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy"
Sep 11 20:18:17.886107 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.885932    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="59fdbf06-1c4c-4fca-9e0b-14a7d82ca2b9" containerName="istio-proxy"
Sep 11 20:18:17.890992 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.890971    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:17.893654 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.893632    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-ea327d-openshift-default-dockercfg-x54vc\""
Sep 11 20:18:17.903266 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:17.903242    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"]
Sep 11 20:18:18.015835 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.015801    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-credential-socket\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.015835 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.015840    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-data\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.016128 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.015861    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-podinfo\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.016128 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.015922    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-token\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.016128 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.016033    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxwgp\" (UniqueName: \"kubernetes.io/projected/9400ee51-9f92-43b9-98a5-40e9f1befc9a-kube-api-access-pxwgp\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.016128 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.016069    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-envoy\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.016128 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.016108    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-workload-socket\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.016324 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.016175    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-workload-certs\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.016324 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.016199    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istiod-ca-cert\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.117526 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.117491    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-workload-certs\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.117526 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.117536    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istiod-ca-cert\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.117757 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.117627    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-credential-socket\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.117757 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.117734    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-data\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.117868 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.117781    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-podinfo\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.117868 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.117810    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-token\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.118002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.117870    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxwgp\" (UniqueName: \"kubernetes.io/projected/9400ee51-9f92-43b9-98a5-40e9f1befc9a-kube-api-access-pxwgp\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.118002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.117903    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-envoy\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.118002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.117905    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-workload-certs\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.118002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.117943    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-workload-socket\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.118002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.117982    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-credential-socket\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.118247 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.118099    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-data\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.118321 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.118302    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-workload-socket\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.118643 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.118623    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istiod-ca-cert\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.120218 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.120188    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-envoy\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.120505 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.120483    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-podinfo\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.125671 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.125643    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-token\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.125884 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.125868    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxwgp\" (UniqueName: \"kubernetes.io/projected/9400ee51-9f92-43b9-98a5-40e9f1befc9a-kube-api-access-pxwgp\") pod \"e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") " pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.202245 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.202164    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:18.487919 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.487893    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"]
Sep 11 20:18:18.490052 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:18:18.490014    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9400ee51_9f92_43b9_98a5_40e9f1befc9a.slice/crio-89efeabebef93df335b9f941df9c28a604122812c401859c6452c4d1a74d00fd WatchSource:0}: Error finding container 89efeabebef93df335b9f941df9c28a604122812c401859c6452c4d1a74d00fd: Status 404 returned error can't find the container with id 89efeabebef93df335b9f941df9c28a604122812c401859c6452c4d1a74d00fd
Sep 11 20:18:18.492542 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.492508    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:18:18.492660 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.492580    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:18:18.492660 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.492608    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:18:18.630827 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.630792    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" event={"ID":"9400ee51-9f92-43b9-98a5-40e9f1befc9a","Type":"ContainerStarted","Data":"b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342"}
Sep 11 20:18:18.631014 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.630840    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" event={"ID":"9400ee51-9f92-43b9-98a5-40e9f1befc9a","Type":"ContainerStarted","Data":"89efeabebef93df335b9f941df9c28a604122812c401859c6452c4d1a74d00fd"}
Sep 11 20:18:18.676761 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:18.676711    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" podStartSLOduration=1.676695577 podStartE2EDuration="1.676695577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:18:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:18:18.67531579 +0000 UTC m=+1083.836566034" watchObservedRunningTime="2026-09-11 20:18:18.676695577 +0000 UTC m=+1083.837945818"
Sep 11 20:18:19.203004 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:19.202948    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:19.208240 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:19.208216    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:19.636000 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:19.635971    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:19.636903 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:19.636879    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:20.505751 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:20.505708    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"]
Sep 11 20:18:20.506245 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:20.506008    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerName="istio-proxy" containerID="cri-o://99ee57c57ebe69f8bf1cad86845de08e3d8f8d65c94c90ecdacfe49093e497c0" gracePeriod=30
Sep 11 20:18:25.670578 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.670543    2585 generic.go:356] "Generic (PLEG): container finished" podID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerID="99ee57c57ebe69f8bf1cad86845de08e3d8f8d65c94c90ecdacfe49093e497c0" exitCode=0
Sep 11 20:18:25.671042 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.670612    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" event={"ID":"66a959ce-f8b1-4348-824d-7c70a9b3ba05","Type":"ContainerDied","Data":"99ee57c57ebe69f8bf1cad86845de08e3d8f8d65c94c90ecdacfe49093e497c0"}
Sep 11 20:18:25.671042 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.670689    2585 scope.go:117] "RemoveContainer" containerID="764236da3b254ee0aa4d9b5f89e6823d3b99533b67399fc04b26c78686435814"
Sep 11 20:18:25.768284 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.768224    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:18:25.797514 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.797484    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-credential-socket\") pod \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") "
Sep 11 20:18:25.797730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.797525    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-envoy\") pod \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") "
Sep 11 20:18:25.797730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.797552    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-podinfo\") pod \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") "
Sep 11 20:18:25.797730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.797581    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-workload-certs\") pod \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") "
Sep 11 20:18:25.797730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.797649    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-token\") pod \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") "
Sep 11 20:18:25.797730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.797696    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvpq6\" (UniqueName: \"kubernetes.io/projected/66a959ce-f8b1-4348-824d-7c70a9b3ba05-kube-api-access-qvpq6\") pod \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") "
Sep 11 20:18:25.797730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.797721    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-workload-socket\") pod \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") "
Sep 11 20:18:25.798098 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.797783    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istiod-ca-cert\") pod \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") "
Sep 11 20:18:25.798098 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.797820    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-data\") pod \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\" (UID: \"66a959ce-f8b1-4348-824d-7c70a9b3ba05\") "
Sep 11 20:18:25.798098 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.797828    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66a959ce-f8b1-4348-824d-7c70a9b3ba05" (UID: "66a959ce-f8b1-4348-824d-7c70a9b3ba05"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:18:25.798098 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.798079    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66a959ce-f8b1-4348-824d-7c70a9b3ba05" (UID: "66a959ce-f8b1-4348-824d-7c70a9b3ba05"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:18:25.798298 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.798220    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66a959ce-f8b1-4348-824d-7c70a9b3ba05" (UID: "66a959ce-f8b1-4348-824d-7c70a9b3ba05"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:18:25.798354 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.798278    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-data" (OuterVolumeSpecName: "istio-data") pod "66a959ce-f8b1-4348-824d-7c70a9b3ba05" (UID: "66a959ce-f8b1-4348-824d-7c70a9b3ba05"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:18:25.798410 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.798388    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:25.798470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.798407    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:25.798470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.798420    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:25.798470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.798420    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66a959ce-f8b1-4348-824d-7c70a9b3ba05" (UID: "66a959ce-f8b1-4348-824d-7c70a9b3ba05"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:18:25.799987 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.799936    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66a959ce-f8b1-4348-824d-7c70a9b3ba05" (UID: "66a959ce-f8b1-4348-824d-7c70a9b3ba05"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:18:25.800562 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.800538    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66a959ce-f8b1-4348-824d-7c70a9b3ba05" (UID: "66a959ce-f8b1-4348-824d-7c70a9b3ba05"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:18:25.800641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.800558    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66a959ce-f8b1-4348-824d-7c70a9b3ba05-kube-api-access-qvpq6" (OuterVolumeSpecName: "kube-api-access-qvpq6") pod "66a959ce-f8b1-4348-824d-7c70a9b3ba05" (UID: "66a959ce-f8b1-4348-824d-7c70a9b3ba05"). InnerVolumeSpecName "kube-api-access-qvpq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:18:25.800709 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.800688    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-token" (OuterVolumeSpecName: "istio-token") pod "66a959ce-f8b1-4348-824d-7c70a9b3ba05" (UID: "66a959ce-f8b1-4348-824d-7c70a9b3ba05"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:18:25.899188 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.899149    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:25.899188 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.899179    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:25.899188 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.899191    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:25.899407 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.899203    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:25.899407 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.899213    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66a959ce-f8b1-4348-824d-7c70a9b3ba05-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:25.899407 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:25.899225    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvpq6\" (UniqueName: \"kubernetes.io/projected/66a959ce-f8b1-4348-824d-7c70a9b3ba05-kube-api-access-qvpq6\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:18:26.677904 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:26.677874    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"
Sep 11 20:18:26.678391 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:26.677921    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7" event={"ID":"66a959ce-f8b1-4348-824d-7c70a9b3ba05","Type":"ContainerDied","Data":"f475f1cfbb497fa4e87f5fd828574aad00de7f1fbd9314fc2279b4cb8f219051"}
Sep 11 20:18:26.678391 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:26.677992    2585 scope.go:117] "RemoveContainer" containerID="99ee57c57ebe69f8bf1cad86845de08e3d8f8d65c94c90ecdacfe49093e497c0"
Sep 11 20:18:26.702710 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:26.702686    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"]
Sep 11 20:18:26.705913 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:26.705891    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-3c2adb-openshift-default-79d6dd558d-fctv7"]
Sep 11 20:18:27.350573 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:27.350539    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" path="/var/lib/kubelet/pods/66a959ce-f8b1-4348-824d-7c70a9b3ba05/volumes"
Sep 11 20:18:43.769316 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:43.769229    2585 generic.go:356] "Generic (PLEG): container finished" podID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerID="b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342" exitCode=0
Sep 11 20:18:43.769704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:43.769304    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" event={"ID":"9400ee51-9f92-43b9-98a5-40e9f1befc9a","Type":"ContainerDied","Data":"b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342"}
Sep 11 20:18:43.769704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:43.769699    2585 scope.go:117] "RemoveContainer" containerID="b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342"
Sep 11 20:18:43.770905 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:43.770881    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:18:43.770993 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:43.770944    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:18:43.771041 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:43.770999    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:18:44.778871 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:44.778835    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" event={"ID":"9400ee51-9f92-43b9-98a5-40e9f1befc9a","Type":"ContainerStarted","Data":"d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600"}
Sep 11 20:18:45.203273 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:45.203238    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:45.204310 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:45.204277    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 20:18:45.204451 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:45.204329    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 20:18:46.203523 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:46.203487    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 20:18:46.203910 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:46.203544    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 20:18:47.203411 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:47.203377    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 20:18:47.203595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:47.203446    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 20:18:48.202906 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:48.202872    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 20:18:48.203105 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:48.202931    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 20:18:49.202905 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:49.202871    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 20:18:49.203346 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:49.202928    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 20:18:49.636461 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:49.636423    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:50.207241 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:50.207209    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:50.208224 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:50.208206    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:18:51.105788 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.105743    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"]
Sep 11 20:18:51.106242 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.106223    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerName="istio-proxy"
Sep 11 20:18:51.106242 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.106242    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerName="istio-proxy"
Sep 11 20:18:51.106415 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.106260    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerName="istio-proxy"
Sep 11 20:18:51.106415 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.106266    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerName="istio-proxy"
Sep 11 20:18:51.106415 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.106333    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerName="istio-proxy"
Sep 11 20:18:51.108585 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.108568    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.111511 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.111487    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-c7e744-openshift-default-dockercfg-f75mm\""
Sep 11 20:18:51.121588 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.121567    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"]
Sep 11 20:18:51.236596 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.236558    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istiod-ca-cert\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.236596 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.236597    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-data\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.237151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.236615    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-workload-certs\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.237151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.236696    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-credential-socket\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.237151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.236748    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-podinfo\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.237151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.236826    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-envoy\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.237151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.236878    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-workload-socket\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.237151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.236938    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6tzq\" (UniqueName: \"kubernetes.io/projected/3dc4bcb6-4869-4c8c-802d-caac8a56654e-kube-api-access-l6tzq\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.237151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.237011    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-token\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338000 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.337935    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-podinfo\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338178 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338031    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-envoy\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338178 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338066    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-workload-socket\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338178 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338117    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tzq\" (UniqueName: \"kubernetes.io/projected/3dc4bcb6-4869-4c8c-802d-caac8a56654e-kube-api-access-l6tzq\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338178 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338158    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-token\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338207    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istiod-ca-cert\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338237    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-data\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338264    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-workload-certs\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338307    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-credential-socket\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338598 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338574    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-workload-socket\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338714 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338686    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-credential-socket\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338855 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338752    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-data\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.338928 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338867    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-workload-certs\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.339034 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.338986    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istiod-ca-cert\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.340510 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.340490    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-envoy\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.340689 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.340666    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-podinfo\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.346838 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.346811    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-token\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.347639 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.347604    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6tzq\" (UniqueName: \"kubernetes.io/projected/3dc4bcb6-4869-4c8c-802d-caac8a56654e-kube-api-access-l6tzq\") pod \"e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") " pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.419539 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.419449    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:51.712236 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.712210    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"]
Sep 11 20:18:51.714143 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:18:51.714118    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc4bcb6_4869_4c8c_802d_caac8a56654e.slice/crio-648e0251d5e72946a5ed5932fe4698c4d12a16be62bcd33b6370cd68683b872e WatchSource:0}: Error finding container 648e0251d5e72946a5ed5932fe4698c4d12a16be62bcd33b6370cd68683b872e: Status 404 returned error can't find the container with id 648e0251d5e72946a5ed5932fe4698c4d12a16be62bcd33b6370cd68683b872e
Sep 11 20:18:51.716456 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.716428    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:18:51.716523 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.716489    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:18:51.716523 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.716520    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:18:51.819243 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.819211    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" event={"ID":"3dc4bcb6-4869-4c8c-802d-caac8a56654e","Type":"ContainerStarted","Data":"5489f782312df31d417a8ebf69442ddf9b90633ba2f4b91c623fea663f2a4141"}
Sep 11 20:18:51.819433 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.819259    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" event={"ID":"3dc4bcb6-4869-4c8c-802d-caac8a56654e","Type":"ContainerStarted","Data":"648e0251d5e72946a5ed5932fe4698c4d12a16be62bcd33b6370cd68683b872e"}
Sep 11 20:18:51.840101 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:51.840046    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" podStartSLOduration=0.840029781 podStartE2EDuration="840.029781ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:18:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:18:51.838736319 +0000 UTC m=+1116.999986553" watchObservedRunningTime="2026-09-11 20:18:51.840029781 +0000 UTC m=+1117.001280022"
Sep 11 20:18:52.420482 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:52.420442    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:52.425641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:52.425616    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:52.825154 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:52.825073    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:52.826153 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:52.826135    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:18:57.708243 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.708209    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"]
Sep 11 20:18:57.708834 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.708660    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="66a959ce-f8b1-4348-824d-7c70a9b3ba05" containerName="istio-proxy"
Sep 11 20:18:57.710876 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.710856    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:57.713285 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.713266    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-c7e744-serving-cert\""
Sep 11 20:18:57.724453 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.724427    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"]
Sep 11 20:18:57.802937 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.802902    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9675592c-76c1-4261-8982-5c96a30c1f59-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:57.803125 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.802981    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:57.803125 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.803023    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:57.803125 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.803056    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6fhf\" (UniqueName: \"kubernetes.io/projected/9675592c-76c1-4261-8982-5c96a30c1f59-kube-api-access-m6fhf\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:57.904315 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.904283    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9675592c-76c1-4261-8982-5c96a30c1f59-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:57.904529 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.904348    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:57.904529 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.904399    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:57.904529 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.904436    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6fhf\" (UniqueName: \"kubernetes.io/projected/9675592c-76c1-4261-8982-5c96a30c1f59-kube-api-access-m6fhf\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:57.904696 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:18:57.904530    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-serving-cert: secret "maas-api-e2e-shared-b-w2-c7e744-serving-cert" not found
Sep 11 20:18:57.904696 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:18:57.904598    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-maas-api-tls podName:9675592c-76c1-4261-8982-5c96a30c1f59 nodeName:}" failed. No retries permitted until 2026-09-11 20:18:58.404577781 +0000 UTC m=+1123.565828026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-maas-api-tls") pod "maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm" (UID: "9675592c-76c1-4261-8982-5c96a30c1f59") : secret "maas-api-e2e-shared-b-w2-c7e744-serving-cert" not found
Sep 11 20:18:57.905114 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.905094    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9675592c-76c1-4261-8982-5c96a30c1f59-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:57.906869 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.906848    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:57.915635 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:57.915612    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6fhf\" (UniqueName: \"kubernetes.io/projected/9675592c-76c1-4261-8982-5c96a30c1f59-kube-api-access-m6fhf\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:58.409464 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:58.409431    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:58.409652 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:18:58.409603    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-serving-cert: secret "maas-api-e2e-shared-b-w2-c7e744-serving-cert" not found
Sep 11 20:18:58.409698 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:18:58.409677    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-maas-api-tls podName:9675592c-76c1-4261-8982-5c96a30c1f59 nodeName:}" failed. No retries permitted until 2026-09-11 20:18:59.409662075 +0000 UTC m=+1124.570912317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-maas-api-tls") pod "maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm" (UID: "9675592c-76c1-4261-8982-5c96a30c1f59") : secret "maas-api-e2e-shared-b-w2-c7e744-serving-cert" not found
Sep 11 20:18:59.418850 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:59.418812    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:59.421290 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:59.421265    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:59.523151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:59.523128    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:18:59.795660 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:59.795635    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"]
Sep 11 20:18:59.797886 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:18:59.797856    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9675592c_76c1_4261_8982_5c96a30c1f59.slice/crio-1671bd3c2267349d18ed788f73bf4e7216d3772ed17f0088f9f10de7af533e51 WatchSource:0}: Error finding container 1671bd3c2267349d18ed788f73bf4e7216d3772ed17f0088f9f10de7af533e51: Status 404 returned error can't find the container with id 1671bd3c2267349d18ed788f73bf4e7216d3772ed17f0088f9f10de7af533e51
Sep 11 20:18:59.799460 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:59.799438    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 20:18:59.866888 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:18:59.866856    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm" event={"ID":"9675592c-76c1-4261-8982-5c96a30c1f59","Type":"ContainerStarted","Data":"1671bd3c2267349d18ed788f73bf4e7216d3772ed17f0088f9f10de7af533e51"}
Sep 11 20:19:00.874263 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:00.874226    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm" event={"ID":"9675592c-76c1-4261-8982-5c96a30c1f59","Type":"ContainerStarted","Data":"f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500"}
Sep 11 20:19:00.874665 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:00.874294    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:19:00.918191 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:00.918144    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm" podStartSLOduration=3.593873287 podStartE2EDuration="3.918126861s" totalImagesPullingTime="324.253574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:19:00.916819309 +0000 UTC m=+1126.078069552" watchObservedRunningTime="2026-09-11 20:19:00.918126861 +0000 UTC m=+1126.079377103"
Sep 11 20:19:06.885744 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:06.885713    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:19:21.994724 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:21.994688    2585 generic.go:356] "Generic (PLEG): container finished" podID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerID="5489f782312df31d417a8ebf69442ddf9b90633ba2f4b91c623fea663f2a4141" exitCode=0
Sep 11 20:19:21.995161 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:21.994726    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" event={"ID":"3dc4bcb6-4869-4c8c-802d-caac8a56654e","Type":"ContainerDied","Data":"5489f782312df31d417a8ebf69442ddf9b90633ba2f4b91c623fea663f2a4141"}
Sep 11 20:19:21.995233 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:21.995214    2585 scope.go:117] "RemoveContainer" containerID="5489f782312df31d417a8ebf69442ddf9b90633ba2f4b91c623fea663f2a4141"
Sep 11 20:19:21.996714 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:21.996687    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:19:21.996783 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:21.996756    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:19:21.996820 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:21.996786    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:19:22.825736 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:22.825704    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:19:23.002665 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:23.002627    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" event={"ID":"3dc4bcb6-4869-4c8c-802d-caac8a56654e","Type":"ContainerStarted","Data":"46355aeb3563f08c0bf3fdf7f55c229238d0f05a9a73fafe376340444aca2ddc"}
Sep 11 20:19:23.420135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:23.420098    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:19:23.421450 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:23.421422    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 20:19:23.421578 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:23.421484    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 20:19:24.420671 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:24.420636    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 20:19:24.421095 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:24.420695    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 20:19:25.419978 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:25.419922    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 20:19:25.420187 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:25.420008    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 20:19:26.420059 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:26.420027    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 20:19:26.420426 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:26.420083    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 20:19:27.420220 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:27.420185    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 20:19:27.420608 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:27.420240    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 20:19:28.420687 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:28.420654    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 20:19:28.421117 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:28.420711    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 20:19:29.424352 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:29.424322    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:19:29.424749 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:29.424615    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:19:29.425159 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:29.425143    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:19:32.731728 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.731693    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"]
Sep 11 20:19:32.735187 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.735165    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.737761 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.737739    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d11bc81f-openshift-default-dockercfg-z2lbq\""
Sep 11 20:19:32.749948 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.749926    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"]
Sep 11 20:19:32.858811 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.858698    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d42b45a9-61fd-47bc-9855-20440e865b25-istio-token\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.858811 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.858759    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-istio-envoy\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.859112 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.858948    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-workload-certs\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.859112 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.859017    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d42b45a9-61fd-47bc-9855-20440e865b25-istio-podinfo\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.859112 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.859053    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-credential-socket\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.873212 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.873158    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqgw9\" (UniqueName: \"kubernetes.io/projected/d42b45a9-61fd-47bc-9855-20440e865b25-kube-api-access-hqgw9\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.873468 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.873272    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-istio-data\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.873468 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.873317    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d42b45a9-61fd-47bc-9855-20440e865b25-istiod-ca-cert\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.873468 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.873367    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-workload-socket\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.974540 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.974495    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-workload-certs\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.974540 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.974544    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d42b45a9-61fd-47bc-9855-20440e865b25-istio-podinfo\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.974825 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.974565    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-credential-socket\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.974825 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.974606    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqgw9\" (UniqueName: \"kubernetes.io/projected/d42b45a9-61fd-47bc-9855-20440e865b25-kube-api-access-hqgw9\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.974825 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.974633    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-istio-data\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.974825 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.974650    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d42b45a9-61fd-47bc-9855-20440e865b25-istiod-ca-cert\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.974825 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.974687    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-workload-socket\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.974825 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.974718    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d42b45a9-61fd-47bc-9855-20440e865b25-istio-token\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.974825 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.974758    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-istio-envoy\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.975212 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.975068    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-istio-data\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.975289 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.975264    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-credential-socket\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.975344 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.975314    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-workload-socket\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.975409 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.975390    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-workload-certs\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.976167 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.976144    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d42b45a9-61fd-47bc-9855-20440e865b25-istiod-ca-cert\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.978255 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.977587    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d42b45a9-61fd-47bc-9855-20440e865b25-istio-podinfo\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.978439 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.978420    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-istio-envoy\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.983415 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.983355    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d42b45a9-61fd-47bc-9855-20440e865b25-istio-token\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:32.983811 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:32.983789    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqgw9\" (UniqueName: \"kubernetes.io/projected/d42b45a9-61fd-47bc-9855-20440e865b25-kube-api-access-hqgw9\") pod \"e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") " pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:33.046921 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:33.046886    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:33.325645 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:33.325623    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"]
Sep 11 20:19:33.327662 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:19:33.327627    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42b45a9_61fd_47bc_9855_20440e865b25.slice/crio-038432c1d24c78a09145772803abf56ca31283e99263c777e239eb9caa2b8684 WatchSource:0}: Error finding container 038432c1d24c78a09145772803abf56ca31283e99263c777e239eb9caa2b8684: Status 404 returned error can't find the container with id 038432c1d24c78a09145772803abf56ca31283e99263c777e239eb9caa2b8684
Sep 11 20:19:33.330241 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:33.330208    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:19:33.330325 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:33.330277    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:19:33.330325 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:33.330313    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:19:34.072611 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:34.072575    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" event={"ID":"d42b45a9-61fd-47bc-9855-20440e865b25","Type":"ContainerStarted","Data":"517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd"}
Sep 11 20:19:34.073125 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:34.072636    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" event={"ID":"d42b45a9-61fd-47bc-9855-20440e865b25","Type":"ContainerStarted","Data":"038432c1d24c78a09145772803abf56ca31283e99263c777e239eb9caa2b8684"}
Sep 11 20:19:34.094371 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:34.094321    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" podStartSLOduration=2.094305352 podStartE2EDuration="2.094305352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:19:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:19:34.091323269 +0000 UTC m=+1159.252573535" watchObservedRunningTime="2026-09-11 20:19:34.094305352 +0000 UTC m=+1159.255555595"
Sep 11 20:19:35.047264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:35.047228    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:35.052501 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:35.052474    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:35.077648 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:35.077620    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:35.078443 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:35.078425    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:19:40.688113 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.688032    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"]
Sep 11 20:19:40.691228 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.691208    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:40.693792 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.693771    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d11bc81f-serving-cert\""
Sep 11 20:19:40.702397 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.702085    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"]
Sep 11 20:19:40.753022 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.752989    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-maas-api-tls\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:40.753188 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.753075    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bbde525-fb97-4c94-8925-f7259c7dd88c-openshift-service-ca\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:40.753188 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.753114    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l9jb\" (UniqueName: \"kubernetes.io/projected/5bbde525-fb97-4c94-8925-f7259c7dd88c-kube-api-access-5l9jb\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:40.753188 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.753142    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-metrics-certs\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:40.853766 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.853734    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-maas-api-tls\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:40.853940 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.853837    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bbde525-fb97-4c94-8925-f7259c7dd88c-openshift-service-ca\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:40.853940 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:19:40.853890    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-serving-cert: secret "maas-api-e2e-mt-d11bc81f-serving-cert" not found
Sep 11 20:19:40.853940 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.853901    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l9jb\" (UniqueName: \"kubernetes.io/projected/5bbde525-fb97-4c94-8925-f7259c7dd88c-kube-api-access-5l9jb\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:40.854154 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:19:40.853986    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-maas-api-tls podName:5bbde525-fb97-4c94-8925-f7259c7dd88c nodeName:}" failed. No retries permitted until 2026-09-11 20:19:41.353934455 +0000 UTC m=+1166.515184675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-maas-api-tls") pod "maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79" (UID: "5bbde525-fb97-4c94-8925-f7259c7dd88c") : secret "maas-api-e2e-mt-d11bc81f-serving-cert" not found
Sep 11 20:19:40.854154 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.854014    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-metrics-certs\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:40.854545 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.854518    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bbde525-fb97-4c94-8925-f7259c7dd88c-openshift-service-ca\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:40.856396 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.856373    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-metrics-certs\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:40.862537 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:40.862514    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l9jb\" (UniqueName: \"kubernetes.io/projected/5bbde525-fb97-4c94-8925-f7259c7dd88c-kube-api-access-5l9jb\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:41.358429 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:41.358396    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-maas-api-tls\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:41.358605 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:19:41.358559    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-serving-cert: secret "maas-api-e2e-mt-d11bc81f-serving-cert" not found
Sep 11 20:19:41.358652 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:19:41.358640    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-maas-api-tls podName:5bbde525-fb97-4c94-8925-f7259c7dd88c nodeName:}" failed. No retries permitted until 2026-09-11 20:19:42.358620836 +0000 UTC m=+1167.519871062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-maas-api-tls") pod "maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79" (UID: "5bbde525-fb97-4c94-8925-f7259c7dd88c") : secret "maas-api-e2e-mt-d11bc81f-serving-cert" not found
Sep 11 20:19:42.373415 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:42.373369    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-maas-api-tls\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:42.375758 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:42.375737    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-maas-api-tls\") pod \"maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:42.507007 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:42.506972    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:42.780236 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:42.780211    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"]
Sep 11 20:19:42.782216 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:19:42.782179    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bbde525_fb97_4c94_8925_f7259c7dd88c.slice/crio-3eb8320c3132820bbb7a8d58243653db292833b98f0b81146dd0ff88c0e89c3d WatchSource:0}: Error finding container 3eb8320c3132820bbb7a8d58243653db292833b98f0b81146dd0ff88c0e89c3d: Status 404 returned error can't find the container with id 3eb8320c3132820bbb7a8d58243653db292833b98f0b81146dd0ff88c0e89c3d
Sep 11 20:19:43.126211 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:43.126176    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79" event={"ID":"5bbde525-fb97-4c94-8925-f7259c7dd88c","Type":"ContainerStarted","Data":"3eb8320c3132820bbb7a8d58243653db292833b98f0b81146dd0ff88c0e89c3d"}
Sep 11 20:19:44.133321 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:44.133284    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79" event={"ID":"5bbde525-fb97-4c94-8925-f7259c7dd88c","Type":"ContainerStarted","Data":"042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca"}
Sep 11 20:19:44.133720 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:44.133345    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:19:44.153310 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:44.153257    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79" podStartSLOduration=3.74981893 podStartE2EDuration="4.153239692s" totalImagesPullingTime="403.420762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:19:44.150224728 +0000 UTC m=+1169.311474970" watchObservedRunningTime="2026-09-11 20:19:44.153239692 +0000 UTC m=+1169.314489933"
Sep 11 20:19:50.147941 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:19:50.147908    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:20:13.300187 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:13.300153    2585 generic.go:356] "Generic (PLEG): container finished" podID="d42b45a9-61fd-47bc-9855-20440e865b25" containerID="517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd" exitCode=0
Sep 11 20:20:13.300617 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:13.300196    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" event={"ID":"d42b45a9-61fd-47bc-9855-20440e865b25","Type":"ContainerDied","Data":"517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd"}
Sep 11 20:20:13.300617 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:13.300574    2585 scope.go:117] "RemoveContainer" containerID="517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd"
Sep 11 20:20:13.301725 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:13.301662    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:20:13.301816 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:13.301726    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:20:13.301816 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:13.301757    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:20:14.307252 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:14.307215    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" event={"ID":"d42b45a9-61fd-47bc-9855-20440e865b25","Type":"ContainerStarted","Data":"b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444"}
Sep 11 20:20:15.048081 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:15.048046    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:20:15.048290 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:15.048182    2585 patch_prober.go:28] interesting pod/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 20:20:15.048290 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:15.048237    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 20:20:15.395968 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:15.395924    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:20:15.398752 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:15.398730    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:20:16.047618 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:16.047579    2585 patch_prober.go:28] interesting pod/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 20:20:16.047833 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:16.047649    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 20:20:17.047884 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:17.047836    2585 patch_prober.go:28] interesting pod/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 20:20:17.048438 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:17.047925    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 20:20:18.048367 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:18.048331    2585 patch_prober.go:28] interesting pod/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 20:20:18.048997 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:18.048938    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 20:20:19.047569 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:19.047528    2585 patch_prober.go:28] interesting pod/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 20:20:19.047898 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:19.047870    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 20:20:20.051381 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:20.051344    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:20:20.051794 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:20.051772    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:20:20.052630 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:20.052606    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:20:47.016625 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:47.016587    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"]
Sep 11 20:20:47.017291 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:47.016788    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy" containerID="cri-o://de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9" gracePeriod=30
Sep 11 20:20:52.268415 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.268390    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:20:52.313542 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.313475    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-credential-socket\") pod \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") "
Sep 11 20:20:52.313542 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.313505    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-token\") pod \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") "
Sep 11 20:20:52.313542 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.313525    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istiod-ca-cert\") pod \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") "
Sep 11 20:20:52.313542 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.313541    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-envoy\") pod \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") "
Sep 11 20:20:52.313812 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.313755    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jfwg\" (UniqueName: \"kubernetes.io/projected/4e2e5a77-1709-41bc-a41d-d1ac31a77698-kube-api-access-8jfwg\") pod \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") "
Sep 11 20:20:52.313890 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.313873    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-data\") pod \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") "
Sep 11 20:20:52.313965 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.313915    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-workload-socket\") pod \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") "
Sep 11 20:20:52.314020 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.313868    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4e2e5a77-1709-41bc-a41d-d1ac31a77698" (UID: "4e2e5a77-1709-41bc-a41d-d1ac31a77698"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:20:52.314020 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.313943    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4e2e5a77-1709-41bc-a41d-d1ac31a77698" (UID: "4e2e5a77-1709-41bc-a41d-d1ac31a77698"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:20:52.314136 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.314018    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-workload-certs\") pod \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") "
Sep 11 20:20:52.314136 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.314071    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-podinfo\") pod \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\" (UID: \"4e2e5a77-1709-41bc-a41d-d1ac31a77698\") "
Sep 11 20:20:52.314136 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.314095    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-data" (OuterVolumeSpecName: "istio-data") pod "4e2e5a77-1709-41bc-a41d-d1ac31a77698" (UID: "4e2e5a77-1709-41bc-a41d-d1ac31a77698"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:20:52.314279 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.314250    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4e2e5a77-1709-41bc-a41d-d1ac31a77698" (UID: "4e2e5a77-1709-41bc-a41d-d1ac31a77698"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:20:52.314279 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.314263    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4e2e5a77-1709-41bc-a41d-d1ac31a77698" (UID: "4e2e5a77-1709-41bc-a41d-d1ac31a77698"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:20:52.314512 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.314482    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:52.314606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.314513    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:52.314606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.314528    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:52.314606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.314542    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:52.314606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.314555    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:52.315878 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.315851    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4e2e5a77-1709-41bc-a41d-d1ac31a77698" (UID: "4e2e5a77-1709-41bc-a41d-d1ac31a77698"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:20:52.316198 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.316163    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4e2e5a77-1709-41bc-a41d-d1ac31a77698" (UID: "4e2e5a77-1709-41bc-a41d-d1ac31a77698"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:20:52.316312 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.316286    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e2e5a77-1709-41bc-a41d-d1ac31a77698-kube-api-access-8jfwg" (OuterVolumeSpecName: "kube-api-access-8jfwg") pod "4e2e5a77-1709-41bc-a41d-d1ac31a77698" (UID: "4e2e5a77-1709-41bc-a41d-d1ac31a77698"). InnerVolumeSpecName "kube-api-access-8jfwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:20:52.316498 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.316475    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e2e5a77-1709-41bc-a41d-d1ac31a77698" (UID: "4e2e5a77-1709-41bc-a41d-d1ac31a77698"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:20:52.416310 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.416283    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:52.416452 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.416314    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jfwg\" (UniqueName: \"kubernetes.io/projected/4e2e5a77-1709-41bc-a41d-d1ac31a77698-kube-api-access-8jfwg\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:52.416452 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.416330    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:52.416452 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.416345    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e2e5a77-1709-41bc-a41d-d1ac31a77698-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:52.519422 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.519392    2585 generic.go:356] "Generic (PLEG): container finished" podID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerID="de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9" exitCode=0
Sep 11 20:20:52.519579 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.519434    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"
Sep 11 20:20:52.519579 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.519466    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" event={"ID":"4e2e5a77-1709-41bc-a41d-d1ac31a77698","Type":"ContainerDied","Data":"de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9"}
Sep 11 20:20:52.519579 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.519505    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f" event={"ID":"4e2e5a77-1709-41bc-a41d-d1ac31a77698","Type":"ContainerDied","Data":"1a1745dca747dbf76e6b93d5702f29d756b2a44614d82370d435d2b7cb4f4125"}
Sep 11 20:20:52.519579 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.519527    2585 scope.go:117] "RemoveContainer" containerID="de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9"
Sep 11 20:20:52.529018 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.529001    2585 scope.go:117] "RemoveContainer" containerID="0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6"
Sep 11 20:20:52.537041 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.537022    2585 scope.go:117] "RemoveContainer" containerID="de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9"
Sep 11 20:20:52.537285 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:20:52.537266    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9\": container with ID starting with de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9 not found: ID does not exist" containerID="de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9"
Sep 11 20:20:52.537351 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.537291    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9"} err="failed to get container status \"de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9\": rpc error: code = NotFound desc = could not find container \"de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9\": container with ID starting with de6d3da04d625501036466a3369f6b8549cc7e0ac165f279854208553f1126a9 not found: ID does not exist"
Sep 11 20:20:52.537351 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.537306    2585 scope.go:117] "RemoveContainer" containerID="0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6"
Sep 11 20:20:52.537564 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:20:52.537542    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6\": container with ID starting with 0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6 not found: ID does not exist" containerID="0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6"
Sep 11 20:20:52.537681 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.537567    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6"} err="failed to get container status \"0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6\": rpc error: code = NotFound desc = could not find container \"0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6\": container with ID starting with 0a76610814e7adf78b6f67f5b2cea9995780591598532d941e67b76bbac390f6 not found: ID does not exist"
Sep 11 20:20:52.544049 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.544029    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"]
Sep 11 20:20:52.548051 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:52.548027    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-b3e1dd-openshift-default-585cb6db5b-2zb9f"]
Sep 11 20:20:53.350595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:53.350563    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" path="/var/lib/kubelet/pods/4e2e5a77-1709-41bc-a41d-d1ac31a77698/volumes"
Sep 11 20:20:57.943525 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:57.943486    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"]
Sep 11 20:20:57.944031 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:57.943699    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9" podUID="523159c5-afc1-4a65-a4cb-e3c30c2b364d" containerName="maas-api" containerID="cri-o://d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327" gracePeriod=30
Sep 11 20:20:58.181907 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.181885    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:20:58.276621 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.276540    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpbm6\" (UniqueName: \"kubernetes.io/projected/523159c5-afc1-4a65-a4cb-e3c30c2b364d-kube-api-access-mpbm6\") pod \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") "
Sep 11 20:20:58.276762 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.276623    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-metrics-certs\") pod \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") "
Sep 11 20:20:58.276815 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.276779    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/523159c5-afc1-4a65-a4cb-e3c30c2b364d-openshift-service-ca\") pod \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") "
Sep 11 20:20:58.276861 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.276832    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls\") pod \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\" (UID: \"523159c5-afc1-4a65-a4cb-e3c30c2b364d\") "
Sep 11 20:20:58.277113 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.277086    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/523159c5-afc1-4a65-a4cb-e3c30c2b364d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "523159c5-afc1-4a65-a4cb-e3c30c2b364d" (UID: "523159c5-afc1-4a65-a4cb-e3c30c2b364d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:20:58.277255 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.277240    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/523159c5-afc1-4a65-a4cb-e3c30c2b364d-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:58.278818 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.278792    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "523159c5-afc1-4a65-a4cb-e3c30c2b364d" (UID: "523159c5-afc1-4a65-a4cb-e3c30c2b364d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:20:58.279188 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.279162    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "523159c5-afc1-4a65-a4cb-e3c30c2b364d" (UID: "523159c5-afc1-4a65-a4cb-e3c30c2b364d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:20:58.279290 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.279192    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/523159c5-afc1-4a65-a4cb-e3c30c2b364d-kube-api-access-mpbm6" (OuterVolumeSpecName: "kube-api-access-mpbm6") pod "523159c5-afc1-4a65-a4cb-e3c30c2b364d" (UID: "523159c5-afc1-4a65-a4cb-e3c30c2b364d"). InnerVolumeSpecName "kube-api-access-mpbm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:20:58.378139 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.378105    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpbm6\" (UniqueName: \"kubernetes.io/projected/523159c5-afc1-4a65-a4cb-e3c30c2b364d-kube-api-access-mpbm6\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:58.378139 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.378131    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:58.378356 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.378209    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/523159c5-afc1-4a65-a4cb-e3c30c2b364d-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:20:58.552220 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.552122    2585 generic.go:356] "Generic (PLEG): container finished" podID="523159c5-afc1-4a65-a4cb-e3c30c2b364d" containerID="d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327" exitCode=0
Sep 11 20:20:58.552220 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.552178    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"
Sep 11 20:20:58.552220 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.552196    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9" event={"ID":"523159c5-afc1-4a65-a4cb-e3c30c2b364d","Type":"ContainerDied","Data":"d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327"}
Sep 11 20:20:58.552498 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.552247    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9" event={"ID":"523159c5-afc1-4a65-a4cb-e3c30c2b364d","Type":"ContainerDied","Data":"19005c5e8c41161da831f2f5db71042d16fbd567b10113f10320ea57843415bd"}
Sep 11 20:20:58.552498 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.552277    2585 scope.go:117] "RemoveContainer" containerID="d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327"
Sep 11 20:20:58.561929 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.561911    2585 scope.go:117] "RemoveContainer" containerID="d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327"
Sep 11 20:20:58.562291 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:20:58.562273    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327\": container with ID starting with d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327 not found: ID does not exist" containerID="d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327"
Sep 11 20:20:58.562336 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.562300    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327"} err="failed to get container status \"d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327\": rpc error: code = NotFound desc = could not find container \"d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327\": container with ID starting with d9d3591423bd9d6fb453cb67d48775d00e777a4157da74dc266b5bd712516327 not found: ID does not exist"
Sep 11 20:20:58.574451 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.574424    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"]
Sep 11 20:20:58.578106 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:58.578086    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4f9558-594749478b-jxhz9"]
Sep 11 20:20:59.349566 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:20:59.349533    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="523159c5-afc1-4a65-a4cb-e3c30c2b364d" path="/var/lib/kubelet/pods/523159c5-afc1-4a65-a4cb-e3c30c2b364d/volumes"
Sep 11 20:21:04.585307 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:04.585275    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"]
Sep 11 20:21:04.585751 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:04.585466    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy" containerID="cri-o://16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad" gracePeriod=30
Sep 11 20:21:06.505467 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:06.505431    2585 patch_prober.go:28] interesting pod/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 20:21:06.505829 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:06.505490    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 20:21:09.849034 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.848974    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:21:09.996155 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996126    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-credential-socket\") pod \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") "
Sep 11 20:21:09.996324 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996218    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-workload-socket\") pod \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") "
Sep 11 20:21:09.996324 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996271    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-workload-certs\") pod \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") "
Sep 11 20:21:09.996405 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996323    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-envoy\") pod \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") "
Sep 11 20:21:09.996405 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996376    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istiod-ca-cert\") pod \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") "
Sep 11 20:21:09.996520 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996402    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-podinfo\") pod \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") "
Sep 11 20:21:09.996520 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996407    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a89f095-92c7-4564-9cfb-43bd0c4f17d8" (UID: "1a89f095-92c7-4564-9cfb-43bd0c4f17d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:09.996520 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996431    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-data\") pod \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") "
Sep 11 20:21:09.996696 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996522    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-token\") pod \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") "
Sep 11 20:21:09.996696 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996537    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a89f095-92c7-4564-9cfb-43bd0c4f17d8" (UID: "1a89f095-92c7-4564-9cfb-43bd0c4f17d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:09.996696 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996560    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-585t4\" (UniqueName: \"kubernetes.io/projected/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-kube-api-access-585t4\") pod \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\" (UID: \"1a89f095-92c7-4564-9cfb-43bd0c4f17d8\") "
Sep 11 20:21:09.996696 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996609    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a89f095-92c7-4564-9cfb-43bd0c4f17d8" (UID: "1a89f095-92c7-4564-9cfb-43bd0c4f17d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:09.996696 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996632    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a89f095-92c7-4564-9cfb-43bd0c4f17d8" (UID: "1a89f095-92c7-4564-9cfb-43bd0c4f17d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:09.996948 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.996749    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a89f095-92c7-4564-9cfb-43bd0c4f17d8" (UID: "1a89f095-92c7-4564-9cfb-43bd0c4f17d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:21:09.997056 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.997038    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:09.997119 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.997061    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:09.997119 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.997074    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:09.997119 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.997088    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:09.997119 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.997102    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:09.998532 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.998503    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a89f095-92c7-4564-9cfb-43bd0c4f17d8" (UID: "1a89f095-92c7-4564-9cfb-43bd0c4f17d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:09.998650 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.998619    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a89f095-92c7-4564-9cfb-43bd0c4f17d8" (UID: "1a89f095-92c7-4564-9cfb-43bd0c4f17d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:21:09.998897 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.998870    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a89f095-92c7-4564-9cfb-43bd0c4f17d8" (UID: "1a89f095-92c7-4564-9cfb-43bd0c4f17d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:21:09.999034 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:09.998934    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-kube-api-access-585t4" (OuterVolumeSpecName: "kube-api-access-585t4") pod "1a89f095-92c7-4564-9cfb-43bd0c4f17d8" (UID: "1a89f095-92c7-4564-9cfb-43bd0c4f17d8"). InnerVolumeSpecName "kube-api-access-585t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:21:10.098032 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.098002    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:10.098032 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.098027    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:10.098032 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.098036    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:10.098254 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.098044    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-585t4\" (UniqueName: \"kubernetes.io/projected/1a89f095-92c7-4564-9cfb-43bd0c4f17d8-kube-api-access-585t4\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:10.617395 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.617357    2585 generic.go:356] "Generic (PLEG): container finished" podID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerID="16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad" exitCode=0
Sep 11 20:21:10.617598 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.617407    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"
Sep 11 20:21:10.617598 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.617416    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" event={"ID":"1a89f095-92c7-4564-9cfb-43bd0c4f17d8","Type":"ContainerDied","Data":"16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad"}
Sep 11 20:21:10.617598 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.617470    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d" event={"ID":"1a89f095-92c7-4564-9cfb-43bd0c4f17d8","Type":"ContainerDied","Data":"55281bbc76e14ee159efeb0328918228f7008b3340ced0084f9a23321078a5c1"}
Sep 11 20:21:10.617598 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.617493    2585 scope.go:117] "RemoveContainer" containerID="16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad"
Sep 11 20:21:10.627026 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.627006    2585 scope.go:117] "RemoveContainer" containerID="ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde"
Sep 11 20:21:10.635278 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.635261    2585 scope.go:117] "RemoveContainer" containerID="16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad"
Sep 11 20:21:10.635549 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:21:10.635529    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad\": container with ID starting with 16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad not found: ID does not exist" containerID="16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad"
Sep 11 20:21:10.635599 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.635557    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad"} err="failed to get container status \"16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad\": rpc error: code = NotFound desc = could not find container \"16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad\": container with ID starting with 16f1712046d19028102dd03dd4472ec48bfe16d2cf8fde52018d8b8ecaca97ad not found: ID does not exist"
Sep 11 20:21:10.635599 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.635572    2585 scope.go:117] "RemoveContainer" containerID="ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde"
Sep 11 20:21:10.635844 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:21:10.635824    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde\": container with ID starting with ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde not found: ID does not exist" containerID="ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde"
Sep 11 20:21:10.635890 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.635861    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde"} err="failed to get container status \"ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde\": rpc error: code = NotFound desc = could not find container \"ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde\": container with ID starting with ee392b4f6a8e33785af52ca6920ab6ea2e0e41354cf327204785ada5e457ebde not found: ID does not exist"
Sep 11 20:21:10.638998 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.638977    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"]
Sep 11 20:21:10.641401 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:10.641383    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4f9558-openshift-default-57cf774ffd-b6l9d"]
Sep 11 20:21:11.351546 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:11.351507    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" path="/var/lib/kubelet/pods/1a89f095-92c7-4564-9cfb-43bd0c4f17d8/volumes"
Sep 11 20:21:12.922822 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.922783    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"]
Sep 11 20:21:12.923428 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923406    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy"
Sep 11 20:21:12.923506 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923432    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy"
Sep 11 20:21:12.923506 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923457    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="523159c5-afc1-4a65-a4cb-e3c30c2b364d" containerName="maas-api"
Sep 11 20:21:12.923506 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923466    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="523159c5-afc1-4a65-a4cb-e3c30c2b364d" containerName="maas-api"
Sep 11 20:21:12.923506 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923497    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy"
Sep 11 20:21:12.923506 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923505    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy"
Sep 11 20:21:12.923785 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923516    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy"
Sep 11 20:21:12.923785 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923523    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy"
Sep 11 20:21:12.923785 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923632    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy"
Sep 11 20:21:12.923785 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923644    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy"
Sep 11 20:21:12.923785 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923651    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy"
Sep 11 20:21:12.923785 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923663    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e2e5a77-1709-41bc-a41d-d1ac31a77698" containerName="istio-proxy"
Sep 11 20:21:12.923785 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.923674    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="523159c5-afc1-4a65-a4cb-e3c30c2b364d" containerName="maas-api"
Sep 11 20:21:12.927990 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.927973    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:12.930444 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.930420    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-fcb0e4-serving-cert\""
Sep 11 20:21:12.939607 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:12.939582    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"]
Sep 11 20:21:13.028083 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.028050    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjhlv\" (UniqueName: \"kubernetes.io/projected/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-kube-api-access-fjhlv\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.028228 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.028158    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.028228 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.028190    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.028228 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.028221    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.129570 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.129529    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.129763 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.129590    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.129763 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.129631    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.129763 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.129687    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjhlv\" (UniqueName: \"kubernetes.io/projected/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-kube-api-access-fjhlv\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.129947 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:21:13.129807    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-serving-cert: secret "maas-api-e2e-shared-a-w3-fcb0e4-serving-cert" not found
Sep 11 20:21:13.129947 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:21:13.129875    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-maas-api-tls podName:b850fadc-dbe5-4c94-ad3a-45fe81021b8f nodeName:}" failed. No retries permitted until 2026-09-11 20:21:13.629858051 +0000 UTC m=+1258.791108272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-maas-api-tls") pod "maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs" (UID: "b850fadc-dbe5-4c94-ad3a-45fe81021b8f") : secret "maas-api-e2e-shared-a-w3-fcb0e4-serving-cert" not found
Sep 11 20:21:13.130243 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.130224    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.132264 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.132243    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.138573 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.138549    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjhlv\" (UniqueName: \"kubernetes.io/projected/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-kube-api-access-fjhlv\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.634444 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.634414    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.636554 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.636535    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:13.841104 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:13.841070    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:14.114153 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:14.114127    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"]
Sep 11 20:21:14.115752 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:21:14.115725    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb850fadc_dbe5_4c94_ad3a_45fe81021b8f.slice/crio-a931eb5b790ae77644d5005a3b5b30c0dbb28b6d95b04470c53080373889ca61 WatchSource:0}: Error finding container a931eb5b790ae77644d5005a3b5b30c0dbb28b6d95b04470c53080373889ca61: Status 404 returned error can't find the container with id a931eb5b790ae77644d5005a3b5b30c0dbb28b6d95b04470c53080373889ca61
Sep 11 20:21:14.638985 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:14.638937    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs" event={"ID":"b850fadc-dbe5-4c94-ad3a-45fe81021b8f","Type":"ContainerStarted","Data":"a931eb5b790ae77644d5005a3b5b30c0dbb28b6d95b04470c53080373889ca61"}
Sep 11 20:21:15.438028 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:15.438001    2585 scope.go:117] "RemoveContainer" containerID="b9982ed5c467436cec6d5e9c56ac966de899964161536620cc5bd14c0cdf66ce"
Sep 11 20:21:15.645366 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:15.645334    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs" event={"ID":"b850fadc-dbe5-4c94-ad3a-45fe81021b8f","Type":"ContainerStarted","Data":"163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e"}
Sep 11 20:21:15.645544 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:15.645421    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:15.662777 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:15.662733    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs" podStartSLOduration=3.150452054 podStartE2EDuration="3.662718659s" totalImagesPullingTime="512.266605ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:21:15.661798835 +0000 UTC m=+1260.823049078" watchObservedRunningTime="2026-09-11 20:21:15.662718659 +0000 UTC m=+1260.823968902"
Sep 11 20:21:21.655989 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:21.655946    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:21:28.274162 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:28.274127    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"]
Sep 11 20:21:34.030538 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.030497    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"]
Sep 11 20:21:34.360236 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.360202    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"]
Sep 11 20:21:34.362345 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.361181    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy"
Sep 11 20:21:34.362345 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.361206    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a89f095-92c7-4564-9cfb-43bd0c4f17d8" containerName="istio-proxy"
Sep 11 20:21:34.375698 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.375674    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.376704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.376674    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"]
Sep 11 20:21:34.379015 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.378992    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-092e1a-openshift-default-dockercfg-mjnvz\""
Sep 11 20:21:34.431670 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.431635    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-data\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.431821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.431672    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t5mn\" (UniqueName: \"kubernetes.io/projected/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-kube-api-access-7t5mn\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.431821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.431713    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-token\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.431821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.431751    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-podinfo\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.431821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.431773    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-workload-socket\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.431821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.431796    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-workload-certs\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.432145 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.431872    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-credential-socket\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.432145 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.431917    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istiod-ca-cert\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.432145 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.431987    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-envoy\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.533381 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.533344    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istiod-ca-cert\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.533564 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.533398    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-envoy\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.533564 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.533424    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-data\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.533564 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.533446    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t5mn\" (UniqueName: \"kubernetes.io/projected/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-kube-api-access-7t5mn\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.533564 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.533480    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-token\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.533564 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.533522    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-podinfo\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.533564 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.533555    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-workload-socket\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.533903 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.533580    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-workload-certs\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.533903 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.533642    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-credential-socket\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.534053 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.534012    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-data\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.534208 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.534184    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-workload-socket\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.534285 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.534222    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-credential-socket\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.534285 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.534241    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-workload-certs\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.534405 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.534355    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istiod-ca-cert\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.535922 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.535899    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-envoy\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.536069 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.536050    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-podinfo\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.543725 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.543698    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-token\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.543821 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.543801    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t5mn\" (UniqueName: \"kubernetes.io/projected/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-kube-api-access-7t5mn\") pod \"e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") " pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.688255 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.688166    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:34.968255 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.968225    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"]
Sep 11 20:21:34.970528 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:21:34.970501    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7479543d_c2a6_4b6d_bb39_1aaa2aa6853a.slice/crio-1cd67986da2824048d35585b9220b7f70d865884d905a1ac73508ee473e40b87 WatchSource:0}: Error finding container 1cd67986da2824048d35585b9220b7f70d865884d905a1ac73508ee473e40b87: Status 404 returned error can't find the container with id 1cd67986da2824048d35585b9220b7f70d865884d905a1ac73508ee473e40b87
Sep 11 20:21:34.972883 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.972846    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:21:34.973008 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.972930    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:21:34.973008 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:34.972973    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:21:35.762661 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:35.762627    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" event={"ID":"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a","Type":"ContainerStarted","Data":"11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4"}
Sep 11 20:21:35.763074 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:35.762681    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" event={"ID":"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a","Type":"ContainerStarted","Data":"1cd67986da2824048d35585b9220b7f70d865884d905a1ac73508ee473e40b87"}
Sep 11 20:21:35.784392 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:35.784344    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" podStartSLOduration=1.784330561 podStartE2EDuration="1.784330561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:21:35.782693584 +0000 UTC m=+1280.943943845" watchObservedRunningTime="2026-09-11 20:21:35.784330561 +0000 UTC m=+1280.945580802"
Sep 11 20:21:36.689176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:36.689145    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:36.694199 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:36.694176    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:36.767451 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:36.767430    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:36.768285 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:36.768266    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:21:40.194710 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.194679    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"]
Sep 11 20:21:40.198776 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.198756    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.201691 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.201669    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-092e1a-serving-cert\""
Sep 11 20:21:40.208811 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.208785    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"]
Sep 11 20:21:40.292416 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.292386    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/726e130a-b8c6-4141-97a4-16d783f66b22-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.292416 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.292416    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltkfx\" (UniqueName: \"kubernetes.io/projected/726e130a-b8c6-4141-97a4-16d783f66b22-kube-api-access-ltkfx\") pod \"maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.292593 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.292446    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/726e130a-b8c6-4141-97a4-16d783f66b22-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.292593 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.292540    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/726e130a-b8c6-4141-97a4-16d783f66b22-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.393390 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.393349    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/726e130a-b8c6-4141-97a4-16d783f66b22-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.393589 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.393455    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/726e130a-b8c6-4141-97a4-16d783f66b22-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.393589 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.393481    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltkfx\" (UniqueName: \"kubernetes.io/projected/726e130a-b8c6-4141-97a4-16d783f66b22-kube-api-access-ltkfx\") pod \"maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.393589 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.393521    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/726e130a-b8c6-4141-97a4-16d783f66b22-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.394209 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.394186    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/726e130a-b8c6-4141-97a4-16d783f66b22-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.395868 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.395848    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/726e130a-b8c6-4141-97a4-16d783f66b22-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.395932 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.395917    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/726e130a-b8c6-4141-97a4-16d783f66b22-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.403816 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.403797    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltkfx\" (UniqueName: \"kubernetes.io/projected/726e130a-b8c6-4141-97a4-16d783f66b22-kube-api-access-ltkfx\") pod \"maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.514746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.514674    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:40.793933 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:40.793910    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"]
Sep 11 20:21:40.795564 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:21:40.795538    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726e130a_b8c6_4141_97a4_16d783f66b22.slice/crio-3a2d4fc73189984cd8848dad53253d7176a62f61fb6028be860009c29105cf51 WatchSource:0}: Error finding container 3a2d4fc73189984cd8848dad53253d7176a62f61fb6028be860009c29105cf51: Status 404 returned error can't find the container with id 3a2d4fc73189984cd8848dad53253d7176a62f61fb6028be860009c29105cf51
Sep 11 20:21:41.797471 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:41.797437    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x" event={"ID":"726e130a-b8c6-4141-97a4-16d783f66b22","Type":"ContainerStarted","Data":"0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f"}
Sep 11 20:21:41.797984 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:41.797490    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x" event={"ID":"726e130a-b8c6-4141-97a4-16d783f66b22","Type":"ContainerStarted","Data":"3a2d4fc73189984cd8848dad53253d7176a62f61fb6028be860009c29105cf51"}
Sep 11 20:21:41.797984 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:41.797517    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:41.816921 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:41.816870    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x" podStartSLOduration=1.465450085 podStartE2EDuration="1.816855474s" totalImagesPullingTime="351.405389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:21:41.815836304 +0000 UTC m=+1286.977086545" watchObservedRunningTime="2026-09-11 20:21:41.816855474 +0000 UTC m=+1286.978105731"
Sep 11 20:21:43.293375 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.293335    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6" podUID="02bd5bb1-73b0-47b8-9f52-1e238ed7a93f" containerName="main" containerID="cri-o://527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172" gracePeriod=45
Sep 11 20:21:43.557131 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.557075    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:21:43.625380 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.625355    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-dshm\") pod \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") "
Sep 11 20:21:43.625530 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.625415    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tjtg\" (UniqueName: \"kubernetes.io/projected/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-kube-api-access-8tjtg\") pod \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") "
Sep 11 20:21:43.625530 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.625458    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-model-cache\") pod \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") "
Sep 11 20:21:43.625530 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.625485    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-home\") pod \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") "
Sep 11 20:21:43.625648 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.625549    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-tmp-dir\") pod \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") "
Sep 11 20:21:43.625648 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.625584    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-tls-certs\") pod \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\" (UID: \"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f\") "
Sep 11 20:21:43.625800 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.625710    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-model-cache" (OuterVolumeSpecName: "model-cache") pod "02bd5bb1-73b0-47b8-9f52-1e238ed7a93f" (UID: "02bd5bb1-73b0-47b8-9f52-1e238ed7a93f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:43.625860 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.625802    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-home" (OuterVolumeSpecName: "home") pod "02bd5bb1-73b0-47b8-9f52-1e238ed7a93f" (UID: "02bd5bb1-73b0-47b8-9f52-1e238ed7a93f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:43.625860 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.625824    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "02bd5bb1-73b0-47b8-9f52-1e238ed7a93f" (UID: "02bd5bb1-73b0-47b8-9f52-1e238ed7a93f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:43.625992 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.625940    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-model-cache\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:43.625992 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.625968    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-home\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:43.625992 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.625979    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-tmp-dir\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:43.627603 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.627576    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "02bd5bb1-73b0-47b8-9f52-1e238ed7a93f" (UID: "02bd5bb1-73b0-47b8-9f52-1e238ed7a93f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:21:43.627716 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.627583    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-dshm" (OuterVolumeSpecName: "dshm") pod "02bd5bb1-73b0-47b8-9f52-1e238ed7a93f" (UID: "02bd5bb1-73b0-47b8-9f52-1e238ed7a93f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:43.627716 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.627604    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-kube-api-access-8tjtg" (OuterVolumeSpecName: "kube-api-access-8tjtg") pod "02bd5bb1-73b0-47b8-9f52-1e238ed7a93f" (UID: "02bd5bb1-73b0-47b8-9f52-1e238ed7a93f"). InnerVolumeSpecName "kube-api-access-8tjtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:21:43.727478 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.727431    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tjtg\" (UniqueName: \"kubernetes.io/projected/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-kube-api-access-8tjtg\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:43.727478 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.727472    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-tls-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:43.727478 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.727482    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f-dshm\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:43.816918 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.816811    2585 generic.go:356] "Generic (PLEG): container finished" podID="02bd5bb1-73b0-47b8-9f52-1e238ed7a93f" containerID="527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172" exitCode=0
Sep 11 20:21:43.816918 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.816862    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"
Sep 11 20:21:43.817119 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.816927    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6" event={"ID":"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f","Type":"ContainerDied","Data":"527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172"}
Sep 11 20:21:43.817119 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.817004    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6" event={"ID":"02bd5bb1-73b0-47b8-9f52-1e238ed7a93f","Type":"ContainerDied","Data":"5042305bb67bc231bf4dcd16ceb124d699a68295be2d165b1d75e7f2cd41dc2f"}
Sep 11 20:21:43.817119 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.817029    2585 scope.go:117] "RemoveContainer" containerID="527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172"
Sep 11 20:21:43.826092 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.826075    2585 scope.go:117] "RemoveContainer" containerID="527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172"
Sep 11 20:21:43.826320 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:21:43.826298    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172\": container with ID starting with 527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172 not found: ID does not exist" containerID="527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172"
Sep 11 20:21:43.826389 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.826332    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172"} err="failed to get container status \"527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172\": rpc error: code = NotFound desc = could not find container \"527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172\": container with ID starting with 527efe644b998a18570bbec5242f8421bffdaaa51e7ea2c80fb3ed4f1e35d172 not found: ID does not exist"
Sep 11 20:21:43.839330 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.839304    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"]
Sep 11 20:21:43.841337 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:43.841317    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-22fc84/e2e-conflict-a-cb87ecd4-kserve-66d67685b9-kg4l6"]
Sep 11 20:21:45.349908 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:45.349878    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02bd5bb1-73b0-47b8-9f52-1e238ed7a93f" path="/var/lib/kubelet/pods/02bd5bb1-73b0-47b8-9f52-1e238ed7a93f/volumes"
Sep 11 20:21:47.808914 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:47.808884    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:21:49.051663 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.051616    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn" podUID="3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef" containerName="main" containerID="cri-o://547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144" gracePeriod=45
Sep 11 20:21:49.312201 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.312134    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:21:49.388185 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.388155    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-model-cache\") pod \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") "
Sep 11 20:21:49.388347 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.388221    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-tls-certs\") pod \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") "
Sep 11 20:21:49.388347 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.388257    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-home\") pod \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") "
Sep 11 20:21:49.388476 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.388422    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-dshm\") pod \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") "
Sep 11 20:21:49.388476 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.388468    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpm7v\" (UniqueName: \"kubernetes.io/projected/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-kube-api-access-zpm7v\") pod \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") "
Sep 11 20:21:49.388606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.388582    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-tmp-dir\") pod \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\" (UID: \"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef\") "
Sep 11 20:21:49.388606 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.388425    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef" (UID: "3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:49.388736 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.388525    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-home" (OuterVolumeSpecName: "home") pod "3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef" (UID: "3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:49.388920 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.388896    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef" (UID: "3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:49.389024 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.389005    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-model-cache\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:49.389091 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.389027    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-home\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:49.390697 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.390666    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-dshm" (OuterVolumeSpecName: "dshm") pod "3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef" (UID: "3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:21:49.390697 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.390687    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-kube-api-access-zpm7v" (OuterVolumeSpecName: "kube-api-access-zpm7v") pod "3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef" (UID: "3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef"). InnerVolumeSpecName "kube-api-access-zpm7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:21:49.390835 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.390715    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef" (UID: "3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:21:49.490359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.490322    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-dshm\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:49.490359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.490352    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpm7v\" (UniqueName: \"kubernetes.io/projected/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-kube-api-access-zpm7v\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:49.490359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.490362    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-tmp-dir\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:49.490607 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.490373    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef-tls-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:21:49.857316 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.857281    2585 generic.go:356] "Generic (PLEG): container finished" podID="3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef" containerID="547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144" exitCode=0
Sep 11 20:21:49.857495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.857333    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"
Sep 11 20:21:49.857495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.857370    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn" event={"ID":"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef","Type":"ContainerDied","Data":"547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144"}
Sep 11 20:21:49.857495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.857416    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn" event={"ID":"3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef","Type":"ContainerDied","Data":"6f4057a0d1e1342a739d250405f5a3754b592ed93a638a6b04ef0326e768269f"}
Sep 11 20:21:49.857495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.857435    2585 scope.go:117] "RemoveContainer" containerID="547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144"
Sep 11 20:21:49.868235 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.868216    2585 scope.go:117] "RemoveContainer" containerID="547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144"
Sep 11 20:21:49.868819 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:21:49.868789    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144\": container with ID starting with 547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144 not found: ID does not exist" containerID="547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144"
Sep 11 20:21:49.869016 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.868987    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144"} err="failed to get container status \"547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144\": rpc error: code = NotFound desc = could not find container \"547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144\": container with ID starting with 547d76b4d85fbf8f8284172d927159b1991a5fa7785938f3d3212c8113b8a144 not found: ID does not exist"
Sep 11 20:21:49.882921 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.882894    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"]
Sep 11 20:21:49.888584 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:49.888560    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-9d9abb/premium-w0-9d9abb-kserve-5595cc8577-6d5gn"]
Sep 11 20:21:51.350370 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:21:51.350335    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef" path="/var/lib/kubelet/pods/3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef/volumes"
Sep 11 20:22:00.924515 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:00.924478    2585 generic.go:356] "Generic (PLEG): container finished" podID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerID="11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4" exitCode=0
Sep 11 20:22:00.925094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:00.924540    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" event={"ID":"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a","Type":"ContainerDied","Data":"11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4"}
Sep 11 20:22:00.925094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:00.925068    2585 scope.go:117] "RemoveContainer" containerID="11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4"
Sep 11 20:22:00.926224 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:00.926195    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:22:00.926298 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:00.926260    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:22:00.926298 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:00.926291    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:22:01.932138 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:01.932096    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" event={"ID":"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a","Type":"ContainerStarted","Data":"7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb"}
Sep 11 20:22:02.688394 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:02.688357    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:22:02.689432 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:02.689402    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 11 20:22:02.689561 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:02.689453    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 11 20:22:03.688682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:03.688649    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 11 20:22:03.689085 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:03.688702    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 11 20:22:04.689057 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:04.689022    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 11 20:22:04.689444 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:04.689078    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 11 20:22:05.689451 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:05.689417    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 11 20:22:05.689866 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:05.689467    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 11 20:22:06.689319 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:06.689287    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 11 20:22:06.689490 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:06.689337    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 11 20:22:06.768127 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:06.768094    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:22:07.693179 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:07.693144    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:22:07.694147 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:07.694124    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:22:28.480478 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:28.480446    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"]
Sep 11 20:22:29.089691 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.089647    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79" podUID="5bbde525-fb97-4c94-8925-f7259c7dd88c" containerName="maas-api" containerID="cri-o://042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca" gracePeriod=30
Sep 11 20:22:29.345301 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.345246    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:22:29.483667 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.483634    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bbde525-fb97-4c94-8925-f7259c7dd88c-openshift-service-ca\") pod \"5bbde525-fb97-4c94-8925-f7259c7dd88c\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") "
Sep 11 20:22:29.484148 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.483675    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-maas-api-tls\") pod \"5bbde525-fb97-4c94-8925-f7259c7dd88c\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") "
Sep 11 20:22:29.484148 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.483692    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l9jb\" (UniqueName: \"kubernetes.io/projected/5bbde525-fb97-4c94-8925-f7259c7dd88c-kube-api-access-5l9jb\") pod \"5bbde525-fb97-4c94-8925-f7259c7dd88c\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") "
Sep 11 20:22:29.484148 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.483799    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-metrics-certs\") pod \"5bbde525-fb97-4c94-8925-f7259c7dd88c\" (UID: \"5bbde525-fb97-4c94-8925-f7259c7dd88c\") "
Sep 11 20:22:29.484148 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.484037    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bbde525-fb97-4c94-8925-f7259c7dd88c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5bbde525-fb97-4c94-8925-f7259c7dd88c" (UID: "5bbde525-fb97-4c94-8925-f7259c7dd88c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:22:29.484328 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.484224    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bbde525-fb97-4c94-8925-f7259c7dd88c-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:22:29.485823 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.485792    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bbde525-fb97-4c94-8925-f7259c7dd88c-kube-api-access-5l9jb" (OuterVolumeSpecName: "kube-api-access-5l9jb") pod "5bbde525-fb97-4c94-8925-f7259c7dd88c" (UID: "5bbde525-fb97-4c94-8925-f7259c7dd88c"). InnerVolumeSpecName "kube-api-access-5l9jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:22:29.485983 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.485856    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5bbde525-fb97-4c94-8925-f7259c7dd88c" (UID: "5bbde525-fb97-4c94-8925-f7259c7dd88c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:22:29.485983 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.485943    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5bbde525-fb97-4c94-8925-f7259c7dd88c" (UID: "5bbde525-fb97-4c94-8925-f7259c7dd88c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:22:29.584891 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.584864    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:22:29.584891 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.584886    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l9jb\" (UniqueName: \"kubernetes.io/projected/5bbde525-fb97-4c94-8925-f7259c7dd88c-kube-api-access-5l9jb\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:22:29.584891 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:29.584897    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bbde525-fb97-4c94-8925-f7259c7dd88c-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:22:30.096000 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:30.095968    2585 generic.go:356] "Generic (PLEG): container finished" podID="5bbde525-fb97-4c94-8925-f7259c7dd88c" containerID="042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca" exitCode=0
Sep 11 20:22:30.096207 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:30.095999    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79" event={"ID":"5bbde525-fb97-4c94-8925-f7259c7dd88c","Type":"ContainerDied","Data":"042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca"}
Sep 11 20:22:30.096207 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:30.096053    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79" event={"ID":"5bbde525-fb97-4c94-8925-f7259c7dd88c","Type":"ContainerDied","Data":"3eb8320c3132820bbb7a8d58243653db292833b98f0b81146dd0ff88c0e89c3d"}
Sep 11 20:22:30.096207 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:30.096075    2585 scope.go:117] "RemoveContainer" containerID="042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca"
Sep 11 20:22:30.096207 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:30.096015    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"
Sep 11 20:22:30.105776 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:30.105757    2585 scope.go:117] "RemoveContainer" containerID="042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca"
Sep 11 20:22:30.106040 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:22:30.106024    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca\": container with ID starting with 042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca not found: ID does not exist" containerID="042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca"
Sep 11 20:22:30.106100 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:30.106048    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca"} err="failed to get container status \"042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca\": rpc error: code = NotFound desc = could not find container \"042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca\": container with ID starting with 042fd96a8a4bf448261ca62beaaadaa8699f9e1aa08bc31db1019aaaf24797ca not found: ID does not exist"
Sep 11 20:22:30.118027 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:30.118006    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"]
Sep 11 20:22:30.123080 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:30.123059    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d11bc81f-57fd8fb9cb-n7w79"]
Sep 11 20:22:31.350330 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:22:31.350299    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bbde525-fb97-4c94-8925-f7259c7dd88c" path="/var/lib/kubelet/pods/5bbde525-fb97-4c94-8925-f7259c7dd88c/volumes"
Sep 11 20:23:42.674188 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:42.674149    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"]
Sep 11 20:23:42.674715 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:42.674401    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" containerName="istio-proxy" containerID="cri-o://b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444" gracePeriod=30
Sep 11 20:23:47.928871 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:47.928848    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:23:48.034128 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034064    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-istio-envoy\") pod \"d42b45a9-61fd-47bc-9855-20440e865b25\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") "
Sep 11 20:23:48.034128 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034109    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d42b45a9-61fd-47bc-9855-20440e865b25-istiod-ca-cert\") pod \"d42b45a9-61fd-47bc-9855-20440e865b25\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") "
Sep 11 20:23:48.034320 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034180    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-workload-socket\") pod \"d42b45a9-61fd-47bc-9855-20440e865b25\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") "
Sep 11 20:23:48.034320 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034232    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-istio-data\") pod \"d42b45a9-61fd-47bc-9855-20440e865b25\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") "
Sep 11 20:23:48.034320 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034253    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d42b45a9-61fd-47bc-9855-20440e865b25-istio-podinfo\") pod \"d42b45a9-61fd-47bc-9855-20440e865b25\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") "
Sep 11 20:23:48.034320 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034269    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-credential-socket\") pod \"d42b45a9-61fd-47bc-9855-20440e865b25\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") "
Sep 11 20:23:48.034320 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034298    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d42b45a9-61fd-47bc-9855-20440e865b25-istio-token\") pod \"d42b45a9-61fd-47bc-9855-20440e865b25\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") "
Sep 11 20:23:48.034600 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034525    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-istio-data" (OuterVolumeSpecName: "istio-data") pod "d42b45a9-61fd-47bc-9855-20440e865b25" (UID: "d42b45a9-61fd-47bc-9855-20440e865b25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:23:48.034600 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034548    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d42b45a9-61fd-47bc-9855-20440e865b25" (UID: "d42b45a9-61fd-47bc-9855-20440e865b25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:23:48.034600 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034581    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqgw9\" (UniqueName: \"kubernetes.io/projected/d42b45a9-61fd-47bc-9855-20440e865b25-kube-api-access-hqgw9\") pod \"d42b45a9-61fd-47bc-9855-20440e865b25\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") "
Sep 11 20:23:48.034774 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034611    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42b45a9-61fd-47bc-9855-20440e865b25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d42b45a9-61fd-47bc-9855-20440e865b25" (UID: "d42b45a9-61fd-47bc-9855-20440e865b25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:23:48.034774 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034635    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-workload-certs\") pod \"d42b45a9-61fd-47bc-9855-20440e865b25\" (UID: \"d42b45a9-61fd-47bc-9855-20440e865b25\") "
Sep 11 20:23:48.034774 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034636    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d42b45a9-61fd-47bc-9855-20440e865b25" (UID: "d42b45a9-61fd-47bc-9855-20440e865b25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:23:48.034933 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.034838    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d42b45a9-61fd-47bc-9855-20440e865b25" (UID: "d42b45a9-61fd-47bc-9855-20440e865b25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:23:48.035102 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.035080    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:23:48.035233 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.035105    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:23:48.035233 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.035120    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:23:48.035233 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.035133    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d42b45a9-61fd-47bc-9855-20440e865b25-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:23:48.035233 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.035140    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:23:48.036426 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.036398    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d42b45a9-61fd-47bc-9855-20440e865b25" (UID: "d42b45a9-61fd-47bc-9855-20440e865b25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:23:48.036636 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.036612    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42b45a9-61fd-47bc-9855-20440e865b25-kube-api-access-hqgw9" (OuterVolumeSpecName: "kube-api-access-hqgw9") pod "d42b45a9-61fd-47bc-9855-20440e865b25" (UID: "d42b45a9-61fd-47bc-9855-20440e865b25"). InnerVolumeSpecName "kube-api-access-hqgw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:23:48.036833 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.036807    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d42b45a9-61fd-47bc-9855-20440e865b25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d42b45a9-61fd-47bc-9855-20440e865b25" (UID: "d42b45a9-61fd-47bc-9855-20440e865b25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:23:48.036910 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.036864    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42b45a9-61fd-47bc-9855-20440e865b25-istio-token" (OuterVolumeSpecName: "istio-token") pod "d42b45a9-61fd-47bc-9855-20440e865b25" (UID: "d42b45a9-61fd-47bc-9855-20440e865b25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:23:48.136359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.136332    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d42b45a9-61fd-47bc-9855-20440e865b25-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:23:48.136359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.136356    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d42b45a9-61fd-47bc-9855-20440e865b25-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:23:48.136359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.136365    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqgw9\" (UniqueName: \"kubernetes.io/projected/d42b45a9-61fd-47bc-9855-20440e865b25-kube-api-access-hqgw9\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:23:48.136558 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.136373    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d42b45a9-61fd-47bc-9855-20440e865b25-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:23:48.500942 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.500906    2585 generic.go:356] "Generic (PLEG): container finished" podID="d42b45a9-61fd-47bc-9855-20440e865b25" containerID="b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444" exitCode=0
Sep 11 20:23:48.501145 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.500948    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" event={"ID":"d42b45a9-61fd-47bc-9855-20440e865b25","Type":"ContainerDied","Data":"b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444"}
Sep 11 20:23:48.501145 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.500980    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"
Sep 11 20:23:48.501145 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.501020    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h" event={"ID":"d42b45a9-61fd-47bc-9855-20440e865b25","Type":"ContainerDied","Data":"038432c1d24c78a09145772803abf56ca31283e99263c777e239eb9caa2b8684"}
Sep 11 20:23:48.501145 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.501042    2585 scope.go:117] "RemoveContainer" containerID="b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444"
Sep 11 20:23:48.510629 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.510614    2585 scope.go:117] "RemoveContainer" containerID="517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd"
Sep 11 20:23:48.520370 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.520332    2585 scope.go:117] "RemoveContainer" containerID="b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444"
Sep 11 20:23:48.520830 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:23:48.520796    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444\": container with ID starting with b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444 not found: ID does not exist" containerID="b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444"
Sep 11 20:23:48.520940 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.520837    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444"} err="failed to get container status \"b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444\": rpc error: code = NotFound desc = could not find container \"b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444\": container with ID starting with b21380cd0b8d37a46036e5fce965cdae0bba96f22dc082f92866beb56c275444 not found: ID does not exist"
Sep 11 20:23:48.520940 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.520861    2585 scope.go:117] "RemoveContainer" containerID="517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd"
Sep 11 20:23:48.521284 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:23:48.521188    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd\": container with ID starting with 517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd not found: ID does not exist" containerID="517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd"
Sep 11 20:23:48.521284 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.521215    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd"} err="failed to get container status \"517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd\": rpc error: code = NotFound desc = could not find container \"517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd\": container with ID starting with 517eaa6d70e41fdcd4cdf1c873c960f34541262b788e42ffe0ca6e8b87942dfd not found: ID does not exist"
Sep 11 20:23:48.523564 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.523540    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"]
Sep 11 20:23:48.529827 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:48.529803    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d11bc81f-openshift-default-5d596d5c68-ck88h"]
Sep 11 20:23:49.350209 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:23:49.350180    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" path="/var/lib/kubelet/pods/d42b45a9-61fd-47bc-9855-20440e865b25/volumes"
Sep 11 20:24:37.555452 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.555417    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"]
Sep 11 20:24:37.556018 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.555998    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bbde525-fb97-4c94-8925-f7259c7dd88c" containerName="maas-api"
Sep 11 20:24:37.556135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556020    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bbde525-fb97-4c94-8925-f7259c7dd88c" containerName="maas-api"
Sep 11 20:24:37.556135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556041    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef" containerName="main"
Sep 11 20:24:37.556135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556050    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef" containerName="main"
Sep 11 20:24:37.556135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556091    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02bd5bb1-73b0-47b8-9f52-1e238ed7a93f" containerName="main"
Sep 11 20:24:37.556135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556100    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="02bd5bb1-73b0-47b8-9f52-1e238ed7a93f" containerName="main"
Sep 11 20:24:37.556135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556112    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" containerName="istio-proxy"
Sep 11 20:24:37.556135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556120    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" containerName="istio-proxy"
Sep 11 20:24:37.556135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556135    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" containerName="istio-proxy"
Sep 11 20:24:37.556500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556143    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" containerName="istio-proxy"
Sep 11 20:24:37.556500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556229    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc56545-f1a9-4dad-8b28-8f8afbdaf2ef" containerName="main"
Sep 11 20:24:37.556500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556240    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="02bd5bb1-73b0-47b8-9f52-1e238ed7a93f" containerName="main"
Sep 11 20:24:37.556500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556251    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" containerName="istio-proxy"
Sep 11 20:24:37.556500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556259    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42b45a9-61fd-47bc-9855-20440e865b25" containerName="istio-proxy"
Sep 11 20:24:37.556500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.556274    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bbde525-fb97-4c94-8925-f7259c7dd88c" containerName="maas-api"
Sep 11 20:24:37.562152 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.562120    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.565641 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.565610    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-3faec0-openshift-default-dockercfg-h2589\""
Sep 11 20:24:37.571284 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.571258    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"]
Sep 11 20:24:37.605088 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.605063    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-data\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.605184 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.605106    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-token\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.605242 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.605222    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-workload-socket\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.605282 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.605253    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-credential-socket\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.605282 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.605269    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-workload-certs\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.605360 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.605284    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-envoy\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.605395 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.605351    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istiod-ca-cert\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.605438 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.605409    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84fkc\" (UniqueName: \"kubernetes.io/projected/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-kube-api-access-84fkc\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.605476 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.605436    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-podinfo\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.706183 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.706149    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istiod-ca-cert\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.706358 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.706203    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84fkc\" (UniqueName: \"kubernetes.io/projected/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-kube-api-access-84fkc\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.706358 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.706230    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-podinfo\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.706358 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.706274    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-data\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.706358 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.706304    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-token\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.706540 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.706406    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-workload-socket\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.706540 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.706440    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-credential-socket\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.706540 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.706463    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-workload-certs\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.706540 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.706487    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-envoy\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.706741 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.706682    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-data\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.706871 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.706849    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-workload-socket\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.707003 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.706982    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-workload-certs\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.707064 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.707021    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istiod-ca-cert\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.707064 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.707040    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-credential-socket\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.708683 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.708663    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-envoy\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.709045 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.709027    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-podinfo\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.715189 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.715162    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-token\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.715357 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.715338    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84fkc\" (UniqueName: \"kubernetes.io/projected/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-kube-api-access-84fkc\") pod \"e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") " pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:37.879354 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:37.879326    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:38.156717 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:38.156689    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"]
Sep 11 20:24:38.158519 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:24:38.158489    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d2f1e4_4c2d_4e19_868c_07319f270a9b.slice/crio-a91fb5b7074255625ba6bc2945f7e791f7beb758b82c7ee634bab328fa12c50d WatchSource:0}: Error finding container a91fb5b7074255625ba6bc2945f7e791f7beb758b82c7ee634bab328fa12c50d: Status 404 returned error can't find the container with id a91fb5b7074255625ba6bc2945f7e791f7beb758b82c7ee634bab328fa12c50d
Sep 11 20:24:38.160729 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:38.160698    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:24:38.160813 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:38.160762    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:24:38.160813 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:38.160789    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:24:38.755804 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:38.755764    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" event={"ID":"f9d2f1e4-4c2d-4e19-868c-07319f270a9b","Type":"ContainerStarted","Data":"899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d"}
Sep 11 20:24:38.756267 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:38.755824    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" event={"ID":"f9d2f1e4-4c2d-4e19-868c-07319f270a9b","Type":"ContainerStarted","Data":"a91fb5b7074255625ba6bc2945f7e791f7beb758b82c7ee634bab328fa12c50d"}
Sep 11 20:24:38.780462 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:38.780410    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" podStartSLOduration=1.780396573 podStartE2EDuration="1.780396573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:24:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:24:38.778758754 +0000 UTC m=+1463.940008993" watchObservedRunningTime="2026-09-11 20:24:38.780396573 +0000 UTC m=+1463.941646815"
Sep 11 20:24:38.879774 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:38.879744    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:39.885422 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:39.885395    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:40.766054 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:40.766003    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:24:40.766924 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:24:40.766907    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:25:11.635464 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.635431    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"]
Sep 11 20:25:11.639761 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.639736    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.643051 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.643028    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b0d28c-openshift-default-dockercfg-8rsrk\""
Sep 11 20:25:11.658068 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.657378    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"]
Sep 11 20:25:11.741121 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.741077    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istiod-ca-cert\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.741121 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.741127    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-workload-socket\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.741376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.741143    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-workload-certs\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.741376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.741193    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-podinfo\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.741376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.741276    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-credential-socket\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.741376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.741303    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-data\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.741376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.741330    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-envoy\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.741376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.741364    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptv54\" (UniqueName: \"kubernetes.io/projected/5cd28b11-8ff4-4378-a49f-9cc7751491d0-kube-api-access-ptv54\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.741720 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.741382    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-token\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.808171 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.808131    2585 patch_prober.go:28] interesting pod/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 20:25:11.808499 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.808446    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 20:25:11.842003 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.841934    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-credential-socket\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.842003 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.842001    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-data\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.842251 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.842031    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-envoy\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.842251 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.842074    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptv54\" (UniqueName: \"kubernetes.io/projected/5cd28b11-8ff4-4378-a49f-9cc7751491d0-kube-api-access-ptv54\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.842251 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.842103    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-token\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.842251 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.842183    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istiod-ca-cert\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.842251 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.842238    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-workload-socket\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.842558 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.842262    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-workload-certs\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.842558 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.842288    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-podinfo\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.842558 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.842412    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-credential-socket\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.842558 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.842465    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-data\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.842795 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.842739    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-workload-socket\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.842795 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.842785    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-workload-certs\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.843216 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.843198    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istiod-ca-cert\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.844934 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.844907    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-envoy\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.845131 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.845114    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-podinfo\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.852089 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.851934    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptv54\" (UniqueName: \"kubernetes.io/projected/5cd28b11-8ff4-4378-a49f-9cc7751491d0-kube-api-access-ptv54\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.852436 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.852412    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-token\") pod \"e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") " pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:11.961781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:11.961697    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:12.268186 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:12.268158    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"]
Sep 11 20:25:12.271031 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:25:12.270998    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd28b11_8ff4_4378_a49f_9cc7751491d0.slice/crio-5623d1db09cc0206a2163851842f13b3985aace44fcaa6329be11b281a78d30c WatchSource:0}: Error finding container 5623d1db09cc0206a2163851842f13b3985aace44fcaa6329be11b281a78d30c: Status 404 returned error can't find the container with id 5623d1db09cc0206a2163851842f13b3985aace44fcaa6329be11b281a78d30c
Sep 11 20:25:12.273215 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:12.273178    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:25:12.273315 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:12.273244    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:25:12.273315 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:12.273273    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:25:12.936404 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:12.936366    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" event={"ID":"5cd28b11-8ff4-4378-a49f-9cc7751491d0","Type":"ContainerStarted","Data":"c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994"}
Sep 11 20:25:12.936823 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:12.936439    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" event={"ID":"5cd28b11-8ff4-4378-a49f-9cc7751491d0","Type":"ContainerStarted","Data":"5623d1db09cc0206a2163851842f13b3985aace44fcaa6329be11b281a78d30c"}
Sep 11 20:25:12.960809 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:12.960752    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" podStartSLOduration=1.960732414 podStartE2EDuration="1.960732414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:25:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:25:12.957827606 +0000 UTC m=+1498.119077850" watchObservedRunningTime="2026-09-11 20:25:12.960732414 +0000 UTC m=+1498.121982660"
Sep 11 20:25:12.962086 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:12.962064    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:13.942627 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:13.942593    2585 generic.go:356] "Generic (PLEG): container finished" podID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerID="899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d" exitCode=0
Sep 11 20:25:13.943064 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:13.942664    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" event={"ID":"f9d2f1e4-4c2d-4e19-868c-07319f270a9b","Type":"ContainerDied","Data":"899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d"}
Sep 11 20:25:13.943197 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:13.943181    2585 scope.go:117] "RemoveContainer" containerID="899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d"
Sep 11 20:25:13.944206 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:13.944182    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:25:13.944263 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:13.944247    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:25:13.944299 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:13.944282    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:25:13.968636 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:13.968612    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:14.950992 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:14.950945    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" event={"ID":"f9d2f1e4-4c2d-4e19-868c-07319f270a9b","Type":"ContainerStarted","Data":"37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66"}
Sep 11 20:25:14.951458 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:14.951126    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:14.952242 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:14.952219    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:15.434247 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:15.434219    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:25:15.439161 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:15.439135    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:25:15.879828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:15.879787    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:25:15.880094 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:15.880068    2585 patch_prober.go:28] interesting pod/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 20:25:15.880166 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:15.880123    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 20:25:16.879907 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:16.879875    2585 patch_prober.go:28] interesting pod/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 20:25:16.880315 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:16.879928    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 20:25:17.880099 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:17.880062    2585 patch_prober.go:28] interesting pod/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 20:25:17.880504 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:17.880123    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 20:25:18.880422 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:18.880388    2585 patch_prober.go:28] interesting pod/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 20:25:18.880809 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:18.880444    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 20:25:19.880612 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:19.880575    2585 patch_prober.go:28] interesting pod/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 20:25:19.881020 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:19.880639    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 20:25:20.879811 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:20.879774    2585 patch_prober.go:28] interesting pod/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 20:25:20.880139 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:20.880109    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 20:25:21.884508 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:21.884477    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:25:21.884940 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:21.884766    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:25:21.885402 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:21.885384    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:25:45.993097 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:45.993060    2585 patch_prober.go:28] interesting pod/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 20:25:45.996164 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:45.993127    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 20:25:46.129969 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:46.129932    2585 generic.go:356] "Generic (PLEG): container finished" podID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerID="c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994" exitCode=0
Sep 11 20:25:46.130149 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:46.129988    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" event={"ID":"5cd28b11-8ff4-4378-a49f-9cc7751491d0","Type":"ContainerDied","Data":"c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994"}
Sep 11 20:25:46.130450 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:46.130433    2585 scope.go:117] "RemoveContainer" containerID="c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994"
Sep 11 20:25:46.131599 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:46.131567    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:25:46.131679 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:46.131635    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:25:46.131679 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:46.131665    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:25:46.754184 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:46.754150    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"]
Sep 11 20:25:47.137456 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:47.137422    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" event={"ID":"5cd28b11-8ff4-4378-a49f-9cc7751491d0","Type":"ContainerStarted","Data":"1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a"}
Sep 11 20:25:47.963201 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:47.963165    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:47.963564 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:47.963541    2585 patch_prober.go:28] interesting pod/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 11 20:25:47.963752 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:47.963724    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 11 20:25:48.962460 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:48.962421    2585 patch_prober.go:28] interesting pod/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 11 20:25:48.963085 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:48.963052    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 11 20:25:49.962221 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:49.962180    2585 patch_prober.go:28] interesting pod/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 11 20:25:49.962534 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:49.962492    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 11 20:25:50.962425 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:50.962387    2585 patch_prober.go:28] interesting pod/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 11 20:25:50.962730 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:50.962697    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 11 20:25:51.962709 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:51.962671    2585 patch_prober.go:28] interesting pod/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 11 20:25:51.962913 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:51.962749    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 11 20:25:52.962987 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:52.962927    2585 patch_prober.go:28] interesting pod/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 11 20:25:52.963628 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:52.963592    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 11 20:25:53.966316 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:53.966280    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:53.966770 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:53.966667    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:25:53.967225 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:25:53.967205    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:26:00.219928 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:00.219893    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd"]
Sep 11 20:26:00.222810 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:00.222783    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-22fc84-29819295-wz9pd"]
Sep 11 20:26:01.349346 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:01.349311    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="157e8aa9-3604-484e-9ca6-3eda8aa2abd7" path="/var/lib/kubelet/pods/157e8aa9-3604-484e-9ca6-3eda8aa2abd7/volumes"
Sep 11 20:26:01.773424 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:01.773333    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh" podUID="4a58691d-c9e2-4d3b-9d15-d5da543fd29e" containerName="main" containerID="cri-o://a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0" gracePeriod=45
Sep 11 20:26:02.036725 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.036666    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:26:02.125804 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.125767    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-model-cache\") pod \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") "
Sep 11 20:26:02.126015 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.125829    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-tmp-dir\") pod \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") "
Sep 11 20:26:02.126015 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.125916    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq7t2\" (UniqueName: \"kubernetes.io/projected/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-kube-api-access-zq7t2\") pod \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") "
Sep 11 20:26:02.126015 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.125945    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-tls-certs\") pod \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") "
Sep 11 20:26:02.126015 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.126002    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-home\") pod \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") "
Sep 11 20:26:02.126276 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.126044    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-dshm\") pod \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\" (UID: \"4a58691d-c9e2-4d3b-9d15-d5da543fd29e\") "
Sep 11 20:26:02.126276 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.126102    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-model-cache" (OuterVolumeSpecName: "model-cache") pod "4a58691d-c9e2-4d3b-9d15-d5da543fd29e" (UID: "4a58691d-c9e2-4d3b-9d15-d5da543fd29e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:02.126276 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.126113    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4a58691d-c9e2-4d3b-9d15-d5da543fd29e" (UID: "4a58691d-c9e2-4d3b-9d15-d5da543fd29e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:02.126455 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.126348    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-home" (OuterVolumeSpecName: "home") pod "4a58691d-c9e2-4d3b-9d15-d5da543fd29e" (UID: "4a58691d-c9e2-4d3b-9d15-d5da543fd29e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:02.126455 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.126403    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-model-cache\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:02.126455 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.126421    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-tmp-dir\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:02.128283 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.128260    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-dshm" (OuterVolumeSpecName: "dshm") pod "4a58691d-c9e2-4d3b-9d15-d5da543fd29e" (UID: "4a58691d-c9e2-4d3b-9d15-d5da543fd29e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:02.128416 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.128315    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4a58691d-c9e2-4d3b-9d15-d5da543fd29e" (UID: "4a58691d-c9e2-4d3b-9d15-d5da543fd29e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:26:02.128595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.128573    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-kube-api-access-zq7t2" (OuterVolumeSpecName: "kube-api-access-zq7t2") pod "4a58691d-c9e2-4d3b-9d15-d5da543fd29e" (UID: "4a58691d-c9e2-4d3b-9d15-d5da543fd29e"). InnerVolumeSpecName "kube-api-access-zq7t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:26:02.227441 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.227410    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq7t2\" (UniqueName: \"kubernetes.io/projected/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-kube-api-access-zq7t2\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:02.227441 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.227438    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-tls-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:02.227441 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.227448    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-home\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:02.227663 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.227456    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a58691d-c9e2-4d3b-9d15-d5da543fd29e-dshm\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:02.248126 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.246549    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh" event={"ID":"4a58691d-c9e2-4d3b-9d15-d5da543fd29e","Type":"ContainerDied","Data":"a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0"}
Sep 11 20:26:02.248126 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.246640    2585 scope.go:117] "RemoveContainer" containerID="a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0"
Sep 11 20:26:02.248126 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.246698    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"
Sep 11 20:26:02.248126 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.247397    2585 generic.go:356] "Generic (PLEG): container finished" podID="4a58691d-c9e2-4d3b-9d15-d5da543fd29e" containerID="a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0" exitCode=0
Sep 11 20:26:02.248126 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.247501    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh" event={"ID":"4a58691d-c9e2-4d3b-9d15-d5da543fd29e","Type":"ContainerDied","Data":"3726500d3d32a92190b2598f6716d7e2c54e0f0a8cd860d654fd63c24bb921d1"}
Sep 11 20:26:02.268508 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.268280    2585 scope.go:117] "RemoveContainer" containerID="a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0"
Sep 11 20:26:02.268723 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:26:02.268659    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0\": container with ID starting with a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0 not found: ID does not exist" containerID="a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0"
Sep 11 20:26:02.268723 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.268691    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0"} err="failed to get container status \"a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0\": rpc error: code = NotFound desc = could not find container \"a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0\": container with ID starting with a9f19537b049c98257657b59a559661ca5fea97e96dcebd40cc651a9ee6449a0 not found: ID does not exist"
Sep 11 20:26:02.281762 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.281729    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"]
Sep 11 20:26:02.288704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:02.288647    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-22fc84/simulator-w4-22fc84-kserve-5fc47558d4-4rmrh"]
Sep 11 20:26:03.350616 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:03.350576    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a58691d-c9e2-4d3b-9d15-d5da543fd29e" path="/var/lib/kubelet/pods/4a58691d-c9e2-4d3b-9d15-d5da543fd29e/volumes"
Sep 11 20:26:07.643068 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:07.643035    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"]
Sep 11 20:26:07.643473 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:07.643264    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy" containerID="cri-o://ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b" gracePeriod=30
Sep 11 20:26:10.214235 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:10.214205    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"]
Sep 11 20:26:10.214656 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:10.214451    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy" containerID="cri-o://37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66" gracePeriod=30
Sep 11 20:26:11.144605 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:11.144571    2585 patch_prober.go:28] interesting pod/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 20:26:11.144795 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:11.144635    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 20:26:12.897078 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:12.897054    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:26:13.031091 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031008    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-token\") pod \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") "
Sep 11 20:26:13.031091 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031075    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istiod-ca-cert\") pod \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") "
Sep 11 20:26:13.031362 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031116    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97sw8\" (UniqueName: \"kubernetes.io/projected/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-kube-api-access-97sw8\") pod \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") "
Sep 11 20:26:13.031362 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031140    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-podinfo\") pod \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") "
Sep 11 20:26:13.031475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031357    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-envoy\") pod \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") "
Sep 11 20:26:13.031475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031410    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-workload-socket\") pod \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") "
Sep 11 20:26:13.031596 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031505    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-workload-certs\") pod \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") "
Sep 11 20:26:13.031596 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031538    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ef0681da-eb0a-4b97-af37-58c08b0fc2d1" (UID: "ef0681da-eb0a-4b97-af37-58c08b0fc2d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:26:13.031596 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031561    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-data\") pod \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") "
Sep 11 20:26:13.031748 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031596    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-credential-socket\") pod \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\" (UID: \"ef0681da-eb0a-4b97-af37-58c08b0fc2d1\") "
Sep 11 20:26:13.031843 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031791    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ef0681da-eb0a-4b97-af37-58c08b0fc2d1" (UID: "ef0681da-eb0a-4b97-af37-58c08b0fc2d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:13.031979 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031938    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ef0681da-eb0a-4b97-af37-58c08b0fc2d1" (UID: "ef0681da-eb0a-4b97-af37-58c08b0fc2d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:13.031979 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.031970    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "ef0681da-eb0a-4b97-af37-58c08b0fc2d1" (UID: "ef0681da-eb0a-4b97-af37-58c08b0fc2d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:13.032102 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.032068    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ef0681da-eb0a-4b97-af37-58c08b0fc2d1" (UID: "ef0681da-eb0a-4b97-af37-58c08b0fc2d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:13.032102 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.032083    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:13.032102 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.032100    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:13.032271 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.032114    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:13.032271 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.032129    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:13.033573 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.033545    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ef0681da-eb0a-4b97-af37-58c08b0fc2d1" (UID: "ef0681da-eb0a-4b97-af37-58c08b0fc2d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:26:13.034031 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.034005    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "ef0681da-eb0a-4b97-af37-58c08b0fc2d1" (UID: "ef0681da-eb0a-4b97-af37-58c08b0fc2d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:26:13.034129 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.034038    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-kube-api-access-97sw8" (OuterVolumeSpecName: "kube-api-access-97sw8") pod "ef0681da-eb0a-4b97-af37-58c08b0fc2d1" (UID: "ef0681da-eb0a-4b97-af37-58c08b0fc2d1"). InnerVolumeSpecName "kube-api-access-97sw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:26:13.034207 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.034128    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ef0681da-eb0a-4b97-af37-58c08b0fc2d1" (UID: "ef0681da-eb0a-4b97-af37-58c08b0fc2d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:13.132900 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.132871    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:13.132900 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.132898    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:13.133081 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.132908    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97sw8\" (UniqueName: \"kubernetes.io/projected/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-kube-api-access-97sw8\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:13.133081 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.132918    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:13.133081 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.132926    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef0681da-eb0a-4b97-af37-58c08b0fc2d1-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:13.307113 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.307035    2585 generic.go:356] "Generic (PLEG): container finished" podID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerID="ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b" exitCode=0
Sep 11 20:26:13.307113 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.307081    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"
Sep 11 20:26:13.307336 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.307127    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" event={"ID":"ef0681da-eb0a-4b97-af37-58c08b0fc2d1","Type":"ContainerDied","Data":"ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b"}
Sep 11 20:26:13.307336 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.307185    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b" event={"ID":"ef0681da-eb0a-4b97-af37-58c08b0fc2d1","Type":"ContainerDied","Data":"3fb2d7dae91a424859fc52e5ccdff8e65c520775b9dc79488ccc5e0a75de928a"}
Sep 11 20:26:13.307336 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.307214    2585 scope.go:117] "RemoveContainer" containerID="ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b"
Sep 11 20:26:13.317330 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.317313    2585 scope.go:117] "RemoveContainer" containerID="c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7"
Sep 11 20:26:13.325270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.325254    2585 scope.go:117] "RemoveContainer" containerID="ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b"
Sep 11 20:26:13.325545 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:26:13.325527    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b\": container with ID starting with ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b not found: ID does not exist" containerID="ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b"
Sep 11 20:26:13.325620 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.325553    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b"} err="failed to get container status \"ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b\": rpc error: code = NotFound desc = could not find container \"ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b\": container with ID starting with ee5e82ce0f65c5261f9b1dcbba2b85a7f881c8adcba9b5d1f8f6cb3ad959328b not found: ID does not exist"
Sep 11 20:26:13.325620 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.325569    2585 scope.go:117] "RemoveContainer" containerID="c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7"
Sep 11 20:26:13.325799 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:26:13.325782    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7\": container with ID starting with c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7 not found: ID does not exist" containerID="c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7"
Sep 11 20:26:13.325837 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.325804    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7"} err="failed to get container status \"c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7\": rpc error: code = NotFound desc = could not find container \"c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7\": container with ID starting with c5915335acc9f4105cb3017d5a43c09ed90d3d342b4c63081ea20d06120da5f7 not found: ID does not exist"
Sep 11 20:26:13.333866 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.333841    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"]
Sep 11 20:26:13.339751 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.339730    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-22fc84-openshift-default-7559f86594-q8l2b"]
Sep 11 20:26:13.349679 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:13.349657    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" path="/var/lib/kubelet/pods/ef0681da-eb0a-4b97-af37-58c08b0fc2d1/volumes"
Sep 11 20:26:15.464478 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.464456    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:26:15.530347 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.530278    2585 scope.go:117] "RemoveContainer" containerID="957bbde8c7849c0bfd5bcc1283ccbc4331659853c6bacd632f28a231cbe7c448"
Sep 11 20:26:15.550153 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.550032    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-token\") pod \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") "
Sep 11 20:26:15.550153 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.550087    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-podinfo\") pod \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") "
Sep 11 20:26:15.550153 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.550125    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-workload-socket\") pod \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") "
Sep 11 20:26:15.550340 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.550197    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-envoy\") pod \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") "
Sep 11 20:26:15.550340 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.550262    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istiod-ca-cert\") pod \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") "
Sep 11 20:26:15.550340 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.550297    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84fkc\" (UniqueName: \"kubernetes.io/projected/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-kube-api-access-84fkc\") pod \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") "
Sep 11 20:26:15.550557 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.550461    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9d2f1e4-4c2d-4e19-868c-07319f270a9b" (UID: "f9d2f1e4-4c2d-4e19-868c-07319f270a9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:15.550613 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.550551    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-workload-certs\") pod \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") "
Sep 11 20:26:15.550613 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.550591    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-credential-socket\") pod \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") "
Sep 11 20:26:15.550720 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.550617    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-data\") pod \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\" (UID: \"f9d2f1e4-4c2d-4e19-868c-07319f270a9b\") "
Sep 11 20:26:15.550720 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.550697    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9d2f1e4-4c2d-4e19-868c-07319f270a9b" (UID: "f9d2f1e4-4c2d-4e19-868c-07319f270a9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:26:15.551102 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.550909    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9d2f1e4-4c2d-4e19-868c-07319f270a9b" (UID: "f9d2f1e4-4c2d-4e19-868c-07319f270a9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:15.551102 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.551057    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9d2f1e4-4c2d-4e19-868c-07319f270a9b" (UID: "f9d2f1e4-4c2d-4e19-868c-07319f270a9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:15.551249 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.551112    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9d2f1e4-4c2d-4e19-868c-07319f270a9b" (UID: "f9d2f1e4-4c2d-4e19-868c-07319f270a9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:15.551307 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.551288    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:15.551361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.551308    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:15.551361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.551321    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:15.551361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.551335    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:15.551361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.551348    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:15.552623 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.552583    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9d2f1e4-4c2d-4e19-868c-07319f270a9b" (UID: "f9d2f1e4-4c2d-4e19-868c-07319f270a9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:26:15.553060 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.553028    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-kube-api-access-84fkc" (OuterVolumeSpecName: "kube-api-access-84fkc") pod "f9d2f1e4-4c2d-4e19-868c-07319f270a9b" (UID: "f9d2f1e4-4c2d-4e19-868c-07319f270a9b"). InnerVolumeSpecName "kube-api-access-84fkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:26:15.553150 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.553094    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9d2f1e4-4c2d-4e19-868c-07319f270a9b" (UID: "f9d2f1e4-4c2d-4e19-868c-07319f270a9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:26:15.553358 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.553343    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9d2f1e4-4c2d-4e19-868c-07319f270a9b" (UID: "f9d2f1e4-4c2d-4e19-868c-07319f270a9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:15.652538 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.652512    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84fkc\" (UniqueName: \"kubernetes.io/projected/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-kube-api-access-84fkc\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:15.652538 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.652535    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:15.652666 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.652544    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:15.652666 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:15.652553    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9d2f1e4-4c2d-4e19-868c-07319f270a9b-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:16.330440 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:16.330408    2585 generic.go:356] "Generic (PLEG): container finished" podID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerID="37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66" exitCode=0
Sep 11 20:26:16.330610 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:16.330457    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" event={"ID":"f9d2f1e4-4c2d-4e19-868c-07319f270a9b","Type":"ContainerDied","Data":"37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66"}
Sep 11 20:26:16.330610 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:16.330463    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"
Sep 11 20:26:16.330610 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:16.330496    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6" event={"ID":"f9d2f1e4-4c2d-4e19-868c-07319f270a9b","Type":"ContainerDied","Data":"a91fb5b7074255625ba6bc2945f7e791f7beb758b82c7ee634bab328fa12c50d"}
Sep 11 20:26:16.330610 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:16.330526    2585 scope.go:117] "RemoveContainer" containerID="37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66"
Sep 11 20:26:16.340801 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:16.340627    2585 scope.go:117] "RemoveContainer" containerID="899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d"
Sep 11 20:26:16.349484 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:16.349463    2585 scope.go:117] "RemoveContainer" containerID="37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66"
Sep 11 20:26:16.349772 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:26:16.349751    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66\": container with ID starting with 37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66 not found: ID does not exist" containerID="37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66"
Sep 11 20:26:16.349850 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:16.349783    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66"} err="failed to get container status \"37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66\": rpc error: code = NotFound desc = could not find container \"37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66\": container with ID starting with 37414044db3cc8f70acc9037922cc38f3690d6ef1294d38cf761f7f4b0bd2a66 not found: ID does not exist"
Sep 11 20:26:16.349850 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:16.349808    2585 scope.go:117] "RemoveContainer" containerID="899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d"
Sep 11 20:26:16.350129 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:26:16.350113    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d\": container with ID starting with 899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d not found: ID does not exist" containerID="899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d"
Sep 11 20:26:16.350170 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:16.350135    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d"} err="failed to get container status \"899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d\": rpc error: code = NotFound desc = could not find container \"899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d\": container with ID starting with 899061296ae08a1973207d49930698f203da2d87d527060326027039691b7a1d not found: ID does not exist"
Sep 11 20:26:16.355241 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:16.355220    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"]
Sep 11 20:26:16.361369 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:16.361344    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-3faec0-openshift-default-648c448dbd-zl9f6"]
Sep 11 20:26:17.350145 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:17.350111    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" path="/var/lib/kubelet/pods/f9d2f1e4-4c2d-4e19-868c-07319f270a9b/volumes"
Sep 11 20:26:33.441972 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:33.441915    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"]
Sep 11 20:26:33.442382 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:33.442184    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy" containerID="cri-o://1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a" gracePeriod=30
Sep 11 20:26:38.691746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.691723    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:26:38.769076 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.768996    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-data\") pod \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") "
Sep 11 20:26:38.769076 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769052    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-workload-socket\") pod \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") "
Sep 11 20:26:38.769297 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769084    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istiod-ca-cert\") pod \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") "
Sep 11 20:26:38.769297 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769122    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-token\") pod \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") "
Sep 11 20:26:38.769297 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769142    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-credential-socket\") pod \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") "
Sep 11 20:26:38.769297 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769170    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-workload-certs\") pod \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") "
Sep 11 20:26:38.769297 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769260    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-podinfo\") pod \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") "
Sep 11 20:26:38.769297 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769289    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "5cd28b11-8ff4-4378-a49f-9cc7751491d0" (UID: "5cd28b11-8ff4-4378-a49f-9cc7751491d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:38.769297 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769298    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-envoy\") pod \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") "
Sep 11 20:26:38.769628 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769390    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5cd28b11-8ff4-4378-a49f-9cc7751491d0" (UID: "5cd28b11-8ff4-4378-a49f-9cc7751491d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:38.769628 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769414    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5cd28b11-8ff4-4378-a49f-9cc7751491d0" (UID: "5cd28b11-8ff4-4378-a49f-9cc7751491d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:38.769742 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769701    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5cd28b11-8ff4-4378-a49f-9cc7751491d0" (UID: "5cd28b11-8ff4-4378-a49f-9cc7751491d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:26:38.769946 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769916    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5cd28b11-8ff4-4378-a49f-9cc7751491d0" (UID: "5cd28b11-8ff4-4378-a49f-9cc7751491d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:38.770058 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.769400    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptv54\" (UniqueName: \"kubernetes.io/projected/5cd28b11-8ff4-4378-a49f-9cc7751491d0-kube-api-access-ptv54\") pod \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\" (UID: \"5cd28b11-8ff4-4378-a49f-9cc7751491d0\") "
Sep 11 20:26:38.773601 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.770889    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:38.773601 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.770915    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:38.773601 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.770938    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:38.773601 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.770976    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:38.773601 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.770992    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:38.775995 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.774062    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "5cd28b11-8ff4-4378-a49f-9cc7751491d0" (UID: "5cd28b11-8ff4-4378-a49f-9cc7751491d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:26:38.778015 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.776336    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cd28b11-8ff4-4378-a49f-9cc7751491d0-kube-api-access-ptv54" (OuterVolumeSpecName: "kube-api-access-ptv54") pod "5cd28b11-8ff4-4378-a49f-9cc7751491d0" (UID: "5cd28b11-8ff4-4378-a49f-9cc7751491d0"). InnerVolumeSpecName "kube-api-access-ptv54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:26:38.778840 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.778805    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5cd28b11-8ff4-4378-a49f-9cc7751491d0" (UID: "5cd28b11-8ff4-4378-a49f-9cc7751491d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:38.779034 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.779008    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5cd28b11-8ff4-4378-a49f-9cc7751491d0" (UID: "5cd28b11-8ff4-4378-a49f-9cc7751491d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:26:38.872495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.872460    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:38.872495 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.872490    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:38.872682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.872503    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cd28b11-8ff4-4378-a49f-9cc7751491d0-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:38.872682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:38.872516    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptv54\" (UniqueName: \"kubernetes.io/projected/5cd28b11-8ff4-4378-a49f-9cc7751491d0-kube-api-access-ptv54\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:39.453255 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:39.453221    2585 generic.go:356] "Generic (PLEG): container finished" podID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerID="1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a" exitCode=0
Sep 11 20:26:39.453412 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:39.453286    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"
Sep 11 20:26:39.453412 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:39.453309    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" event={"ID":"5cd28b11-8ff4-4378-a49f-9cc7751491d0","Type":"ContainerDied","Data":"1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a"}
Sep 11 20:26:39.453412 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:39.453379    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5" event={"ID":"5cd28b11-8ff4-4378-a49f-9cc7751491d0","Type":"ContainerDied","Data":"5623d1db09cc0206a2163851842f13b3985aace44fcaa6329be11b281a78d30c"}
Sep 11 20:26:39.453412 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:39.453412    2585 scope.go:117] "RemoveContainer" containerID="1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a"
Sep 11 20:26:39.462141 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:39.462114    2585 scope.go:117] "RemoveContainer" containerID="c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994"
Sep 11 20:26:39.469718 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:39.469700    2585 scope.go:117] "RemoveContainer" containerID="1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a"
Sep 11 20:26:39.469982 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:26:39.469950    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a\": container with ID starting with 1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a not found: ID does not exist" containerID="1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a"
Sep 11 20:26:39.470053 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:39.469988    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a"} err="failed to get container status \"1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a\": rpc error: code = NotFound desc = could not find container \"1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a\": container with ID starting with 1e50a08eb8f345b5a6039eacffb2ade608dafebb26dbc3f9f8302dd9670d6d6a not found: ID does not exist"
Sep 11 20:26:39.470053 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:39.470006    2585 scope.go:117] "RemoveContainer" containerID="c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994"
Sep 11 20:26:39.470280 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:26:39.470265    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994\": container with ID starting with c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994 not found: ID does not exist" containerID="c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994"
Sep 11 20:26:39.470329 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:39.470284    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994"} err="failed to get container status \"c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994\": rpc error: code = NotFound desc = could not find container \"c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994\": container with ID starting with c78b0d9315b5a41994e67d6ae2804485729877b8800b8becf85eddbc974c8994 not found: ID does not exist"
Sep 11 20:26:39.483716 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:39.483691    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"]
Sep 11 20:26:39.497516 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:39.497494    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b0d28c-openshift-default-655f79d96-rd9j5"]
Sep 11 20:26:41.349852 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:41.349819    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" path="/var/lib/kubelet/pods/5cd28b11-8ff4-4378-a49f-9cc7751491d0/volumes"
Sep 11 20:26:52.177186 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:52.177150    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"]
Sep 11 20:26:52.177746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:52.177388    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerName="istio-proxy" containerID="cri-o://d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600" gracePeriod=30
Sep 11 20:26:57.431769 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.431743    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:26:57.445629 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.445575    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-workload-socket\") pod \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") "
Sep 11 20:26:57.445629 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.445605    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istiod-ca-cert\") pod \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") "
Sep 11 20:26:57.445629 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.445626    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-credential-socket\") pod \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") "
Sep 11 20:26:57.445860 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.445654    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-token\") pod \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") "
Sep 11 20:26:57.445860 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.445690    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-data\") pod \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") "
Sep 11 20:26:57.445860 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.445723    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-envoy\") pod \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") "
Sep 11 20:26:57.445860 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.445765    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-workload-certs\") pod \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") "
Sep 11 20:26:57.445860 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.445789    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxwgp\" (UniqueName: \"kubernetes.io/projected/9400ee51-9f92-43b9-98a5-40e9f1befc9a-kube-api-access-pxwgp\") pod \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") "
Sep 11 20:26:57.446143 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.445866    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-podinfo\") pod \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\" (UID: \"9400ee51-9f92-43b9-98a5-40e9f1befc9a\") "
Sep 11 20:26:57.446143 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.445890    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9400ee51-9f92-43b9-98a5-40e9f1befc9a" (UID: "9400ee51-9f92-43b9-98a5-40e9f1befc9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:57.446143 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.445911    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9400ee51-9f92-43b9-98a5-40e9f1befc9a" (UID: "9400ee51-9f92-43b9-98a5-40e9f1befc9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:57.446143 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.446042    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9400ee51-9f92-43b9-98a5-40e9f1befc9a" (UID: "9400ee51-9f92-43b9-98a5-40e9f1befc9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:26:57.446143 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.446113    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9400ee51-9f92-43b9-98a5-40e9f1befc9a" (UID: "9400ee51-9f92-43b9-98a5-40e9f1befc9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:57.446414 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.446250    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:57.446414 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.446267    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:57.446414 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.446280    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:57.446414 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.446293    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:57.447078 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.447037    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9400ee51-9f92-43b9-98a5-40e9f1befc9a" (UID: "9400ee51-9f92-43b9-98a5-40e9f1befc9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:57.448238 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.448201    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9400ee51-9f92-43b9-98a5-40e9f1befc9a" (UID: "9400ee51-9f92-43b9-98a5-40e9f1befc9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:26:57.448411 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.448395    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9400ee51-9f92-43b9-98a5-40e9f1befc9a" (UID: "9400ee51-9f92-43b9-98a5-40e9f1befc9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:26:57.448757 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.448737    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9400ee51-9f92-43b9-98a5-40e9f1befc9a" (UID: "9400ee51-9f92-43b9-98a5-40e9f1befc9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:26:57.449444 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.449421    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9400ee51-9f92-43b9-98a5-40e9f1befc9a-kube-api-access-pxwgp" (OuterVolumeSpecName: "kube-api-access-pxwgp") pod "9400ee51-9f92-43b9-98a5-40e9f1befc9a" (UID: "9400ee51-9f92-43b9-98a5-40e9f1befc9a"). InnerVolumeSpecName "kube-api-access-pxwgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:26:57.543270 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.543233    2585 generic.go:356] "Generic (PLEG): container finished" podID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerID="d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600" exitCode=0
Sep 11 20:26:57.543470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.543301    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"
Sep 11 20:26:57.543470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.543308    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" event={"ID":"9400ee51-9f92-43b9-98a5-40e9f1befc9a","Type":"ContainerDied","Data":"d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600"}
Sep 11 20:26:57.543470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.543390    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd" event={"ID":"9400ee51-9f92-43b9-98a5-40e9f1befc9a","Type":"ContainerDied","Data":"89efeabebef93df335b9f941df9c28a604122812c401859c6452c4d1a74d00fd"}
Sep 11 20:26:57.543470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.543420    2585 scope.go:117] "RemoveContainer" containerID="d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600"
Sep 11 20:26:57.546740 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.546715    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxwgp\" (UniqueName: \"kubernetes.io/projected/9400ee51-9f92-43b9-98a5-40e9f1befc9a-kube-api-access-pxwgp\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:57.546740 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.546740    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:57.546937 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.546751    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:57.546937 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.546759    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:57.546937 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.546767    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9400ee51-9f92-43b9-98a5-40e9f1befc9a-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:26:57.553518 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.553501    2585 scope.go:117] "RemoveContainer" containerID="b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342"
Sep 11 20:26:57.562158 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.562138    2585 scope.go:117] "RemoveContainer" containerID="d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600"
Sep 11 20:26:57.562448 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:26:57.562420    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600\": container with ID starting with d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600 not found: ID does not exist" containerID="d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600"
Sep 11 20:26:57.562564 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.562455    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600"} err="failed to get container status \"d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600\": rpc error: code = NotFound desc = could not find container \"d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600\": container with ID starting with d7203faeff063e9760b1e841dc5aa12ba91ed3c85eeb2b4b0b620b039794c600 not found: ID does not exist"
Sep 11 20:26:57.562564 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.562478    2585 scope.go:117] "RemoveContainer" containerID="b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342"
Sep 11 20:26:57.562743 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:26:57.562728    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342\": container with ID starting with b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342 not found: ID does not exist" containerID="b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342"
Sep 11 20:26:57.562808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.562746    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342"} err="failed to get container status \"b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342\": rpc error: code = NotFound desc = could not find container \"b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342\": container with ID starting with b73311568ee9311ef0a8567c0b3859160700f6b4a200007533c0abc44283b342 not found: ID does not exist"
Sep 11 20:26:57.569125 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.569096    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"]
Sep 11 20:26:57.577344 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:57.577323    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ea327d-openshift-default-68b9cbb6f4-bflbd"]
Sep 11 20:26:59.353913 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:26:59.353879    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" path="/var/lib/kubelet/pods/9400ee51-9f92-43b9-98a5-40e9f1befc9a/volumes"
Sep 11 20:27:02.921227 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:02.921190    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"]
Sep 11 20:27:02.921638 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:02.921389    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm" podUID="9675592c-76c1-4261-8982-5c96a30c1f59" containerName="maas-api" containerID="cri-o://f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500" gracePeriod=30
Sep 11 20:27:03.172175 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.172114    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:27:03.301246 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.301211    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9675592c-76c1-4261-8982-5c96a30c1f59-openshift-service-ca\") pod \"9675592c-76c1-4261-8982-5c96a30c1f59\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") "
Sep 11 20:27:03.301438 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.301269    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-metrics-certs\") pod \"9675592c-76c1-4261-8982-5c96a30c1f59\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") "
Sep 11 20:27:03.301438 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.301305    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-maas-api-tls\") pod \"9675592c-76c1-4261-8982-5c96a30c1f59\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") "
Sep 11 20:27:03.301438 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.301370    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6fhf\" (UniqueName: \"kubernetes.io/projected/9675592c-76c1-4261-8982-5c96a30c1f59-kube-api-access-m6fhf\") pod \"9675592c-76c1-4261-8982-5c96a30c1f59\" (UID: \"9675592c-76c1-4261-8982-5c96a30c1f59\") "
Sep 11 20:27:03.301615 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.301571    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9675592c-76c1-4261-8982-5c96a30c1f59-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9675592c-76c1-4261-8982-5c96a30c1f59" (UID: "9675592c-76c1-4261-8982-5c96a30c1f59"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:27:03.303460 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.303423    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9675592c-76c1-4261-8982-5c96a30c1f59" (UID: "9675592c-76c1-4261-8982-5c96a30c1f59"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:27:03.303588 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.303492    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9675592c-76c1-4261-8982-5c96a30c1f59" (UID: "9675592c-76c1-4261-8982-5c96a30c1f59"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:27:03.303682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.303654    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9675592c-76c1-4261-8982-5c96a30c1f59-kube-api-access-m6fhf" (OuterVolumeSpecName: "kube-api-access-m6fhf") pod "9675592c-76c1-4261-8982-5c96a30c1f59" (UID: "9675592c-76c1-4261-8982-5c96a30c1f59"). InnerVolumeSpecName "kube-api-access-m6fhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:27:03.402611 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.402577    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9675592c-76c1-4261-8982-5c96a30c1f59-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:03.402611 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.402610    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:03.402810 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.402623    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9675592c-76c1-4261-8982-5c96a30c1f59-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:03.402810 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.402632    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6fhf\" (UniqueName: \"kubernetes.io/projected/9675592c-76c1-4261-8982-5c96a30c1f59-kube-api-access-m6fhf\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:03.578049 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.577941    2585 generic.go:356] "Generic (PLEG): container finished" podID="9675592c-76c1-4261-8982-5c96a30c1f59" containerID="f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500" exitCode=0
Sep 11 20:27:03.578049 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.578018    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"
Sep 11 20:27:03.578049 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.578025    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm" event={"ID":"9675592c-76c1-4261-8982-5c96a30c1f59","Type":"ContainerDied","Data":"f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500"}
Sep 11 20:27:03.578283 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.578084    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm" event={"ID":"9675592c-76c1-4261-8982-5c96a30c1f59","Type":"ContainerDied","Data":"1671bd3c2267349d18ed788f73bf4e7216d3772ed17f0088f9f10de7af533e51"}
Sep 11 20:27:03.578283 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.578106    2585 scope.go:117] "RemoveContainer" containerID="f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500"
Sep 11 20:27:03.586788 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.586773    2585 scope.go:117] "RemoveContainer" containerID="f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500"
Sep 11 20:27:03.587104 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:27:03.587079    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500\": container with ID starting with f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500 not found: ID does not exist" containerID="f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500"
Sep 11 20:27:03.587224 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.587108    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500"} err="failed to get container status \"f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500\": rpc error: code = NotFound desc = could not find container \"f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500\": container with ID starting with f71c3996e7b2cbe86a4fb0b946117517b4fdadb4b4a38255078da40387ca8500 not found: ID does not exist"
Sep 11 20:27:03.599028 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.599001    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"]
Sep 11 20:27:03.606512 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:03.606485    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c7e744-7859dd4655-6hfqm"]
Sep 11 20:27:05.349041 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:05.349010    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9675592c-76c1-4261-8982-5c96a30c1f59" path="/var/lib/kubelet/pods/9675592c-76c1-4261-8982-5c96a30c1f59/volumes"
Sep 11 20:27:10.447115 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:10.447040    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"]
Sep 11 20:27:10.447499 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:10.447269    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy" containerID="cri-o://46355aeb3563f08c0bf3fdf7f55c229238d0f05a9a73fafe376340444aca2ddc" gracePeriod=30
Sep 11 20:27:14.427535 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:14.427498    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 20:27:14.428002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:14.427571    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 20:27:15.641578 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.641546    2585 generic.go:356] "Generic (PLEG): container finished" podID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerID="46355aeb3563f08c0bf3fdf7f55c229238d0f05a9a73fafe376340444aca2ddc" exitCode=0
Sep 11 20:27:15.641945 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.641615    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" event={"ID":"3dc4bcb6-4869-4c8c-802d-caac8a56654e","Type":"ContainerDied","Data":"46355aeb3563f08c0bf3fdf7f55c229238d0f05a9a73fafe376340444aca2ddc"}
Sep 11 20:27:15.641945 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.641718    2585 scope.go:117] "RemoveContainer" containerID="5489f782312df31d417a8ebf69442ddf9b90633ba2f4b91c623fea663f2a4141"
Sep 11 20:27:15.708622 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.708568    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:27:15.815892 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.815864    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istiod-ca-cert\") pod \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") "
Sep 11 20:27:15.816045 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.815899    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-workload-certs\") pod \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") "
Sep 11 20:27:15.816045 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.815920    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-workload-socket\") pod \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") "
Sep 11 20:27:15.816045 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.815970    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-envoy\") pod \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") "
Sep 11 20:27:15.816045 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816016    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-podinfo\") pod \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") "
Sep 11 20:27:15.816249 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816048    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-data\") pod \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") "
Sep 11 20:27:15.816249 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816089    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-credential-socket\") pod \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") "
Sep 11 20:27:15.816249 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816121    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6tzq\" (UniqueName: \"kubernetes.io/projected/3dc4bcb6-4869-4c8c-802d-caac8a56654e-kube-api-access-l6tzq\") pod \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") "
Sep 11 20:27:15.816249 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816195    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3dc4bcb6-4869-4c8c-802d-caac8a56654e" (UID: "3dc4bcb6-4869-4c8c-802d-caac8a56654e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:27:15.816249 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816209    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3dc4bcb6-4869-4c8c-802d-caac8a56654e" (UID: "3dc4bcb6-4869-4c8c-802d-caac8a56654e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:27:15.816249 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816207    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-token\") pod \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\" (UID: \"3dc4bcb6-4869-4c8c-802d-caac8a56654e\") "
Sep 11 20:27:15.816548 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816344    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3dc4bcb6-4869-4c8c-802d-caac8a56654e" (UID: "3dc4bcb6-4869-4c8c-802d-caac8a56654e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:27:15.816548 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816399    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-data" (OuterVolumeSpecName: "istio-data") pod "3dc4bcb6-4869-4c8c-802d-caac8a56654e" (UID: "3dc4bcb6-4869-4c8c-802d-caac8a56654e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:27:15.816548 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816495    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3dc4bcb6-4869-4c8c-802d-caac8a56654e" (UID: "3dc4bcb6-4869-4c8c-802d-caac8a56654e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:27:15.816706 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816637    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:15.816706 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816656    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:15.816706 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816672    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:15.816706 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816685    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:15.816706 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.816698    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:15.818165 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.818146    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3dc4bcb6-4869-4c8c-802d-caac8a56654e" (UID: "3dc4bcb6-4869-4c8c-802d-caac8a56654e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:27:15.818344 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.818325    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dc4bcb6-4869-4c8c-802d-caac8a56654e-kube-api-access-l6tzq" (OuterVolumeSpecName: "kube-api-access-l6tzq") pod "3dc4bcb6-4869-4c8c-802d-caac8a56654e" (UID: "3dc4bcb6-4869-4c8c-802d-caac8a56654e"). InnerVolumeSpecName "kube-api-access-l6tzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:27:15.818589 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.818565    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-token" (OuterVolumeSpecName: "istio-token") pod "3dc4bcb6-4869-4c8c-802d-caac8a56654e" (UID: "3dc4bcb6-4869-4c8c-802d-caac8a56654e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:27:15.818589 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.818563    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3dc4bcb6-4869-4c8c-802d-caac8a56654e" (UID: "3dc4bcb6-4869-4c8c-802d-caac8a56654e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:27:15.917501 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.917474    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6tzq\" (UniqueName: \"kubernetes.io/projected/3dc4bcb6-4869-4c8c-802d-caac8a56654e-kube-api-access-l6tzq\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:15.917501 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.917497    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:15.917670 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.917506    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:15.917670 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:15.917525    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc4bcb6-4869-4c8c-802d-caac8a56654e-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:27:16.651243 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:16.651208    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj" event={"ID":"3dc4bcb6-4869-4c8c-802d-caac8a56654e","Type":"ContainerDied","Data":"648e0251d5e72946a5ed5932fe4698c4d12a16be62bcd33b6370cd68683b872e"}
Sep 11 20:27:16.651693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:16.651257    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"
Sep 11 20:27:16.651693 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:16.651272    2585 scope.go:117] "RemoveContainer" containerID="46355aeb3563f08c0bf3fdf7f55c229238d0f05a9a73fafe376340444aca2ddc"
Sep 11 20:27:16.676633 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:16.676607    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"]
Sep 11 20:27:16.682321 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:16.682296    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c7e744-openshift-default-79844fb44d-dlkgj"]
Sep 11 20:27:17.349794 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:27:17.349765    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" path="/var/lib/kubelet/pods/3dc4bcb6-4869-4c8c-802d-caac8a56654e/volumes"
Sep 11 20:29:35.625140 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625105    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"]
Sep 11 20:29:35.625608 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625596    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy"
Sep 11 20:29:35.625653 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625611    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy"
Sep 11 20:29:35.625653 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625624    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9675592c-76c1-4261-8982-5c96a30c1f59" containerName="maas-api"
Sep 11 20:29:35.625653 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625633    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9675592c-76c1-4261-8982-5c96a30c1f59" containerName="maas-api"
Sep 11 20:29:35.625653 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625645    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625653    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625668    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625676    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625697    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625705    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625718    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a58691d-c9e2-4d3b-9d15-d5da543fd29e" containerName="main"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625725    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a58691d-c9e2-4d3b-9d15-d5da543fd29e" containerName="main"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625736    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625744    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625752    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625760    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625777    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerName="istio-proxy"
Sep 11 20:29:35.625781 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625785    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerName="istio-proxy"
Sep 11 20:29:35.626237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625794    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerName="istio-proxy"
Sep 11 20:29:35.626237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625801    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerName="istio-proxy"
Sep 11 20:29:35.626237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625875    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy"
Sep 11 20:29:35.626237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625886    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a58691d-c9e2-4d3b-9d15-d5da543fd29e" containerName="main"
Sep 11 20:29:35.626237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625897    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9675592c-76c1-4261-8982-5c96a30c1f59" containerName="maas-api"
Sep 11 20:29:35.626237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625906    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy"
Sep 11 20:29:35.626237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625914    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerName="istio-proxy"
Sep 11 20:29:35.626237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625923    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy"
Sep 11 20:29:35.626237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625931    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9400ee51-9f92-43b9-98a5-40e9f1befc9a" containerName="istio-proxy"
Sep 11 20:29:35.626237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625942    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy"
Sep 11 20:29:35.626237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625971    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy"
Sep 11 20:29:35.626237 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.625982    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cd28b11-8ff4-4378-a49f-9cc7751491d0" containerName="istio-proxy"
Sep 11 20:29:35.629392 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.629375    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.632136 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.632115    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-248ab6-openshift-default-dockercfg-w2ncm\""
Sep 11 20:29:35.644816 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.644793    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"]
Sep 11 20:29:35.741543 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.741503    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5959f84d-71b3-44de-a342-397ea88e5e78-istiod-ca-cert\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.741844 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.741554    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5959f84d-71b3-44de-a342-397ea88e5e78-istio-token\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.741844 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.741631    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-istio-envoy\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.741844 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.741677    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-credential-socket\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.741844 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.741721    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5959f84d-71b3-44de-a342-397ea88e5e78-istio-podinfo\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.741844 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.741744    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxn8n\" (UniqueName: \"kubernetes.io/projected/5959f84d-71b3-44de-a342-397ea88e5e78-kube-api-access-nxn8n\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.741844 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.741775    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-workload-certs\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.741844 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.741797    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-istio-data\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.741844 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.741836    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-workload-socket\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.843266 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.843235    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-istio-envoy\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.843417 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.843283    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-credential-socket\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.843417 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.843313    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5959f84d-71b3-44de-a342-397ea88e5e78-istio-podinfo\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.843417 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.843333    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxn8n\" (UniqueName: \"kubernetes.io/projected/5959f84d-71b3-44de-a342-397ea88e5e78-kube-api-access-nxn8n\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.843417 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.843365    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-workload-certs\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.843417 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.843388    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-istio-data\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.843708 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.843425    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-workload-socket\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.843771 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.843708    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-credential-socket\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.843831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.843768    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-workload-certs\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.843831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.843794    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5959f84d-71b3-44de-a342-397ea88e5e78-istiod-ca-cert\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.843831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.843821    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5959f84d-71b3-44de-a342-397ea88e5e78-istio-token\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.844020 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.843890    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-istio-data\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.844064 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.844043    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-workload-socket\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.844531 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.844508    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5959f84d-71b3-44de-a342-397ea88e5e78-istiod-ca-cert\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.845799 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.845775    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-istio-envoy\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.845950 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.845930    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5959f84d-71b3-44de-a342-397ea88e5e78-istio-podinfo\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.857050 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.857026    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5959f84d-71b3-44de-a342-397ea88e5e78-istio-token\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.858588 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.858566    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxn8n\" (UniqueName: \"kubernetes.io/projected/5959f84d-71b3-44de-a342-397ea88e5e78-kube-api-access-nxn8n\") pod \"e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") " pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:35.939448 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:35.939396    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:36.221618 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:36.221594    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"]
Sep 11 20:29:36.225447 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:29:36.225414    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5959f84d_71b3_44de_a342_397ea88e5e78.slice/crio-d18903df1362041e1e7d93aaab7b64a068f63a79692b27c4e07fafe9e2774729 WatchSource:0}: Error finding container d18903df1362041e1e7d93aaab7b64a068f63a79692b27c4e07fafe9e2774729: Status 404 returned error can't find the container with id d18903df1362041e1e7d93aaab7b64a068f63a79692b27c4e07fafe9e2774729
Sep 11 20:29:36.227552 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:36.227518    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:29:36.227638 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:36.227582    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:29:36.227638 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:36.227610    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:29:36.322811 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:36.322774    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" event={"ID":"5959f84d-71b3-44de-a342-397ea88e5e78","Type":"ContainerStarted","Data":"54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3"}
Sep 11 20:29:36.323004 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:36.322838    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" event={"ID":"5959f84d-71b3-44de-a342-397ea88e5e78","Type":"ContainerStarted","Data":"d18903df1362041e1e7d93aaab7b64a068f63a79692b27c4e07fafe9e2774729"}
Sep 11 20:29:36.349193 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:36.349132    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" podStartSLOduration=1.349111177 podStartE2EDuration="1.349111177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:29:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:29:36.346096685 +0000 UTC m=+1761.507346941" watchObservedRunningTime="2026-09-11 20:29:36.349111177 +0000 UTC m=+1761.510361423"
Sep 11 20:29:36.940181 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:36.940144    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:37.945335 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:37.945303    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:38.331795 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:38.331772    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:38.332615 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:38.332592    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:54.374119 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:54.374067    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 20:29:54.374618 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:54.374145    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 20:29:55.416168 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:55.416136    2585 generic.go:356] "Generic (PLEG): container finished" podID="5959f84d-71b3-44de-a342-397ea88e5e78" containerID="54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3" exitCode=0
Sep 11 20:29:55.416704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:55.416214    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" event={"ID":"5959f84d-71b3-44de-a342-397ea88e5e78","Type":"ContainerDied","Data":"54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3"}
Sep 11 20:29:55.416785 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:55.416705    2585 scope.go:117] "RemoveContainer" containerID="54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3"
Sep 11 20:29:55.417859 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:55.417832    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:29:55.417920 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:55.417902    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:29:55.417980 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:55.417936    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:29:56.422575 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:56.422543    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" event={"ID":"5959f84d-71b3-44de-a342-397ea88e5e78","Type":"ContainerStarted","Data":"dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be"}
Sep 11 20:29:56.940057 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:56.940016    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:29:56.940256 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:56.940231    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 20:29:56.940316 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:56.940297    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 20:29:57.940276 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:57.940241    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 20:29:57.940671 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:57.940297    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 20:29:58.939902 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:58.939867    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 20:29:58.940098 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:58.939920    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 20:29:59.940372 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:59.940334    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 20:29:59.940771 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:29:59.940403    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 20:30:00.138535 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.138490    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x"]
Sep 11 20:30:00.138905 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.138892    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy"
Sep 11 20:30:00.138975 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.138907    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy"
Sep 11 20:30:00.138975 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.138916    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy"
Sep 11 20:30:00.138975 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.138922    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9d2f1e4-4c2d-4e19-868c-07319f270a9b" containerName="istio-proxy"
Sep 11 20:30:00.139082 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.139018    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef0681da-eb0a-4b97-af37-58c08b0fc2d1" containerName="istio-proxy"
Sep 11 20:30:00.139082 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.139030    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc4bcb6-4869-4c8c-802d-caac8a56654e" containerName="istio-proxy"
Sep 11 20:30:00.141911 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.141891    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x"
Sep 11 20:30:00.144628 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.144598    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7dbs5\""
Sep 11 20:30:00.155372 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.154946    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x"]
Sep 11 20:30:00.160977 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.158433    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x"
Sep 11 20:30:00.460759 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.459589    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x"]
Sep 11 20:30:00.477574 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:30:00.477540    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48226183_3240_4674_a345_e2d26685fca8.slice/crio-24eb8fee5640c82a57206c0e5ecc9d575fedd2747b9e36eed21cd978b48508b1 WatchSource:0}: Error finding container 24eb8fee5640c82a57206c0e5ecc9d575fedd2747b9e36eed21cd978b48508b1: Status 404 returned error can't find the container with id 24eb8fee5640c82a57206c0e5ecc9d575fedd2747b9e36eed21cd978b48508b1
Sep 11 20:30:00.940494 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.940453    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 20:30:00.940882 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:00.940516    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 20:30:01.449394 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:01.449354    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x" event={"ID":"48226183-3240-4674-a345-e2d26685fca8","Type":"ContainerStarted","Data":"c073ebc61adcf029f6e4386d70780c6dd1684c9daba6de10cf226d86e56b85ee"}
Sep 11 20:30:01.449599 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:01.449425    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x" event={"ID":"48226183-3240-4674-a345-e2d26685fca8","Type":"ContainerStarted","Data":"24eb8fee5640c82a57206c0e5ecc9d575fedd2747b9e36eed21cd978b48508b1"}
Sep 11 20:30:01.940897 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:01.940853    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 20:30:01.941328 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:01.940925    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 20:30:02.455330 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:02.455297    2585 generic.go:356] "Generic (PLEG): container finished" podID="48226183-3240-4674-a345-e2d26685fca8" containerID="c073ebc61adcf029f6e4386d70780c6dd1684c9daba6de10cf226d86e56b85ee" exitCode=0
Sep 11 20:30:02.455522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:02.455388    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x" event={"ID":"48226183-3240-4674-a345-e2d26685fca8","Type":"ContainerDied","Data":"c073ebc61adcf029f6e4386d70780c6dd1684c9daba6de10cf226d86e56b85ee"}
Sep 11 20:30:02.943664 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:02.943628    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:30:02.944060 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:02.943872    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:30:02.944595 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:02.944575    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:30:03.594489 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:03.594467    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x"
Sep 11 20:30:04.472173 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:04.472142    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x"
Sep 11 20:30:04.472666 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:04.472182    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x" event={"ID":"48226183-3240-4674-a345-e2d26685fca8","Type":"ContainerDied","Data":"24eb8fee5640c82a57206c0e5ecc9d575fedd2747b9e36eed21cd978b48508b1"}
Sep 11 20:30:04.472666 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:04.472265    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24eb8fee5640c82a57206c0e5ecc9d575fedd2747b9e36eed21cd978b48508b1"
Sep 11 20:30:09.349514 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.349438    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"]
Sep 11 20:30:09.350014 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.349913    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48226183-3240-4674-a345-e2d26685fca8" containerName="cleanup"
Sep 11 20:30:09.350014 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.349927    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="48226183-3240-4674-a345-e2d26685fca8" containerName="cleanup"
Sep 11 20:30:09.350108 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.350083    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="48226183-3240-4674-a345-e2d26685fca8" containerName="cleanup"
Sep 11 20:30:09.360248 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.360217    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.365015 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.364939    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-b6453d-openshift-default-dockercfg-gckrb\""
Sep 11 20:30:09.366235 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.366211    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"]
Sep 11 20:30:09.462254 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.462213    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-credential-socket\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.462254 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.462258    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-token\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.462524 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.462282    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-workload-socket\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.462524 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.462300    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-data\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.462524 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.462329    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-podinfo\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.462524 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.462344    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-envoy\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.462524 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.462360    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54d29dca-edf5-42bf-a565-d783ea6622d8-istiod-ca-cert\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.462524 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.462451    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnnpv\" (UniqueName: \"kubernetes.io/projected/54d29dca-edf5-42bf-a565-d783ea6622d8-kube-api-access-mnnpv\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.462524 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.462518    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-workload-certs\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.564038 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.564008    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-workload-certs\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.564192 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.564073    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-credential-socket\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.564192 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.564101    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-token\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.564192 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.564135    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-workload-socket\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.564192 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.564160    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-data\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.564400 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.564202    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-podinfo\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.564438 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.564397    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-envoy\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.564476 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.564432    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-workload-certs\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.564476 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.564437    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54d29dca-edf5-42bf-a565-d783ea6622d8-istiod-ca-cert\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.564476 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.564466    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-credential-socket\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.564572 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.564531    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnnpv\" (UniqueName: \"kubernetes.io/projected/54d29dca-edf5-42bf-a565-d783ea6622d8-kube-api-access-mnnpv\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.565005 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.564985    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-workload-socket\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.565117 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.565059    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-data\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.565117 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.565082    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54d29dca-edf5-42bf-a565-d783ea6622d8-istiod-ca-cert\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.566678 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.566659    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-podinfo\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.566760 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.566750    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-envoy\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.572617 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.572594    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-token\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.572808 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.572788    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnnpv\" (UniqueName: \"kubernetes.io/projected/54d29dca-edf5-42bf-a565-d783ea6622d8-kube-api-access-mnnpv\") pod \"e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") " pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.674307 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.674232    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:09.953810 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.953780    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"]
Sep 11 20:30:09.955668 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:30:09.955641    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d29dca_edf5_42bf_a565_d783ea6622d8.slice/crio-a850f20129ba1a1071872db50c313003ed5d71da6ad7546ff03937befa5f35d9 WatchSource:0}: Error finding container a850f20129ba1a1071872db50c313003ed5d71da6ad7546ff03937befa5f35d9: Status 404 returned error can't find the container with id a850f20129ba1a1071872db50c313003ed5d71da6ad7546ff03937befa5f35d9
Sep 11 20:30:09.958184 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.958146    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:30:09.958272 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.958234    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:30:09.958310 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:09.958275    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:30:10.501892 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:10.501860    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" event={"ID":"54d29dca-edf5-42bf-a565-d783ea6622d8","Type":"ContainerStarted","Data":"f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa"}
Sep 11 20:30:10.502314 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:10.501911    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" event={"ID":"54d29dca-edf5-42bf-a565-d783ea6622d8","Type":"ContainerStarted","Data":"a850f20129ba1a1071872db50c313003ed5d71da6ad7546ff03937befa5f35d9"}
Sep 11 20:30:10.525766 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:10.525723    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" podStartSLOduration=1.525708862 podStartE2EDuration="1.525708862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:30:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:30:10.523212636 +0000 UTC m=+1795.684462878" watchObservedRunningTime="2026-09-11 20:30:10.525708862 +0000 UTC m=+1795.686959104"
Sep 11 20:30:10.674329 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:10.674294    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:11.679804 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:11.679772    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:12.510588 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:12.510552    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:12.511528 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:12.511509    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:15.287931 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.287900    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"]
Sep 11 20:30:15.291390 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.291372    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.294139 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.294118    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-b6453d-serving-cert\""
Sep 11 20:30:15.302996 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.302974    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"]
Sep 11 20:30:15.317814 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.317789    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mrsl\" (UniqueName: \"kubernetes.io/projected/635c0e4a-f365-4b2a-b4b2-258cafa3429e-kube-api-access-8mrsl\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.317926 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.317845    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/635c0e4a-f365-4b2a-b4b2-258cafa3429e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.318026 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.317922    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-metrics-certs\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.318026 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.317999    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.419406 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.419369    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.419593 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:30:15.419532    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-serving-cert: secret "maas-api-e2e-ipp-b-b6453d-serving-cert" not found
Sep 11 20:30:15.419672 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.419600    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mrsl\" (UniqueName: \"kubernetes.io/projected/635c0e4a-f365-4b2a-b4b2-258cafa3429e-kube-api-access-8mrsl\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.419672 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:30:15.419640    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-maas-api-tls podName:635c0e4a-f365-4b2a-b4b2-258cafa3429e nodeName:}" failed. No retries permitted until 2026-09-11 20:30:15.919616726 +0000 UTC m=+1801.080866952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-maas-api-tls") pod "maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb" (UID: "635c0e4a-f365-4b2a-b4b2-258cafa3429e") : secret "maas-api-e2e-ipp-b-b6453d-serving-cert" not found
Sep 11 20:30:15.419790 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.419709    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/635c0e4a-f365-4b2a-b4b2-258cafa3429e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.419790 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.419766    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-metrics-certs\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.420351 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.420327    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/635c0e4a-f365-4b2a-b4b2-258cafa3429e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.422271 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.422250    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-metrics-certs\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.433902 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.433880    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mrsl\" (UniqueName: \"kubernetes.io/projected/635c0e4a-f365-4b2a-b4b2-258cafa3429e-kube-api-access-8mrsl\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.475274 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.475247    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:30:15.482063 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.482043    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:30:15.925712 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.925670    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:15.928085 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:15.928055    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:16.203381 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:16.203299    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:16.476545 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:16.476504    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"]
Sep 11 20:30:16.479030 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:30:16.479000    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod635c0e4a_f365_4b2a_b4b2_258cafa3429e.slice/crio-49dc0799df536f8db94d6be66ecdacb33b93b426da75796b233b9585c41e2e2e WatchSource:0}: Error finding container 49dc0799df536f8db94d6be66ecdacb33b93b426da75796b233b9585c41e2e2e: Status 404 returned error can't find the container with id 49dc0799df536f8db94d6be66ecdacb33b93b426da75796b233b9585c41e2e2e
Sep 11 20:30:16.480841 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:16.480821    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 20:30:16.530376 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:16.530344    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb" event={"ID":"635c0e4a-f365-4b2a-b4b2-258cafa3429e","Type":"ContainerStarted","Data":"49dc0799df536f8db94d6be66ecdacb33b93b426da75796b233b9585c41e2e2e"}
Sep 11 20:30:17.536880 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:17.536843    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb" event={"ID":"635c0e4a-f365-4b2a-b4b2-258cafa3429e","Type":"ContainerStarted","Data":"3ff6795673f949baeaa2a905e8e8fe929ecf5a18cbae3f0d10c02311fa4004cd"}
Sep 11 20:30:17.537345 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:17.536996    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:17.558200 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:17.558155    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb" podStartSLOduration=2.255481521 podStartE2EDuration="2.558139169s" totalImagesPullingTime="302.657648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:30:17.556212668 +0000 UTC m=+1802.717462909" watchObservedRunningTime="2026-09-11 20:30:17.558139169 +0000 UTC m=+1802.719389412"
Sep 11 20:30:23.547849 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:23.547818    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:30:28.553112 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:28.553065    2585 patch_prober.go:28] interesting pod/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 20:30:28.553499 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:28.553125    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 20:30:30.612784 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:30.612748    2585 generic.go:356] "Generic (PLEG): container finished" podID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerID="f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa" exitCode=0
Sep 11 20:30:30.613236 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:30.612823    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" event={"ID":"54d29dca-edf5-42bf-a565-d783ea6622d8","Type":"ContainerDied","Data":"f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa"}
Sep 11 20:30:30.613341 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:30.613324    2585 scope.go:117] "RemoveContainer" containerID="f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa"
Sep 11 20:30:30.614368 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:30.614342    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:30:30.614426 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:30.614406    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:30:30.614471 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:30.614449    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 20:30:31.619559 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:31.619528    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" event={"ID":"54d29dca-edf5-42bf-a565-d783ea6622d8","Type":"ContainerStarted","Data":"ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39"}
Sep 11 20:30:31.675105 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:31.675065    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:31.675396 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:31.675371    2585 patch_prober.go:28] interesting pod/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 20:30:31.675477 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:31.675428    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 20:30:32.675572 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:32.675534    2585 patch_prober.go:28] interesting pod/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 20:30:32.676071 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:32.675595    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 20:30:33.674742 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:33.674705    2585 patch_prober.go:28] interesting pod/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 20:30:33.674919 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:33.674763    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 20:30:34.675417 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:34.675377    2585 patch_prober.go:28] interesting pod/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 20:30:34.675843 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:34.675435    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 20:30:35.674858 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:35.674818    2585 patch_prober.go:28] interesting pod/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 20:30:35.675061 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:35.674876    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 20:30:36.675235 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:36.675195    2585 patch_prober.go:28] interesting pod/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 20:30:36.675649 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:36.675252    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 20:30:37.678639 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:37.678610    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:37.679098 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:37.678906    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:30:37.679668 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:30:37.679648    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:31:40.895636 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:40.895560    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"]
Sep 11 20:31:40.899642 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:40.899620    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:40.902164 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:40.902133    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-5de5ea-serving-cert\""
Sep 11 20:31:40.909030 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:40.909003    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"]
Sep 11 20:31:40.992437 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:40.992405    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:40.992599 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:40.992471    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:40.992599 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:40.992553    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:40.992599 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:40.992583    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qntmw\" (UniqueName: \"kubernetes.io/projected/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-kube-api-access-qntmw\") pod \"maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:41.093314 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:41.093279    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:41.093497 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:41.093324    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qntmw\" (UniqueName: \"kubernetes.io/projected/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-kube-api-access-qntmw\") pod \"maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:41.093497 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:41.093448    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:41.093497 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:41.093494    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:41.094003 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:41.093982    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:41.096016 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:41.095997    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:41.096140 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:41.096019    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:41.101366 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:41.101344    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qntmw\" (UniqueName: \"kubernetes.io/projected/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-kube-api-access-qntmw\") pod \"maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:41.213743 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:41.213665    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:41.489711 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:41.489685    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"]
Sep 11 20:31:41.491868 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:31:41.491844    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a1a9f4_5feb_4b32_9a0b_04e57706b23d.slice/crio-8b7b8e153d60f6a624a7e1aee05bcf943920e8601067534f1fe863ce2ad1b883 WatchSource:0}: Error finding container 8b7b8e153d60f6a624a7e1aee05bcf943920e8601067534f1fe863ce2ad1b883: Status 404 returned error can't find the container with id 8b7b8e153d60f6a624a7e1aee05bcf943920e8601067534f1fe863ce2ad1b883
Sep 11 20:31:41.962030 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:41.961989    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v" event={"ID":"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d","Type":"ContainerStarted","Data":"8b7b8e153d60f6a624a7e1aee05bcf943920e8601067534f1fe863ce2ad1b883"}
Sep 11 20:31:42.968736 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:42.968699    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v" event={"ID":"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d","Type":"ContainerStarted","Data":"8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051"}
Sep 11 20:31:42.969146 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:42.968763    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:31:42.986431 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:42.986380    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v" podStartSLOduration=2.500441314 podStartE2EDuration="2.986364339s" totalImagesPullingTime="485.923025ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:31:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:31:42.984898998 +0000 UTC m=+1888.146149241" watchObservedRunningTime="2026-09-11 20:31:42.986364339 +0000 UTC m=+1888.147614581"
Sep 11 20:31:48.978875 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:31:48.978848    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:32:19.192850 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.192811    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"]
Sep 11 20:32:19.193503 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.193116    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v" podUID="e9a1a9f4-5feb-4b32-9a0b-04e57706b23d" containerName="maas-api" containerID="cri-o://8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051" gracePeriod=30
Sep 11 20:32:19.452061 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.451996    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:32:19.453829 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.453805    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-metrics-certs\") pod \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") "
Sep 11 20:32:19.453906 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.453890    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-openshift-service-ca\") pod \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") "
Sep 11 20:32:19.454035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.453999    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qntmw\" (UniqueName: \"kubernetes.io/projected/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-kube-api-access-qntmw\") pod \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") "
Sep 11 20:32:19.454078 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.454046    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-maas-api-tls\") pod \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\" (UID: \"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d\") "
Sep 11 20:32:19.454275 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.454246    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e9a1a9f4-5feb-4b32-9a0b-04e57706b23d" (UID: "e9a1a9f4-5feb-4b32-9a0b-04e57706b23d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:32:19.454392 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.454337    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:32:19.455925 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.455894    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e9a1a9f4-5feb-4b32-9a0b-04e57706b23d" (UID: "e9a1a9f4-5feb-4b32-9a0b-04e57706b23d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:32:19.456045 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.456011    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e9a1a9f4-5feb-4b32-9a0b-04e57706b23d" (UID: "e9a1a9f4-5feb-4b32-9a0b-04e57706b23d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:32:19.456244 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.456216    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-kube-api-access-qntmw" (OuterVolumeSpecName: "kube-api-access-qntmw") pod "e9a1a9f4-5feb-4b32-9a0b-04e57706b23d" (UID: "e9a1a9f4-5feb-4b32-9a0b-04e57706b23d"). InnerVolumeSpecName "kube-api-access-qntmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:32:19.555500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.555455    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qntmw\" (UniqueName: \"kubernetes.io/projected/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-kube-api-access-qntmw\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:32:19.555500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.555490    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:32:19.555500 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:19.555504    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:32:20.161466 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:20.161432    2585 generic.go:356] "Generic (PLEG): container finished" podID="e9a1a9f4-5feb-4b32-9a0b-04e57706b23d" containerID="8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051" exitCode=0
Sep 11 20:32:20.161466 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:20.161467    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v" event={"ID":"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d","Type":"ContainerDied","Data":"8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051"}
Sep 11 20:32:20.161741 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:20.161483    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"
Sep 11 20:32:20.161741 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:20.161505    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v" event={"ID":"e9a1a9f4-5feb-4b32-9a0b-04e57706b23d","Type":"ContainerDied","Data":"8b7b8e153d60f6a624a7e1aee05bcf943920e8601067534f1fe863ce2ad1b883"}
Sep 11 20:32:20.161741 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:20.161526    2585 scope.go:117] "RemoveContainer" containerID="8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051"
Sep 11 20:32:20.172935 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:20.172916    2585 scope.go:117] "RemoveContainer" containerID="8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051"
Sep 11 20:32:20.173233 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:32:20.173208    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051\": container with ID starting with 8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051 not found: ID does not exist" containerID="8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051"
Sep 11 20:32:20.173338 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:20.173239    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051"} err="failed to get container status \"8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051\": rpc error: code = NotFound desc = could not find container \"8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051\": container with ID starting with 8f1ead1f2438d4d382104a3331fa60dd073a20c5e0f4bde8bc635c4e18ef6051 not found: ID does not exist"
Sep 11 20:32:20.184328 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:20.184304    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"]
Sep 11 20:32:20.187923 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:20.187904    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5de5ea-6df6fc4db8-wgl6v"]
Sep 11 20:32:21.349337 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:21.349306    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9a1a9f4-5feb-4b32-9a0b-04e57706b23d" path="/var/lib/kubelet/pods/e9a1a9f4-5feb-4b32-9a0b-04e57706b23d/volumes"
Sep 11 20:32:45.307929 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:45.307893    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x"]
Sep 11 20:32:45.309858 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:45.309833    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-248ab6-29819310-lsq8x"]
Sep 11 20:32:45.352672 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:32:45.352634    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48226183-3240-4674-a345-e2d26685fca8" path="/var/lib/kubelet/pods/48226183-3240-4674-a345-e2d26685fca8/volumes"
Sep 11 20:33:33.579191 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:33.579154    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"]
Sep 11 20:33:33.579720 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:33.579450    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy" containerID="cri-o://dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be" gracePeriod=30
Sep 11 20:33:38.830561 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.830536    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:33:38.964012 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.963934    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-istio-envoy\") pod \"5959f84d-71b3-44de-a342-397ea88e5e78\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") "
Sep 11 20:33:38.964012 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.963985    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-workload-socket\") pod \"5959f84d-71b3-44de-a342-397ea88e5e78\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") "
Sep 11 20:33:38.964234 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964049    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxn8n\" (UniqueName: \"kubernetes.io/projected/5959f84d-71b3-44de-a342-397ea88e5e78-kube-api-access-nxn8n\") pod \"5959f84d-71b3-44de-a342-397ea88e5e78\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") "
Sep 11 20:33:38.964234 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964085    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5959f84d-71b3-44de-a342-397ea88e5e78-istio-token\") pod \"5959f84d-71b3-44de-a342-397ea88e5e78\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") "
Sep 11 20:33:38.964234 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964122    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-credential-socket\") pod \"5959f84d-71b3-44de-a342-397ea88e5e78\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") "
Sep 11 20:33:38.964234 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964152    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5959f84d-71b3-44de-a342-397ea88e5e78-istiod-ca-cert\") pod \"5959f84d-71b3-44de-a342-397ea88e5e78\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") "
Sep 11 20:33:38.964234 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964185    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5959f84d-71b3-44de-a342-397ea88e5e78-istio-podinfo\") pod \"5959f84d-71b3-44de-a342-397ea88e5e78\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") "
Sep 11 20:33:38.964234 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964217    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-istio-data\") pod \"5959f84d-71b3-44de-a342-397ea88e5e78\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") "
Sep 11 20:33:38.964624 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964272    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-workload-certs\") pod \"5959f84d-71b3-44de-a342-397ea88e5e78\" (UID: \"5959f84d-71b3-44de-a342-397ea88e5e78\") "
Sep 11 20:33:38.964624 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964314    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5959f84d-71b3-44de-a342-397ea88e5e78" (UID: "5959f84d-71b3-44de-a342-397ea88e5e78"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:33:38.964624 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964499    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5959f84d-71b3-44de-a342-397ea88e5e78" (UID: "5959f84d-71b3-44de-a342-397ea88e5e78"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:33:38.964624 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964564    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:38.964851 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964652    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5959f84d-71b3-44de-a342-397ea88e5e78-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5959f84d-71b3-44de-a342-397ea88e5e78" (UID: "5959f84d-71b3-44de-a342-397ea88e5e78"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:33:38.964851 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964767    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5959f84d-71b3-44de-a342-397ea88e5e78" (UID: "5959f84d-71b3-44de-a342-397ea88e5e78"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:33:38.964851 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.964810    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-istio-data" (OuterVolumeSpecName: "istio-data") pod "5959f84d-71b3-44de-a342-397ea88e5e78" (UID: "5959f84d-71b3-44de-a342-397ea88e5e78"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:33:38.966213 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.966186    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5959f84d-71b3-44de-a342-397ea88e5e78" (UID: "5959f84d-71b3-44de-a342-397ea88e5e78"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:33:38.966426 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.966403    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5959f84d-71b3-44de-a342-397ea88e5e78-istio-token" (OuterVolumeSpecName: "istio-token") pod "5959f84d-71b3-44de-a342-397ea88e5e78" (UID: "5959f84d-71b3-44de-a342-397ea88e5e78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:33:38.966533 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.966405    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5959f84d-71b3-44de-a342-397ea88e5e78-kube-api-access-nxn8n" (OuterVolumeSpecName: "kube-api-access-nxn8n") pod "5959f84d-71b3-44de-a342-397ea88e5e78" (UID: "5959f84d-71b3-44de-a342-397ea88e5e78"). InnerVolumeSpecName "kube-api-access-nxn8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:33:38.966533 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:38.966504    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5959f84d-71b3-44de-a342-397ea88e5e78-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5959f84d-71b3-44de-a342-397ea88e5e78" (UID: "5959f84d-71b3-44de-a342-397ea88e5e78"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:33:39.065907 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.065882    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5959f84d-71b3-44de-a342-397ea88e5e78-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:39.065907 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.065902    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:39.065907 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.065911    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:39.066111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.065919    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:39.066111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.065927    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxn8n\" (UniqueName: \"kubernetes.io/projected/5959f84d-71b3-44de-a342-397ea88e5e78-kube-api-access-nxn8n\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:39.066111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.065936    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5959f84d-71b3-44de-a342-397ea88e5e78-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:39.066111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.065944    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5959f84d-71b3-44de-a342-397ea88e5e78-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:39.066111 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.065968    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5959f84d-71b3-44de-a342-397ea88e5e78-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:39.563466 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.563433    2585 generic.go:356] "Generic (PLEG): container finished" podID="5959f84d-71b3-44de-a342-397ea88e5e78" containerID="dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be" exitCode=0
Sep 11 20:33:39.563647 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.563483    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"
Sep 11 20:33:39.563647 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.563527    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" event={"ID":"5959f84d-71b3-44de-a342-397ea88e5e78","Type":"ContainerDied","Data":"dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be"}
Sep 11 20:33:39.563647 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.563579    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk" event={"ID":"5959f84d-71b3-44de-a342-397ea88e5e78","Type":"ContainerDied","Data":"d18903df1362041e1e7d93aaab7b64a068f63a79692b27c4e07fafe9e2774729"}
Sep 11 20:33:39.563647 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.563603    2585 scope.go:117] "RemoveContainer" containerID="dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be"
Sep 11 20:33:39.574470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.574447    2585 scope.go:117] "RemoveContainer" containerID="54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3"
Sep 11 20:33:39.582478 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.582461    2585 scope.go:117] "RemoveContainer" containerID="dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be"
Sep 11 20:33:39.582781 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:33:39.582759    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be\": container with ID starting with dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be not found: ID does not exist" containerID="dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be"
Sep 11 20:33:39.582878 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.582786    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be"} err="failed to get container status \"dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be\": rpc error: code = NotFound desc = could not find container \"dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be\": container with ID starting with dfacfa33832ed723aa0ab90e160f5c9c16095da39748ed190375d6da190d59be not found: ID does not exist"
Sep 11 20:33:39.582878 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.582804    2585 scope.go:117] "RemoveContainer" containerID="54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3"
Sep 11 20:33:39.583064 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.583025    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"]
Sep 11 20:33:39.583064 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:33:39.583037    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3\": container with ID starting with 54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3 not found: ID does not exist" containerID="54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3"
Sep 11 20:33:39.583064 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.583058    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3"} err="failed to get container status \"54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3\": rpc error: code = NotFound desc = could not find container \"54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3\": container with ID starting with 54c4d5c51e3dc78fad0e36dc7c62332b865cbdb502ece58fb3dde52a3f6c38f3 not found: ID does not exist"
Sep 11 20:33:39.586291 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:39.586269    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-248ab6-openshift-default-66b9d8f744-n9vzk"]
Sep 11 20:33:41.349127 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:41.349093    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" path="/var/lib/kubelet/pods/5959f84d-71b3-44de-a342-397ea88e5e78/volumes"
Sep 11 20:33:44.392176 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.392143    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"]
Sep 11 20:33:44.392682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.392385    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb" podUID="635c0e4a-f365-4b2a-b4b2-258cafa3429e" containerName="maas-api" containerID="cri-o://3ff6795673f949baeaa2a905e8e8fe929ecf5a18cbae3f0d10c02311fa4004cd" gracePeriod=30
Sep 11 20:33:44.590877 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.590848    2585 generic.go:356] "Generic (PLEG): container finished" podID="635c0e4a-f365-4b2a-b4b2-258cafa3429e" containerID="3ff6795673f949baeaa2a905e8e8fe929ecf5a18cbae3f0d10c02311fa4004cd" exitCode=0
Sep 11 20:33:44.591138 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.590917    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb" event={"ID":"635c0e4a-f365-4b2a-b4b2-258cafa3429e","Type":"ContainerDied","Data":"3ff6795673f949baeaa2a905e8e8fe929ecf5a18cbae3f0d10c02311fa4004cd"}
Sep 11 20:33:44.639004 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.638983    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:33:44.718103 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.718027    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-maas-api-tls\") pod \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") "
Sep 11 20:33:44.718268 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.718106    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/635c0e4a-f365-4b2a-b4b2-258cafa3429e-openshift-service-ca\") pod \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") "
Sep 11 20:33:44.718268 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.718186    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-metrics-certs\") pod \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") "
Sep 11 20:33:44.718268 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.718211    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mrsl\" (UniqueName: \"kubernetes.io/projected/635c0e4a-f365-4b2a-b4b2-258cafa3429e-kube-api-access-8mrsl\") pod \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\" (UID: \"635c0e4a-f365-4b2a-b4b2-258cafa3429e\") "
Sep 11 20:33:44.718460 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.718429    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/635c0e4a-f365-4b2a-b4b2-258cafa3429e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "635c0e4a-f365-4b2a-b4b2-258cafa3429e" (UID: "635c0e4a-f365-4b2a-b4b2-258cafa3429e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:33:44.720249 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.720218    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/635c0e4a-f365-4b2a-b4b2-258cafa3429e-kube-api-access-8mrsl" (OuterVolumeSpecName: "kube-api-access-8mrsl") pod "635c0e4a-f365-4b2a-b4b2-258cafa3429e" (UID: "635c0e4a-f365-4b2a-b4b2-258cafa3429e"). InnerVolumeSpecName "kube-api-access-8mrsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:33:44.720361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.720256    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "635c0e4a-f365-4b2a-b4b2-258cafa3429e" (UID: "635c0e4a-f365-4b2a-b4b2-258cafa3429e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:33:44.720361 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.720274    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "635c0e4a-f365-4b2a-b4b2-258cafa3429e" (UID: "635c0e4a-f365-4b2a-b4b2-258cafa3429e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:33:44.819118 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.819084    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:44.819118 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.819113    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mrsl\" (UniqueName: \"kubernetes.io/projected/635c0e4a-f365-4b2a-b4b2-258cafa3429e-kube-api-access-8mrsl\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:44.819118 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.819124    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/635c0e4a-f365-4b2a-b4b2-258cafa3429e-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:44.819362 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:44.819132    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/635c0e4a-f365-4b2a-b4b2-258cafa3429e-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:45.597722 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:45.597689    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"
Sep 11 20:33:45.598188 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:45.597719    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb" event={"ID":"635c0e4a-f365-4b2a-b4b2-258cafa3429e","Type":"ContainerDied","Data":"49dc0799df536f8db94d6be66ecdacb33b93b426da75796b233b9585c41e2e2e"}
Sep 11 20:33:45.598188 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:45.597782    2585 scope.go:117] "RemoveContainer" containerID="3ff6795673f949baeaa2a905e8e8fe929ecf5a18cbae3f0d10c02311fa4004cd"
Sep 11 20:33:45.613485 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:45.613457    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"]
Sep 11 20:33:45.619756 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:45.619727    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b6453d-cb6d65c89-6ddzb"]
Sep 11 20:33:47.349779 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:47.349746    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="635c0e4a-f365-4b2a-b4b2-258cafa3429e" path="/var/lib/kubelet/pods/635c0e4a-f365-4b2a-b4b2-258cafa3429e/volumes"
Sep 11 20:33:50.921728 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:50.921690    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"]
Sep 11 20:33:50.922121 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:50.921907    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy" containerID="cri-o://ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39" gracePeriod=30
Sep 11 20:33:52.681408 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:52.681376    2585 patch_prober.go:28] interesting pod/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 20:33:52.681868 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:52.681444    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 20:33:56.184507 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.184448    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:33:56.225405 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.225370    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54d29dca-edf5-42bf-a565-d783ea6622d8-istiod-ca-cert\") pod \"54d29dca-edf5-42bf-a565-d783ea6622d8\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") "
Sep 11 20:33:56.225537 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.225416    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-credential-socket\") pod \"54d29dca-edf5-42bf-a565-d783ea6622d8\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") "
Sep 11 20:33:56.225586 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.225548    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-podinfo\") pod \"54d29dca-edf5-42bf-a565-d783ea6622d8\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") "
Sep 11 20:33:56.225639 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.225599    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-envoy\") pod \"54d29dca-edf5-42bf-a565-d783ea6622d8\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") "
Sep 11 20:33:56.225639 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.225630    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-data\") pod \"54d29dca-edf5-42bf-a565-d783ea6622d8\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") "
Sep 11 20:33:56.225746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.225659    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-workload-socket\") pod \"54d29dca-edf5-42bf-a565-d783ea6622d8\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") "
Sep 11 20:33:56.225746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.225691    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-workload-certs\") pod \"54d29dca-edf5-42bf-a565-d783ea6622d8\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") "
Sep 11 20:33:56.225746 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.225704    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54d29dca-edf5-42bf-a565-d783ea6622d8" (UID: "54d29dca-edf5-42bf-a565-d783ea6622d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:33:56.225907 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.225764    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54d29dca-edf5-42bf-a565-d783ea6622d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54d29dca-edf5-42bf-a565-d783ea6622d8" (UID: "54d29dca-edf5-42bf-a565-d783ea6622d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:33:56.225907 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.225782    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnnpv\" (UniqueName: \"kubernetes.io/projected/54d29dca-edf5-42bf-a565-d783ea6622d8-kube-api-access-mnnpv\") pod \"54d29dca-edf5-42bf-a565-d783ea6622d8\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") "
Sep 11 20:33:56.225907 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.225826    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-token\") pod \"54d29dca-edf5-42bf-a565-d783ea6622d8\" (UID: \"54d29dca-edf5-42bf-a565-d783ea6622d8\") "
Sep 11 20:33:56.226096 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.225919    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54d29dca-edf5-42bf-a565-d783ea6622d8" (UID: "54d29dca-edf5-42bf-a565-d783ea6622d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:33:56.226096 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.226053    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54d29dca-edf5-42bf-a565-d783ea6622d8" (UID: "54d29dca-edf5-42bf-a565-d783ea6622d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:33:56.226199 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.226138    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54d29dca-edf5-42bf-a565-d783ea6622d8-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:56.226199 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.226157    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:56.226199 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.226174    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:56.226199 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.226187    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:56.226413 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.226203    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "54d29dca-edf5-42bf-a565-d783ea6622d8" (UID: "54d29dca-edf5-42bf-a565-d783ea6622d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:33:56.227759 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.227735    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54d29dca-edf5-42bf-a565-d783ea6622d8" (UID: "54d29dca-edf5-42bf-a565-d783ea6622d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:33:56.227896 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.227855    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "54d29dca-edf5-42bf-a565-d783ea6622d8" (UID: "54d29dca-edf5-42bf-a565-d783ea6622d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:33:56.228230 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.228211    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54d29dca-edf5-42bf-a565-d783ea6622d8" (UID: "54d29dca-edf5-42bf-a565-d783ea6622d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:33:56.228287 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.228211    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54d29dca-edf5-42bf-a565-d783ea6622d8-kube-api-access-mnnpv" (OuterVolumeSpecName: "kube-api-access-mnnpv") pod "54d29dca-edf5-42bf-a565-d783ea6622d8" (UID: "54d29dca-edf5-42bf-a565-d783ea6622d8"). InnerVolumeSpecName "kube-api-access-mnnpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:33:56.327005 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.326974    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:56.327005 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.327003    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnnpv\" (UniqueName: \"kubernetes.io/projected/54d29dca-edf5-42bf-a565-d783ea6622d8-kube-api-access-mnnpv\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:56.327196 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.327014    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:56.327196 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.327026    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:56.327196 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.327037    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54d29dca-edf5-42bf-a565-d783ea6622d8-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:33:56.656546 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.656511    2585 generic.go:356] "Generic (PLEG): container finished" podID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerID="ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39" exitCode=0
Sep 11 20:33:56.656694 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.656596    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" event={"ID":"54d29dca-edf5-42bf-a565-d783ea6622d8","Type":"ContainerDied","Data":"ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39"}
Sep 11 20:33:56.656694 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.656611    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"
Sep 11 20:33:56.656694 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.656653    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld" event={"ID":"54d29dca-edf5-42bf-a565-d783ea6622d8","Type":"ContainerDied","Data":"a850f20129ba1a1071872db50c313003ed5d71da6ad7546ff03937befa5f35d9"}
Sep 11 20:33:56.656694 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.656684    2585 scope.go:117] "RemoveContainer" containerID="ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39"
Sep 11 20:33:56.666615 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.666586    2585 scope.go:117] "RemoveContainer" containerID="f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa"
Sep 11 20:33:56.674300 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.674279    2585 scope.go:117] "RemoveContainer" containerID="ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39"
Sep 11 20:33:56.674556 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:33:56.674538    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39\": container with ID starting with ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39 not found: ID does not exist" containerID="ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39"
Sep 11 20:33:56.674617 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.674564    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39"} err="failed to get container status \"ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39\": rpc error: code = NotFound desc = could not find container \"ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39\": container with ID starting with ebd1b1580973766d29ba32e70b8320b3627482a0e1a5da55aa2f0d58c31e0a39 not found: ID does not exist"
Sep 11 20:33:56.674617 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.674587    2585 scope.go:117] "RemoveContainer" containerID="f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa"
Sep 11 20:33:56.674848 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:33:56.674829    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa\": container with ID starting with f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa not found: ID does not exist" containerID="f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa"
Sep 11 20:33:56.674899 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.674853    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa"} err="failed to get container status \"f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa\": rpc error: code = NotFound desc = could not find container \"f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa\": container with ID starting with f1973a3d53df6f7f3b826e566a013b6700b1f63185e34cf4edae6cd2408860aa not found: ID does not exist"
Sep 11 20:33:56.678107 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.678086    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"]
Sep 11 20:33:56.682271 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:56.682249    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-b6453d-openshift-default-54ddcd7c4d-v94ld"]
Sep 11 20:33:57.349222 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:33:57.349194    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" path="/var/lib/kubelet/pods/54d29dca-edf5-42bf-a565-d783ea6622d8/volumes"
Sep 11 20:34:01.676320 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:01.676289    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"]
Sep 11 20:34:01.676813 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:01.676474    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs" podUID="b850fadc-dbe5-4c94-ad3a-45fe81021b8f" containerName="maas-api" containerID="cri-o://163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e" gracePeriod=30
Sep 11 20:34:01.926520 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:01.926458    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:34:01.976831 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:01.976801    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-openshift-service-ca\") pod \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") "
Sep 11 20:34:01.977025 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:01.976841    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-metrics-certs\") pod \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") "
Sep 11 20:34:01.977025 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:01.976893    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-maas-api-tls\") pod \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") "
Sep 11 20:34:01.977025 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:01.976941    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjhlv\" (UniqueName: \"kubernetes.io/projected/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-kube-api-access-fjhlv\") pod \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\" (UID: \"b850fadc-dbe5-4c94-ad3a-45fe81021b8f\") "
Sep 11 20:34:01.977227 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:01.977195    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b850fadc-dbe5-4c94-ad3a-45fe81021b8f" (UID: "b850fadc-dbe5-4c94-ad3a-45fe81021b8f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:34:01.979146 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:01.979119    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b850fadc-dbe5-4c94-ad3a-45fe81021b8f" (UID: "b850fadc-dbe5-4c94-ad3a-45fe81021b8f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:34:01.979258 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:01.979202    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b850fadc-dbe5-4c94-ad3a-45fe81021b8f" (UID: "b850fadc-dbe5-4c94-ad3a-45fe81021b8f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:34:01.979323 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:01.979281    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-kube-api-access-fjhlv" (OuterVolumeSpecName: "kube-api-access-fjhlv") pod "b850fadc-dbe5-4c94-ad3a-45fe81021b8f" (UID: "b850fadc-dbe5-4c94-ad3a-45fe81021b8f"). InnerVolumeSpecName "kube-api-access-fjhlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:34:02.078276 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.078234    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:02.078276 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.078269    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjhlv\" (UniqueName: \"kubernetes.io/projected/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-kube-api-access-fjhlv\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:02.078276 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.078283    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:02.078513 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.078295    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b850fadc-dbe5-4c94-ad3a-45fe81021b8f-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:02.688598 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.688562    2585 generic.go:356] "Generic (PLEG): container finished" podID="b850fadc-dbe5-4c94-ad3a-45fe81021b8f" containerID="163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e" exitCode=0
Sep 11 20:34:02.689023 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.688608    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"
Sep 11 20:34:02.689023 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.688647    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs" event={"ID":"b850fadc-dbe5-4c94-ad3a-45fe81021b8f","Type":"ContainerDied","Data":"163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e"}
Sep 11 20:34:02.689023 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.688705    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs" event={"ID":"b850fadc-dbe5-4c94-ad3a-45fe81021b8f","Type":"ContainerDied","Data":"a931eb5b790ae77644d5005a3b5b30c0dbb28b6d95b04470c53080373889ca61"}
Sep 11 20:34:02.689023 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.688729    2585 scope.go:117] "RemoveContainer" containerID="163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e"
Sep 11 20:34:02.698538 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.698520    2585 scope.go:117] "RemoveContainer" containerID="163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e"
Sep 11 20:34:02.698866 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:34:02.698846    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e\": container with ID starting with 163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e not found: ID does not exist" containerID="163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e"
Sep 11 20:34:02.698918 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.698875    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e"} err="failed to get container status \"163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e\": rpc error: code = NotFound desc = could not find container \"163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e\": container with ID starting with 163b7ff07e058eed6a54744486d2d8ca9849af76d0f9d8ac30b2246f62161a5e not found: ID does not exist"
Sep 11 20:34:02.710488 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.710464    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"]
Sep 11 20:34:02.713805 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:02.713784    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fcb0e4-77bbb54f77-rjbgs"]
Sep 11 20:34:03.350099 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:03.350064    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b850fadc-dbe5-4c94-ad3a-45fe81021b8f" path="/var/lib/kubelet/pods/b850fadc-dbe5-4c94-ad3a-45fe81021b8f/volumes"
Sep 11 20:34:18.897618 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:18.897586    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"]
Sep 11 20:34:18.898160 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:18.897848    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x" podUID="726e130a-b8c6-4141-97a4-16d783f66b22" containerName="maas-api" containerID="cri-o://0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f" gracePeriod=30
Sep 11 20:34:19.138599 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.138567    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:34:19.217183 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.217102    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltkfx\" (UniqueName: \"kubernetes.io/projected/726e130a-b8c6-4141-97a4-16d783f66b22-kube-api-access-ltkfx\") pod \"726e130a-b8c6-4141-97a4-16d783f66b22\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") "
Sep 11 20:34:19.217183 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.217146    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/726e130a-b8c6-4141-97a4-16d783f66b22-maas-api-tls\") pod \"726e130a-b8c6-4141-97a4-16d783f66b22\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") "
Sep 11 20:34:19.217372 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.217184    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/726e130a-b8c6-4141-97a4-16d783f66b22-metrics-certs\") pod \"726e130a-b8c6-4141-97a4-16d783f66b22\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") "
Sep 11 20:34:19.217372 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.217234    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/726e130a-b8c6-4141-97a4-16d783f66b22-openshift-service-ca\") pod \"726e130a-b8c6-4141-97a4-16d783f66b22\" (UID: \"726e130a-b8c6-4141-97a4-16d783f66b22\") "
Sep 11 20:34:19.217633 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.217603    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/726e130a-b8c6-4141-97a4-16d783f66b22-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "726e130a-b8c6-4141-97a4-16d783f66b22" (UID: "726e130a-b8c6-4141-97a4-16d783f66b22"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:34:19.219307 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.219281    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/726e130a-b8c6-4141-97a4-16d783f66b22-kube-api-access-ltkfx" (OuterVolumeSpecName: "kube-api-access-ltkfx") pod "726e130a-b8c6-4141-97a4-16d783f66b22" (UID: "726e130a-b8c6-4141-97a4-16d783f66b22"). InnerVolumeSpecName "kube-api-access-ltkfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:34:19.219307 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.219290    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/726e130a-b8c6-4141-97a4-16d783f66b22-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "726e130a-b8c6-4141-97a4-16d783f66b22" (UID: "726e130a-b8c6-4141-97a4-16d783f66b22"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:34:19.219454 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.219309    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/726e130a-b8c6-4141-97a4-16d783f66b22-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "726e130a-b8c6-4141-97a4-16d783f66b22" (UID: "726e130a-b8c6-4141-97a4-16d783f66b22"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:34:19.318135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.318099    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/726e130a-b8c6-4141-97a4-16d783f66b22-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:19.318135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.318130    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltkfx\" (UniqueName: \"kubernetes.io/projected/726e130a-b8c6-4141-97a4-16d783f66b22-kube-api-access-ltkfx\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:19.318135 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.318144    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/726e130a-b8c6-4141-97a4-16d783f66b22-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:19.318378 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.318155    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/726e130a-b8c6-4141-97a4-16d783f66b22-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:19.776459 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.776164    2585 generic.go:356] "Generic (PLEG): container finished" podID="726e130a-b8c6-4141-97a4-16d783f66b22" containerID="0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f" exitCode=0
Sep 11 20:34:19.776459 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.776213    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"
Sep 11 20:34:19.776459 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.776230    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x" event={"ID":"726e130a-b8c6-4141-97a4-16d783f66b22","Type":"ContainerDied","Data":"0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f"}
Sep 11 20:34:19.776459 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.776289    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x" event={"ID":"726e130a-b8c6-4141-97a4-16d783f66b22","Type":"ContainerDied","Data":"3a2d4fc73189984cd8848dad53253d7176a62f61fb6028be860009c29105cf51"}
Sep 11 20:34:19.776459 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.776321    2585 scope.go:117] "RemoveContainer" containerID="0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f"
Sep 11 20:34:19.784934 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.784915    2585 scope.go:117] "RemoveContainer" containerID="0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f"
Sep 11 20:34:19.785194 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:34:19.785176    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f\": container with ID starting with 0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f not found: ID does not exist" containerID="0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f"
Sep 11 20:34:19.785243 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.785200    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f"} err="failed to get container status \"0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f\": rpc error: code = NotFound desc = could not find container \"0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f\": container with ID starting with 0ea7fd97c069dbc1ad6ce56f0387b64955bf0ef985d7991c52c046ebeaf9160f not found: ID does not exist"
Sep 11 20:34:19.796591 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.796567    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"]
Sep 11 20:34:19.804051 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:19.804032    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-092e1a-699574cfcd-xsf2x"]
Sep 11 20:34:21.349663 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:21.349625    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="726e130a-b8c6-4141-97a4-16d783f66b22" path="/var/lib/kubelet/pods/726e130a-b8c6-4141-97a4-16d783f66b22/volumes"
Sep 11 20:34:25.420458 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:25.420419    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"]
Sep 11 20:34:25.420976 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:25.420677    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerName="istio-proxy" containerID="cri-o://7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb" gracePeriod=30
Sep 11 20:34:30.671380 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.671355    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:34:30.815836 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.815767    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-podinfo\") pod \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") "
Sep 11 20:34:30.815836 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.815804    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-credential-socket\") pod \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") "
Sep 11 20:34:30.815836 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.815828    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-token\") pod \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") "
Sep 11 20:34:30.816131 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.815865    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t5mn\" (UniqueName: \"kubernetes.io/projected/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-kube-api-access-7t5mn\") pod \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") "
Sep 11 20:34:30.816131 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.815914    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istiod-ca-cert\") pod \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") "
Sep 11 20:34:30.816131 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.815973    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-workload-socket\") pod \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") "
Sep 11 20:34:30.816131 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.816002    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-workload-certs\") pod \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") "
Sep 11 20:34:30.816131 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.816041    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-envoy\") pod \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") "
Sep 11 20:34:30.816131 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.816070    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" (UID: "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:34:30.816131 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.816078    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-data\") pod \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\" (UID: \"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a\") "
Sep 11 20:34:30.816508 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.816254    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" (UID: "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:34:30.816508 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.816270    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-data" (OuterVolumeSpecName: "istio-data") pod "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" (UID: "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:34:30.816508 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.816467    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-workload-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:30.816508 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.816473    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" (UID: "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:34:30.816508 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.816488    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-data\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:30.816508 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.816504    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-credential-socket\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:30.816894 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.816552    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" (UID: "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:34:30.818049 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.818024    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" (UID: "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:34:30.818172 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.818158    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-token" (OuterVolumeSpecName: "istio-token") pod "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" (UID: "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:34:30.818241 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.818224    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" (UID: "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:34:30.818334 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.818317    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-kube-api-access-7t5mn" (OuterVolumeSpecName: "kube-api-access-7t5mn") pod "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" (UID: "7479543d-c2a6-4b6d-bb39-1aaa2aa6853a"). InnerVolumeSpecName "kube-api-access-7t5mn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:34:30.829030 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.828980    2585 generic.go:356] "Generic (PLEG): container finished" podID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerID="7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb" exitCode=0
Sep 11 20:34:30.829030 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.829025    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" event={"ID":"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a","Type":"ContainerDied","Data":"7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb"}
Sep 11 20:34:30.829198 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.829068    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld" event={"ID":"7479543d-c2a6-4b6d-bb39-1aaa2aa6853a","Type":"ContainerDied","Data":"1cd67986da2824048d35585b9220b7f70d865884d905a1ac73508ee473e40b87"}
Sep 11 20:34:30.829198 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.829089    2585 scope.go:117] "RemoveContainer" containerID="7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb"
Sep 11 20:34:30.829198 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.829091    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"
Sep 11 20:34:30.837474 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.837455    2585 scope.go:117] "RemoveContainer" containerID="11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4"
Sep 11 20:34:30.844926 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.844904    2585 scope.go:117] "RemoveContainer" containerID="7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb"
Sep 11 20:34:30.845189 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:34:30.845170    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb\": container with ID starting with 7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb not found: ID does not exist" containerID="7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb"
Sep 11 20:34:30.845267 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.845201    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb"} err="failed to get container status \"7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb\": rpc error: code = NotFound desc = could not find container \"7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb\": container with ID starting with 7bb46156054466a1fa8834b49cd2525f66e9beb99c548a4c32a2a22b4bba20fb not found: ID does not exist"
Sep 11 20:34:30.845267 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.845224    2585 scope.go:117] "RemoveContainer" containerID="11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4"
Sep 11 20:34:30.845486 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:34:30.845469    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4\": container with ID starting with 11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4 not found: ID does not exist" containerID="11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4"
Sep 11 20:34:30.845530 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.845492    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4"} err="failed to get container status \"11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4\": rpc error: code = NotFound desc = could not find container \"11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4\": container with ID starting with 11e51ef19a6836e3ea61e64901c4a78f38eeebd2f12c432b8923e04b0fd088e4 not found: ID does not exist"
Sep 11 20:34:30.851184 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.851153    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"]
Sep 11 20:34:30.853448 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.853425    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-092e1a-openshift-default-687bb54766-bgpld"]
Sep 11 20:34:30.917151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.917125    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istiod-ca-cert\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:30.917151 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.917147    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-workload-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:30.917285 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.917156    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-envoy\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:30.917285 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.917164    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-podinfo\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:30.917285 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.917172    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-istio-token\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:30.917285 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:30.917183    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t5mn\" (UniqueName: \"kubernetes.io/projected/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a-kube-api-access-7t5mn\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:34:31.349917 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:34:31.349886    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" path="/var/lib/kubelet/pods/7479543d-c2a6-4b6d-bb39-1aaa2aa6853a/volumes"
Sep 11 20:35:15.503689 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:35:15.503662    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:35:15.510412 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:35:15.510382    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:36:15.676088 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:36:15.676006    2585 scope.go:117] "RemoveContainer" containerID="c073ebc61adcf029f6e4386d70780c6dd1684c9daba6de10cf226d86e56b85ee"
Sep 11 20:37:08.419514 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:08.419478    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"]
Sep 11 20:37:08.420059 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:08.419715    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5" podUID="02b24688-76e2-4ae9-b488-928c0502334a" containerName="manager" containerID="cri-o://dcf23a9ccf3c0eba137f3c1d9ec81444a083f0207929d47aa505b38fb1bcc740" gracePeriod=10
Sep 11 20:37:08.558921 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:08.558890    2585 generic.go:356] "Generic (PLEG): container finished" podID="02b24688-76e2-4ae9-b488-928c0502334a" containerID="dcf23a9ccf3c0eba137f3c1d9ec81444a083f0207929d47aa505b38fb1bcc740" exitCode=0
Sep 11 20:37:08.559070 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:08.558926    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5" event={"ID":"02b24688-76e2-4ae9-b488-928c0502334a","Type":"ContainerDied","Data":"dcf23a9ccf3c0eba137f3c1d9ec81444a083f0207929d47aa505b38fb1bcc740"}
Sep 11 20:37:08.664440 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:08.664417    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"
Sep 11 20:37:08.726386 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:08.726316    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02b24688-76e2-4ae9-b488-928c0502334a-extensions-socket-volume\") pod \"02b24688-76e2-4ae9-b488-928c0502334a\" (UID: \"02b24688-76e2-4ae9-b488-928c0502334a\") "
Sep 11 20:37:08.726386 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:08.726376    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp26m\" (UniqueName: \"kubernetes.io/projected/02b24688-76e2-4ae9-b488-928c0502334a-kube-api-access-tp26m\") pod \"02b24688-76e2-4ae9-b488-928c0502334a\" (UID: \"02b24688-76e2-4ae9-b488-928c0502334a\") "
Sep 11 20:37:08.726661 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:08.726641    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02b24688-76e2-4ae9-b488-928c0502334a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "02b24688-76e2-4ae9-b488-928c0502334a" (UID: "02b24688-76e2-4ae9-b488-928c0502334a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:37:08.728533 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:08.728507    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02b24688-76e2-4ae9-b488-928c0502334a-kube-api-access-tp26m" (OuterVolumeSpecName: "kube-api-access-tp26m") pod "02b24688-76e2-4ae9-b488-928c0502334a" (UID: "02b24688-76e2-4ae9-b488-928c0502334a"). InnerVolumeSpecName "kube-api-access-tp26m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:37:08.827058 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:08.827014    2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02b24688-76e2-4ae9-b488-928c0502334a-extensions-socket-volume\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:37:08.827058 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:08.827054    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp26m\" (UniqueName: \"kubernetes.io/projected/02b24688-76e2-4ae9-b488-928c0502334a-kube-api-access-tp26m\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:37:09.564314 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:09.564286    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"
Sep 11 20:37:09.564793 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:09.564322    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5" event={"ID":"02b24688-76e2-4ae9-b488-928c0502334a","Type":"ContainerDied","Data":"6342c747969d09caea7a92f43cbdf1a3fc7ec69a75d32a3934ec437cbc2228a8"}
Sep 11 20:37:09.564793 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:09.564390    2585 scope.go:117] "RemoveContainer" containerID="dcf23a9ccf3c0eba137f3c1d9ec81444a083f0207929d47aa505b38fb1bcc740"
Sep 11 20:37:09.582522 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:09.582500    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"]
Sep 11 20:37:09.587060 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:09.587039    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-t6rx5"]
Sep 11 20:37:11.352271 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:37:11.352240    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02b24688-76e2-4ae9-b488-928c0502334a" path="/var/lib/kubelet/pods/02b24688-76e2-4ae9-b488-928c0502334a/volumes"
Sep 11 20:38:09.103375 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103341    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"]
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103663    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103674    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103686    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02b24688-76e2-4ae9-b488-928c0502334a" containerName="manager"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103692    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="02b24688-76e2-4ae9-b488-928c0502334a" containerName="manager"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103700    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726e130a-b8c6-4141-97a4-16d783f66b22" containerName="maas-api"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103707    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="726e130a-b8c6-4141-97a4-16d783f66b22" containerName="maas-api"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103714    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b850fadc-dbe5-4c94-ad3a-45fe81021b8f" containerName="maas-api"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103719    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b850fadc-dbe5-4c94-ad3a-45fe81021b8f" containerName="maas-api"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103725    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a1a9f4-5feb-4b32-9a0b-04e57706b23d" containerName="maas-api"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103730    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a1a9f4-5feb-4b32-9a0b-04e57706b23d" containerName="maas-api"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103738    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103743    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103750    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103754    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103764    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="635c0e4a-f365-4b2a-b4b2-258cafa3429e" containerName="maas-api"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103769    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="635c0e4a-f365-4b2a-b4b2-258cafa3429e" containerName="maas-api"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103782    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerName="istio-proxy"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103787    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerName="istio-proxy"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103793    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerName="istio-proxy"
Sep 11 20:38:09.103828 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103798    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerName="istio-proxy"
Sep 11 20:38:09.104475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103842    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="635c0e4a-f365-4b2a-b4b2-258cafa3429e" containerName="maas-api"
Sep 11 20:38:09.104475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103849    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9a1a9f4-5feb-4b32-9a0b-04e57706b23d" containerName="maas-api"
Sep 11 20:38:09.104475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103855    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy"
Sep 11 20:38:09.104475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103860    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy"
Sep 11 20:38:09.104475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103865    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b850fadc-dbe5-4c94-ad3a-45fe81021b8f" containerName="maas-api"
Sep 11 20:38:09.104475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103872    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="02b24688-76e2-4ae9-b488-928c0502334a" containerName="manager"
Sep 11 20:38:09.104475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103877    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerName="istio-proxy"
Sep 11 20:38:09.104475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103884    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy"
Sep 11 20:38:09.104475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103891    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7479543d-c2a6-4b6d-bb39-1aaa2aa6853a" containerName="istio-proxy"
Sep 11 20:38:09.104475 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.103896    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="726e130a-b8c6-4141-97a4-16d783f66b22" containerName="maas-api"
Sep 11 20:38:09.106684 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.106666    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"
Sep 11 20:38:09.109228 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.109209    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vn2ls\""
Sep 11 20:38:09.120011 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.119982    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"]
Sep 11 20:38:09.223770 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.223733    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1accc25e-aef3-4d60-97ae-ee265cb858fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-q5xvb\" (UID: \"1accc25e-aef3-4d60-97ae-ee265cb858fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"
Sep 11 20:38:09.223951 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.223845    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4sh8\" (UniqueName: \"kubernetes.io/projected/1accc25e-aef3-4d60-97ae-ee265cb858fe-kube-api-access-q4sh8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-q5xvb\" (UID: \"1accc25e-aef3-4d60-97ae-ee265cb858fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"
Sep 11 20:38:09.325003 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.324948    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1accc25e-aef3-4d60-97ae-ee265cb858fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-q5xvb\" (UID: \"1accc25e-aef3-4d60-97ae-ee265cb858fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"
Sep 11 20:38:09.325173 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.325077    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4sh8\" (UniqueName: \"kubernetes.io/projected/1accc25e-aef3-4d60-97ae-ee265cb858fe-kube-api-access-q4sh8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-q5xvb\" (UID: \"1accc25e-aef3-4d60-97ae-ee265cb858fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"
Sep 11 20:38:09.325404 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.325383    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1accc25e-aef3-4d60-97ae-ee265cb858fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-q5xvb\" (UID: \"1accc25e-aef3-4d60-97ae-ee265cb858fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"
Sep 11 20:38:09.334761 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.334731    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4sh8\" (UniqueName: \"kubernetes.io/projected/1accc25e-aef3-4d60-97ae-ee265cb858fe-kube-api-access-q4sh8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-q5xvb\" (UID: \"1accc25e-aef3-4d60-97ae-ee265cb858fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"
Sep 11 20:38:09.416389 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.416319    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"
Sep 11 20:38:09.733251 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.733228    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"]
Sep 11 20:38:09.735457 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:38:09.735431    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1accc25e_aef3_4d60_97ae_ee265cb858fe.slice/crio-ee624b66155fc831e727f8ba9b1b353cb52a6bc224d6d69a65fda96a035c825c WatchSource:0}: Error finding container ee624b66155fc831e727f8ba9b1b353cb52a6bc224d6d69a65fda96a035c825c: Status 404 returned error can't find the container with id ee624b66155fc831e727f8ba9b1b353cb52a6bc224d6d69a65fda96a035c825c
Sep 11 20:38:09.838245 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.838212    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb" event={"ID":"1accc25e-aef3-4d60-97ae-ee265cb858fe","Type":"ContainerStarted","Data":"e775157860ca01661276c22be6b71068b4da7d8198db550856501f108a96411b"}
Sep 11 20:38:09.838359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.838288    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb" event={"ID":"1accc25e-aef3-4d60-97ae-ee265cb858fe","Type":"ContainerStarted","Data":"ee624b66155fc831e727f8ba9b1b353cb52a6bc224d6d69a65fda96a035c825c"}
Sep 11 20:38:09.838359 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.838335    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"
Sep 11 20:38:09.859066 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:09.859021    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb" podStartSLOduration=0.859007455 podStartE2EDuration="859.007455ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:38:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:38:09.858391852 +0000 UTC m=+2275.019642096" watchObservedRunningTime="2026-09-11 20:38:09.859007455 +0000 UTC m=+2275.020257697"
Sep 11 20:38:20.845818 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:20.845787    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q5xvb"
Sep 11 20:38:49.281360 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.281325    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"]
Sep 11 20:38:49.282043 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.281832    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy"
Sep 11 20:38:49.282043 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.281851    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d29dca-edf5-42bf-a565-d783ea6622d8" containerName="istio-proxy"
Sep 11 20:38:49.282043 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.281996    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5959f84d-71b3-44de-a342-397ea88e5e78" containerName="istio-proxy"
Sep 11 20:38:49.285459 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.285440    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.287770 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.287749    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-32def012-kserve-self-signed-certs\""
Sep 11 20:38:49.291863 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.291840    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"]
Sep 11 20:38:49.366885 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.366855    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-dshm\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.367076 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.367016    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-home\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.367076 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.367052    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-model-cache\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.367213 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.367083    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e99c6e-d3fc-4cea-b0cd-d127abab1169-tls-certs\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.367213 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.367109    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-tmp-dir\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.367312 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.367206    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crgqr\" (UniqueName: \"kubernetes.io/projected/92e99c6e-d3fc-4cea-b0cd-d127abab1169-kube-api-access-crgqr\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.468476 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.468439    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-home\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.468659 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.468490    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-model-cache\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.468659 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.468512    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e99c6e-d3fc-4cea-b0cd-d127abab1169-tls-certs\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.468659 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.468531    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-tmp-dir\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.468659 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.468569    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crgqr\" (UniqueName: \"kubernetes.io/projected/92e99c6e-d3fc-4cea-b0cd-d127abab1169-kube-api-access-crgqr\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.468659 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.468601    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-dshm\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.468932 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.468831    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-home\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.468932 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.468908    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-model-cache\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.469061 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.469023    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-tmp-dir\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.470839 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.470819    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-dshm\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.471248 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.471227    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e99c6e-d3fc-4cea-b0cd-d127abab1169-tls-certs\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.476165 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.476144    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crgqr\" (UniqueName: \"kubernetes.io/projected/92e99c6e-d3fc-4cea-b0cd-d127abab1169-kube-api-access-crgqr\") pod \"e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") " pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.596296 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.596264    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:49.864532 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:49.864466    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"]
Sep 11 20:38:49.867043 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:38:49.867013    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92e99c6e_d3fc_4cea_b0cd_d127abab1169.slice/crio-c4d0ca5aa9cc5ff158869f4741e724fd81d32dec061b8e297641e55af50031e7 WatchSource:0}: Error finding container c4d0ca5aa9cc5ff158869f4741e724fd81d32dec061b8e297641e55af50031e7: Status 404 returned error can't find the container with id c4d0ca5aa9cc5ff158869f4741e724fd81d32dec061b8e297641e55af50031e7
Sep 11 20:38:50.025252 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:50.025212    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn" event={"ID":"92e99c6e-d3fc-4cea-b0cd-d127abab1169","Type":"ContainerStarted","Data":"242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008"}
Sep 11 20:38:50.025404 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:50.025261    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn" event={"ID":"92e99c6e-d3fc-4cea-b0cd-d127abab1169","Type":"ContainerStarted","Data":"c4d0ca5aa9cc5ff158869f4741e724fd81d32dec061b8e297641e55af50031e7"}
Sep 11 20:38:50.041654 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:50.041605    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn" podStartSLOduration=1.041587495 podStartE2EDuration="1.041587495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:38:50.041231632 +0000 UTC m=+2315.202481875" watchObservedRunningTime="2026-09-11 20:38:50.041587495 +0000 UTC m=+2315.202837736"
Sep 11 20:38:59.597357 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:59.597323    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:59.597850 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:59.597603    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:38:59.609928 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:38:59.609904    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:39:00.082266 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:00.082240    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:39:27.186188 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:27.186151    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"]
Sep 11 20:39:42.205451 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.205399    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn" podUID="92e99c6e-d3fc-4cea-b0cd-d127abab1169" containerName="main" containerID="cri-o://242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008" gracePeriod=45
Sep 11 20:39:42.459230 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.459172    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:39:42.509575 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.509545    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e99c6e-d3fc-4cea-b0cd-d127abab1169-tls-certs\") pod \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") "
Sep 11 20:39:42.509704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.509609    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-dshm\") pod \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") "
Sep 11 20:39:42.509704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.509632    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-model-cache\") pod \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") "
Sep 11 20:39:42.509704 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.509661    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-home\") pod \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") "
Sep 11 20:39:42.509845 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.509707    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-tmp-dir\") pod \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") "
Sep 11 20:39:42.509845 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.509757    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crgqr\" (UniqueName: \"kubernetes.io/projected/92e99c6e-d3fc-4cea-b0cd-d127abab1169-kube-api-access-crgqr\") pod \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\" (UID: \"92e99c6e-d3fc-4cea-b0cd-d127abab1169\") "
Sep 11 20:39:42.509984 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.509866    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-model-cache" (OuterVolumeSpecName: "model-cache") pod "92e99c6e-d3fc-4cea-b0cd-d127abab1169" (UID: "92e99c6e-d3fc-4cea-b0cd-d127abab1169"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:39:42.509984 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.509884    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-home" (OuterVolumeSpecName: "home") pod "92e99c6e-d3fc-4cea-b0cd-d127abab1169" (UID: "92e99c6e-d3fc-4cea-b0cd-d127abab1169"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:39:42.510107 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.510056    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "92e99c6e-d3fc-4cea-b0cd-d127abab1169" (UID: "92e99c6e-d3fc-4cea-b0cd-d127abab1169"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:39:42.510107 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.510084    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-model-cache\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:39:42.510107 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.510105    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-home\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:39:42.511819 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.511787    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92e99c6e-d3fc-4cea-b0cd-d127abab1169-kube-api-access-crgqr" (OuterVolumeSpecName: "kube-api-access-crgqr") pod "92e99c6e-d3fc-4cea-b0cd-d127abab1169" (UID: "92e99c6e-d3fc-4cea-b0cd-d127abab1169"). InnerVolumeSpecName "kube-api-access-crgqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:39:42.511819 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.511796    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-dshm" (OuterVolumeSpecName: "dshm") pod "92e99c6e-d3fc-4cea-b0cd-d127abab1169" (UID: "92e99c6e-d3fc-4cea-b0cd-d127abab1169"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:39:42.511988 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.511825    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92e99c6e-d3fc-4cea-b0cd-d127abab1169-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "92e99c6e-d3fc-4cea-b0cd-d127abab1169" (UID: "92e99c6e-d3fc-4cea-b0cd-d127abab1169"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:39:42.611002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.610975    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-dshm\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:39:42.611002 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.611003    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92e99c6e-d3fc-4cea-b0cd-d127abab1169-tmp-dir\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:39:42.611178 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.611020    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crgqr\" (UniqueName: \"kubernetes.io/projected/92e99c6e-d3fc-4cea-b0cd-d127abab1169-kube-api-access-crgqr\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:39:42.611178 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:42.611034    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e99c6e-d3fc-4cea-b0cd-d127abab1169-tls-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:39:43.281774 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:43.281740    2585 generic.go:356] "Generic (PLEG): container finished" podID="92e99c6e-d3fc-4cea-b0cd-d127abab1169" containerID="242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008" exitCode=0
Sep 11 20:39:43.282242 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:43.281783    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"
Sep 11 20:39:43.282242 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:43.281785    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn" event={"ID":"92e99c6e-d3fc-4cea-b0cd-d127abab1169","Type":"ContainerDied","Data":"242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008"}
Sep 11 20:39:43.282242 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:43.281901    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn" event={"ID":"92e99c6e-d3fc-4cea-b0cd-d127abab1169","Type":"ContainerDied","Data":"c4d0ca5aa9cc5ff158869f4741e724fd81d32dec061b8e297641e55af50031e7"}
Sep 11 20:39:43.282242 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:43.281927    2585 scope.go:117] "RemoveContainer" containerID="242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008"
Sep 11 20:39:43.290674 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:43.290659    2585 scope.go:117] "RemoveContainer" containerID="242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008"
Sep 11 20:39:43.290907 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:39:43.290890    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008\": container with ID starting with 242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008 not found: ID does not exist" containerID="242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008"
Sep 11 20:39:43.290972 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:43.290914    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008"} err="failed to get container status \"242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008\": rpc error: code = NotFound desc = could not find container \"242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008\": container with ID starting with 242e596f6e8afe7055d544e6529b5cda97f5df7b791223a0573cd2010f6ec008 not found: ID does not exist"
Sep 11 20:39:43.302552 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:43.302522    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"]
Sep 11 20:39:43.306374 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:43.306353    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-32def012-kserve-7c54fc48c-hpdxn"]
Sep 11 20:39:43.349546 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:43.349521    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92e99c6e-d3fc-4cea-b0cd-d127abab1169" path="/var/lib/kubelet/pods/92e99c6e-d3fc-4cea-b0cd-d127abab1169/volumes"
Sep 11 20:39:46.788143 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.788107    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"]
Sep 11 20:39:46.788526 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.788447    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92e99c6e-d3fc-4cea-b0cd-d127abab1169" containerName="main"
Sep 11 20:39:46.788526 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.788458    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="92e99c6e-d3fc-4cea-b0cd-d127abab1169" containerName="main"
Sep 11 20:39:46.788526 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.788518    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="92e99c6e-d3fc-4cea-b0cd-d127abab1169" containerName="main"
Sep 11 20:39:46.792771 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.792750    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:46.796423 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.796399    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 20:39:46.796575 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.796399    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 20:39:46.796575 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.796401    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 20:39:46.796575 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.796406    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 20:39:46.796575 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.796406    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vrkb7\""
Sep 11 20:39:46.801698 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.801676    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"]
Sep 11 20:39:46.804742 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.804716    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"]
Sep 11 20:39:46.808215 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.808198    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.817833 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.817808    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"]
Sep 11 20:39:46.843315 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.843291    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed9c5291-b1c5-4f70-8fd1-d6f68d711927-maas-api-tls\") pod \"maas-api-5c564f7cc4-dlwsk\" (UID: \"ed9c5291-b1c5-4f70-8fd1-d6f68d711927\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.843417 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.843319    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9bzc\" (UniqueName: \"kubernetes.io/projected/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-kube-api-access-g9bzc\") pod \"maas-api-85cff974b6-vc6pj\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:46.843417 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.843335    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed9c5291-b1c5-4f70-8fd1-d6f68d711927-openshift-service-ca\") pod \"maas-api-5c564f7cc4-dlwsk\" (UID: \"ed9c5291-b1c5-4f70-8fd1-d6f68d711927\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.843518 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.843430    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed9c5291-b1c5-4f70-8fd1-d6f68d711927-metrics-certs\") pod \"maas-api-5c564f7cc4-dlwsk\" (UID: \"ed9c5291-b1c5-4f70-8fd1-d6f68d711927\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.843518 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.843496    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-openshift-service-ca\") pod \"maas-api-85cff974b6-vc6pj\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:46.843518 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.843514    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-metrics-certs\") pod \"maas-api-85cff974b6-vc6pj\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:46.843636 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.843531    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-maas-api-tls\") pod \"maas-api-85cff974b6-vc6pj\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:46.843636 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.843545    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvtdj\" (UniqueName: \"kubernetes.io/projected/ed9c5291-b1c5-4f70-8fd1-d6f68d711927-kube-api-access-cvtdj\") pod \"maas-api-5c564f7cc4-dlwsk\" (UID: \"ed9c5291-b1c5-4f70-8fd1-d6f68d711927\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.944523 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.944491    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed9c5291-b1c5-4f70-8fd1-d6f68d711927-metrics-certs\") pod \"maas-api-5c564f7cc4-dlwsk\" (UID: \"ed9c5291-b1c5-4f70-8fd1-d6f68d711927\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.944708 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.944550    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-openshift-service-ca\") pod \"maas-api-85cff974b6-vc6pj\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:46.944708 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.944571    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-metrics-certs\") pod \"maas-api-85cff974b6-vc6pj\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:46.944708 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.944596    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-maas-api-tls\") pod \"maas-api-85cff974b6-vc6pj\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:46.944708 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.944620    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvtdj\" (UniqueName: \"kubernetes.io/projected/ed9c5291-b1c5-4f70-8fd1-d6f68d711927-kube-api-access-cvtdj\") pod \"maas-api-5c564f7cc4-dlwsk\" (UID: \"ed9c5291-b1c5-4f70-8fd1-d6f68d711927\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.944708 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.944669    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed9c5291-b1c5-4f70-8fd1-d6f68d711927-maas-api-tls\") pod \"maas-api-5c564f7cc4-dlwsk\" (UID: \"ed9c5291-b1c5-4f70-8fd1-d6f68d711927\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.945010 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.944691    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9bzc\" (UniqueName: \"kubernetes.io/projected/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-kube-api-access-g9bzc\") pod \"maas-api-85cff974b6-vc6pj\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:46.945010 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.944733    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed9c5291-b1c5-4f70-8fd1-d6f68d711927-openshift-service-ca\") pod \"maas-api-5c564f7cc4-dlwsk\" (UID: \"ed9c5291-b1c5-4f70-8fd1-d6f68d711927\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.945521 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.945495    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-openshift-service-ca\") pod \"maas-api-85cff974b6-vc6pj\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:46.945626 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.945580    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed9c5291-b1c5-4f70-8fd1-d6f68d711927-openshift-service-ca\") pod \"maas-api-5c564f7cc4-dlwsk\" (UID: \"ed9c5291-b1c5-4f70-8fd1-d6f68d711927\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.947194 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.947152    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed9c5291-b1c5-4f70-8fd1-d6f68d711927-metrics-certs\") pod \"maas-api-5c564f7cc4-dlwsk\" (UID: \"ed9c5291-b1c5-4f70-8fd1-d6f68d711927\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.947399 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.947374    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-maas-api-tls\") pod \"maas-api-85cff974b6-vc6pj\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:46.947590 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.947566    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed9c5291-b1c5-4f70-8fd1-d6f68d711927-maas-api-tls\") pod \"maas-api-5c564f7cc4-dlwsk\" (UID: \"ed9c5291-b1c5-4f70-8fd1-d6f68d711927\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.947590 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.947579    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-metrics-certs\") pod \"maas-api-85cff974b6-vc6pj\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:46.952655 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.952630    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvtdj\" (UniqueName: \"kubernetes.io/projected/ed9c5291-b1c5-4f70-8fd1-d6f68d711927-kube-api-access-cvtdj\") pod \"maas-api-5c564f7cc4-dlwsk\" (UID: \"ed9c5291-b1c5-4f70-8fd1-d6f68d711927\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:46.952794 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:46.952771    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9bzc\" (UniqueName: \"kubernetes.io/projected/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-kube-api-access-g9bzc\") pod \"maas-api-85cff974b6-vc6pj\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:47.105093 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:47.105056    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:47.119026 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:47.119002    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:47.380395 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:47.380369    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"]
Sep 11 20:39:47.382506 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:39:47.382478    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3abd34_4a37_4f87_8ad4_ae0eac380adb.slice/crio-1103a9c1b407322c4091596ac2b8bd9442cc6995bed342eb6dc8a85bd9be4e7a WatchSource:0}: Error finding container 1103a9c1b407322c4091596ac2b8bd9442cc6995bed342eb6dc8a85bd9be4e7a: Status 404 returned error can't find the container with id 1103a9c1b407322c4091596ac2b8bd9442cc6995bed342eb6dc8a85bd9be4e7a
Sep 11 20:39:47.384211 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:47.384188    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 20:39:47.403486 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:47.403466    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"]
Sep 11 20:39:47.405120 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:39:47.405094    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded9c5291_b1c5_4f70_8fd1_d6f68d711927.slice/crio-75ff86a617af4fe1f181133860fb7bc08c0097a32970ef80aefbf843d8bf4862 WatchSource:0}: Error finding container 75ff86a617af4fe1f181133860fb7bc08c0097a32970ef80aefbf843d8bf4862: Status 404 returned error can't find the container with id 75ff86a617af4fe1f181133860fb7bc08c0097a32970ef80aefbf843d8bf4862
Sep 11 20:39:48.307455 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:48.307419    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk" event={"ID":"ed9c5291-b1c5-4f70-8fd1-d6f68d711927","Type":"ContainerStarted","Data":"e5c79d911c09f4fa016d700703e81386e0a19e3af3527d89b1932195978bc51c"}
Sep 11 20:39:48.307980 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:48.307471    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk" event={"ID":"ed9c5291-b1c5-4f70-8fd1-d6f68d711927","Type":"ContainerStarted","Data":"75ff86a617af4fe1f181133860fb7bc08c0097a32970ef80aefbf843d8bf4862"}
Sep 11 20:39:48.307980 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:48.307511    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:48.308941 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:48.308919    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj" event={"ID":"7d3abd34-4a37-4f87-8ad4-ae0eac380adb","Type":"ContainerStarted","Data":"c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80"}
Sep 11 20:39:48.309062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:48.308967    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj" event={"ID":"7d3abd34-4a37-4f87-8ad4-ae0eac380adb","Type":"ContainerStarted","Data":"1103a9c1b407322c4091596ac2b8bd9442cc6995bed342eb6dc8a85bd9be4e7a"}
Sep 11 20:39:48.309062 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:48.309009    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:48.324533 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:48.324494    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk" podStartSLOduration=1.925964075 podStartE2EDuration="2.324482422s" totalImagesPullingTime="398.518347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:39:48.322880554 +0000 UTC m=+2373.484130797" watchObservedRunningTime="2026-09-11 20:39:48.324482422 +0000 UTC m=+2373.485732664"
Sep 11 20:39:48.338667 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:48.338631    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj" podStartSLOduration=1.9382006889999999 podStartE2EDuration="2.338619136s" totalImagesPullingTime="400.418447ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:39:48.337843929 +0000 UTC m=+2373.499094186" watchObservedRunningTime="2026-09-11 20:39:48.338619136 +0000 UTC m=+2373.499869375"
Sep 11 20:39:54.318840 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.318803    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:54.319298 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.319113    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-dlwsk"
Sep 11 20:39:54.378154 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.378119    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"]
Sep 11 20:39:54.378364 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.378295    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj" podUID="7d3abd34-4a37-4f87-8ad4-ae0eac380adb" containerName="maas-api" containerID="cri-o://c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80" gracePeriod=30
Sep 11 20:39:54.622134 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.622113    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:54.714266 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.714228    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9bzc\" (UniqueName: \"kubernetes.io/projected/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-kube-api-access-g9bzc\") pod \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") "
Sep 11 20:39:54.714457 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.714340    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-openshift-service-ca\") pod \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") "
Sep 11 20:39:54.714457 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.714375    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-metrics-certs\") pod \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") "
Sep 11 20:39:54.714457 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.714406    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-maas-api-tls\") pod \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\" (UID: \"7d3abd34-4a37-4f87-8ad4-ae0eac380adb\") "
Sep 11 20:39:54.714720 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.714695    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7d3abd34-4a37-4f87-8ad4-ae0eac380adb" (UID: "7d3abd34-4a37-4f87-8ad4-ae0eac380adb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:39:54.716452 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.716426    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7d3abd34-4a37-4f87-8ad4-ae0eac380adb" (UID: "7d3abd34-4a37-4f87-8ad4-ae0eac380adb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:39:54.716560 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.716542    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7d3abd34-4a37-4f87-8ad4-ae0eac380adb" (UID: "7d3abd34-4a37-4f87-8ad4-ae0eac380adb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:39:54.716560 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.716553    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-kube-api-access-g9bzc" (OuterVolumeSpecName: "kube-api-access-g9bzc") pod "7d3abd34-4a37-4f87-8ad4-ae0eac380adb" (UID: "7d3abd34-4a37-4f87-8ad4-ae0eac380adb"). InnerVolumeSpecName "kube-api-access-g9bzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:39:54.815275 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.815246    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9bzc\" (UniqueName: \"kubernetes.io/projected/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-kube-api-access-g9bzc\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:39:54.815275 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.815271    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-openshift-service-ca\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:39:54.815447 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.815282    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-metrics-certs\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:39:54.815447 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:54.815291    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d3abd34-4a37-4f87-8ad4-ae0eac380adb-maas-api-tls\") on node \"ip-10-0-130-146.ec2.internal\" DevicePath \"\""
Sep 11 20:39:55.342097 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:55.342059    2585 generic.go:356] "Generic (PLEG): container finished" podID="7d3abd34-4a37-4f87-8ad4-ae0eac380adb" containerID="c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80" exitCode=0
Sep 11 20:39:55.342498 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:55.342104    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"
Sep 11 20:39:55.342498 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:55.342146    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj" event={"ID":"7d3abd34-4a37-4f87-8ad4-ae0eac380adb","Type":"ContainerDied","Data":"c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80"}
Sep 11 20:39:55.342498 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:55.342204    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj" event={"ID":"7d3abd34-4a37-4f87-8ad4-ae0eac380adb","Type":"ContainerDied","Data":"1103a9c1b407322c4091596ac2b8bd9442cc6995bed342eb6dc8a85bd9be4e7a"}
Sep 11 20:39:55.342498 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:55.342232    2585 scope.go:117] "RemoveContainer" containerID="c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80"
Sep 11 20:39:55.352722 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:55.352707    2585 scope.go:117] "RemoveContainer" containerID="c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80"
Sep 11 20:39:55.353004 ip-10-0-130-146 kubenswrapper[2585]: E0911 20:39:55.352982    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80\": container with ID starting with c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80 not found: ID does not exist" containerID="c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80"
Sep 11 20:39:55.353149 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:55.353016    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80"} err="failed to get container status \"c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80\": rpc error: code = NotFound desc = could not find container \"c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80\": container with ID starting with c31af5ebf0c3f6b22c039dc84ad8ca96bdee77c788dd2a34681d681ac4d18d80 not found: ID does not exist"
Sep 11 20:39:55.366051 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:55.366008    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"]
Sep 11 20:39:55.369832 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:55.369811    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cff974b6-vc6pj"]
Sep 11 20:39:57.350502 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:39:57.350458    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d3abd34-4a37-4f87-8ad4-ae0eac380adb" path="/var/lib/kubelet/pods/7d3abd34-4a37-4f87-8ad4-ae0eac380adb/volumes"
Sep 11 20:40:15.530802 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:15.530774    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:40:15.538133 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:15.538111    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:40:22.486628 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:22.486599    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fdf48ff49-znx4p_bb08fa17-f3b6-4e10-b167-58df42b8ecf0/copy-manifests/0.log"
Sep 11 20:40:22.492262 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:22.492243    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fdf48ff49-znx4p_bb08fa17-f3b6-4e10-b167-58df42b8ecf0/manager/0.log"
Sep 11 20:40:22.827312 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:22.827228    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5c564f7cc4-dlwsk_ed9c5291-b1c5-4f70-8fd1-d6f68d711927/maas-api/0.log"
Sep 11 20:40:23.047009 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:23.046979    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29819295-92zzf_bec51b7d-0f97-4418-a6ef-99292ad76f57/cleanup/0.log"
Sep 11 20:40:24.130370 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:24.130325    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rnt8d_d62949bb-e473-4276-9e78-b97e3a9ef725/manager/0.log"
Sep 11 20:40:24.477661 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:24.477550    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-q5xvb_1accc25e-aef3-4d60-97ae-ee265cb858fe/manager/0.log"
Sep 11 20:40:25.049819 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:25.049783    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z_6890f642-17ff-41a0-b8cf-6525cd8ab9d7/istio-proxy/0.log"
Sep 11 20:40:25.851056 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:25.851026    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cb7c47b86-p6kg9_1fc3208b-5161-465f-ae33-a63b6a913af8/router/0.log"
Sep 11 20:40:26.289628 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:26.289542    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-64592_9bc2f7a8-a247-4220-84f2-a7506cf1b2f4/main/0.log"
Sep 11 20:40:26.399749 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:26.399723    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-pc8zr_de497d69-9d2a-4e12-b1a4-7f1fb1138765/main/0.log"
Sep 11 20:40:34.508159 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:34.508117    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vsxwz_f62e8683-1a77-47c2-981b-a832d9df930c/global-pull-secret-syncer/0.log"
Sep 11 20:40:34.607537 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:34.607511    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xsg69_f20ee550-9f30-480a-9b31-ebc964ae0fe0/konnectivity-agent/0.log"
Sep 11 20:40:34.641471 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:34.641429    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-146.ec2.internal_3675b94d77e2c8e178e2e49334541679/haproxy/0.log"
Sep 11 20:40:39.472737 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:39.472705    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rnt8d_d62949bb-e473-4276-9e78-b97e3a9ef725/manager/0.log"
Sep 11 20:40:39.553257 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:39.553231    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-q5xvb_1accc25e-aef3-4d60-97ae-ee265cb858fe/manager/0.log"
Sep 11 20:40:41.300470 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:41.300440    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-g4tfj_49c83ddc-3e64-44cf-a7be-0284d4c9d91b/cluster-monitoring-operator/0.log"
Sep 11 20:40:41.498870 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:41.498840    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6wrq_0c7e9773-e797-4383-815b-6f2c84ea6f63/node-exporter/0.log"
Sep 11 20:40:41.517165 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:41.517142    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6wrq_0c7e9773-e797-4383-815b-6f2c84ea6f63/kube-rbac-proxy/0.log"
Sep 11 20:40:41.533950 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:41.533934    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6wrq_0c7e9773-e797-4383-815b-6f2c84ea6f63/init-textfile/0.log"
Sep 11 20:40:43.613299 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:43.613271    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-jzlvs_6d372a68-48a8-4f3b-9ed7-b8b7fb872ba1/networking-console-plugin/0.log"
Sep 11 20:40:44.144842 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.144815    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/1.log"
Sep 11 20:40:44.150478 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.150461    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-4zntx_56d5e007-e7c4-46ee-8825-8a5dd2dbd94d/console-operator/2.log"
Sep 11 20:40:44.480210 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.480130    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"]
Sep 11 20:40:44.480472 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.480460    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d3abd34-4a37-4f87-8ad4-ae0eac380adb" containerName="maas-api"
Sep 11 20:40:44.480575 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.480473    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d3abd34-4a37-4f87-8ad4-ae0eac380adb" containerName="maas-api"
Sep 11 20:40:44.480575 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.480528    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d3abd34-4a37-4f87-8ad4-ae0eac380adb" containerName="maas-api"
Sep 11 20:40:44.483430 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.483414    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.485939 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.485907    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mjrrg\"/\"kube-root-ca.crt\""
Sep 11 20:40:44.486889 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.486870    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mjrrg\"/\"default-dockercfg-t9mmc\""
Sep 11 20:40:44.487005 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.486881    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mjrrg\"/\"openshift-service-ca.crt\""
Sep 11 20:40:44.491242 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.491217    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"]
Sep 11 20:40:44.553670 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.553647    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh6j7\" (UniqueName: \"kubernetes.io/projected/0cd506eb-a64a-4314-9b88-dd39800076c9-kube-api-access-sh6j7\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.553778 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.553679    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cd506eb-a64a-4314-9b88-dd39800076c9-lib-modules\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.553778 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.553712    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0cd506eb-a64a-4314-9b88-dd39800076c9-proc\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.553858 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.553808    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cd506eb-a64a-4314-9b88-dd39800076c9-sys\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.553858 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.553838    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0cd506eb-a64a-4314-9b88-dd39800076c9-podres\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.654267 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.654241    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6j7\" (UniqueName: \"kubernetes.io/projected/0cd506eb-a64a-4314-9b88-dd39800076c9-kube-api-access-sh6j7\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.654616 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.654271    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cd506eb-a64a-4314-9b88-dd39800076c9-lib-modules\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.654616 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.654305    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0cd506eb-a64a-4314-9b88-dd39800076c9-proc\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.654616 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.654340    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cd506eb-a64a-4314-9b88-dd39800076c9-sys\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.654616 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.654359    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0cd506eb-a64a-4314-9b88-dd39800076c9-podres\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.654616 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.654447    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cd506eb-a64a-4314-9b88-dd39800076c9-lib-modules\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.654616 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.654465    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0cd506eb-a64a-4314-9b88-dd39800076c9-podres\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.654616 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.654449    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cd506eb-a64a-4314-9b88-dd39800076c9-sys\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.654616 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.654449    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0cd506eb-a64a-4314-9b88-dd39800076c9-proc\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.662093 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.662076    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh6j7\" (UniqueName: \"kubernetes.io/projected/0cd506eb-a64a-4314-9b88-dd39800076c9-kube-api-access-sh6j7\") pod \"perf-node-gather-daemonset-98nbr\" (UID: \"0cd506eb-a64a-4314-9b88-dd39800076c9\") " pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:44.794586 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:44.794513    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:45.061125 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:45.061101    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"]
Sep 11 20:40:45.063537 ip-10-0-130-146 kubenswrapper[2585]: W0911 20:40:45.063502    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0cd506eb_a64a_4314_9b88_dd39800076c9.slice/crio-3b247db0dcae22d1abc952dfe9a22da76d79ab6bae345a99bb36350908dd3883 WatchSource:0}: Error finding container 3b247db0dcae22d1abc952dfe9a22da76d79ab6bae345a99bb36350908dd3883: Status 404 returned error can't find the container with id 3b247db0dcae22d1abc952dfe9a22da76d79ab6bae345a99bb36350908dd3883
Sep 11 20:40:45.507567 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:45.507524    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-kmftf_64bd481c-3c01-44e3-9806-3a0e9191fe20/volume-data-source-validator/0.log"
Sep 11 20:40:45.579966 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:45.579935    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr" event={"ID":"0cd506eb-a64a-4314-9b88-dd39800076c9","Type":"ContainerStarted","Data":"0bb62233c3cb3993f3d47317c7354b6b17c7278db0321037fe45371f7d8a1b62"}
Sep 11 20:40:45.580114 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:45.579994    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr" event={"ID":"0cd506eb-a64a-4314-9b88-dd39800076c9","Type":"ContainerStarted","Data":"3b247db0dcae22d1abc952dfe9a22da76d79ab6bae345a99bb36350908dd3883"}
Sep 11 20:40:45.580114 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:45.580090    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:45.594656 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:45.594616    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr" podStartSLOduration=1.594602407 podStartE2EDuration="1.594602407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:40:45.593978119 +0000 UTC m=+2430.755228355" watchObservedRunningTime="2026-09-11 20:40:45.594602407 +0000 UTC m=+2430.755852649"
Sep 11 20:40:46.564566 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:46.564537    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kc2dt_2c3afeaa-5162-49cf-b716-f59fcd056613/dns/0.log"
Sep 11 20:40:46.583657 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:46.583633    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kc2dt_2c3afeaa-5162-49cf-b716-f59fcd056613/kube-rbac-proxy/0.log"
Sep 11 20:40:46.724707 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:46.724679    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sdh4n_30b3adc7-99ac-4743-9eb5-c1d99ceb1b79/dns-node-resolver/0.log"
Sep 11 20:40:47.270894 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:47.270869    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vrvvx_e7341bdd-c654-4188-bce4-8cd18669ebfa/node-ca/0.log"
Sep 11 20:40:48.139699 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:48.139674    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z_6890f642-17ff-41a0-b8cf-6525cd8ab9d7/istio-proxy/0.log"
Sep 11 20:40:48.684224 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:48.684199    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cb7c47b86-p6kg9_1fc3208b-5161-465f-ae33-a63b6a913af8/router/0.log"
Sep 11 20:40:49.566772 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:49.566743    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wn94s_6700a361-c2da-4e39-92eb-fb1b5619c434/serve-healthcheck-canary/0.log"
Sep 11 20:40:49.990842 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:49.990815    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-9zm9v_ca1a8908-a5ff-4122-9d3f-5ae60adb45b9/insights-operator/0.log"
Sep 11 20:40:49.992345 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:49.992326    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-9zm9v_ca1a8908-a5ff-4122-9d3f-5ae60adb45b9/insights-operator/1.log"
Sep 11 20:40:50.119588 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:50.119562    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfv5l_58d8f981-87ee-426c-aebd-9e1d9f62ea0a/kube-rbac-proxy/0.log"
Sep 11 20:40:50.136068 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:50.136044    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfv5l_58d8f981-87ee-426c-aebd-9e1d9f62ea0a/exporter/0.log"
Sep 11 20:40:50.152887 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:50.152868    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfv5l_58d8f981-87ee-426c-aebd-9e1d9f62ea0a/extractor/0.log"
Sep 11 20:40:51.593488 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:51.593457    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mjrrg/perf-node-gather-daemonset-98nbr"
Sep 11 20:40:52.824494 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:52.824468    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fdf48ff49-znx4p_bb08fa17-f3b6-4e10-b167-58df42b8ecf0/manager/0.log"
Sep 11 20:40:52.840653 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:52.840631    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fdf48ff49-znx4p_bb08fa17-f3b6-4e10-b167-58df42b8ecf0/copy-manifests/0.log"
Sep 11 20:40:54.132936 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:54.132910    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-865445d586-vms6h_dd8800f3-8cf1-4231-9bd2-3ebaf1dc1901/manager/0.log"
Sep 11 20:40:54.299841 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:54.299810    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z_6890f642-17ff-41a0-b8cf-6525cd8ab9d7/istio-proxy/0.log"
Sep 11 20:40:54.831793 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:54.831768    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cb7c47b86-p6kg9_1fc3208b-5161-465f-ae33-a63b6a913af8/router/0.log"
Sep 11 20:40:56.379483 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:56.379453    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5574z_6890f642-17ff-41a0-b8cf-6525cd8ab9d7/istio-proxy/0.log"
Sep 11 20:40:56.913035 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:56.913007    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cb7c47b86-p6kg9_1fc3208b-5161-465f-ae33-a63b6a913af8/router/0.log"
Sep 11 20:40:59.223739 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:59.223709    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-cgds5_195babbb-08c3-4e50-aa77-10f0844bd32b/migrator/0.log"
Sep 11 20:40:59.240872 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:59.240847    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-cgds5_195babbb-08c3-4e50-aa77-10f0844bd32b/graceful-termination/0.log"
Sep 11 20:40:59.565678 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:59.565595    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-vtzn7_452aaf2b-9726-4c46-8fbe-aab42ae6dcc1/kube-storage-version-migrator-operator/1.log"
Sep 11 20:40:59.566378 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:40:59.566359    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-vtzn7_452aaf2b-9726-4c46-8fbe-aab42ae6dcc1/kube-storage-version-migrator-operator/0.log"
Sep 11 20:41:00.875682 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:00.875656    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkfkl_8b217b0a-fb3e-4b5a-942a-0f57a3913ca9/kube-multus-additional-cni-plugins/0.log"
Sep 11 20:41:00.891592 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:00.891566    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkfkl_8b217b0a-fb3e-4b5a-942a-0f57a3913ca9/egress-router-binary-copy/0.log"
Sep 11 20:41:00.907668 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:00.907649    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkfkl_8b217b0a-fb3e-4b5a-942a-0f57a3913ca9/cni-plugins/0.log"
Sep 11 20:41:00.923437 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:00.923417    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkfkl_8b217b0a-fb3e-4b5a-942a-0f57a3913ca9/bond-cni-plugin/0.log"
Sep 11 20:41:00.939508 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:00.939489    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkfkl_8b217b0a-fb3e-4b5a-942a-0f57a3913ca9/routeoverride-cni/0.log"
Sep 11 20:41:00.955216 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:00.955197    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkfkl_8b217b0a-fb3e-4b5a-942a-0f57a3913ca9/whereabouts-cni-bincopy/0.log"
Sep 11 20:41:00.970926 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:00.970911    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkfkl_8b217b0a-fb3e-4b5a-942a-0f57a3913ca9/whereabouts-cni/0.log"
Sep 11 20:41:01.006331 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:01.006310    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pcq4x_7f18aa82-473c-4dfb-82db-31a149631d21/kube-multus/0.log"
Sep 11 20:41:01.058109 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:01.058084    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zn8nm_8dd887eb-41d0-4861-a5b8-4be593422241/network-metrics-daemon/0.log"
Sep 11 20:41:01.072527 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:01.072506    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zn8nm_8dd887eb-41d0-4861-a5b8-4be593422241/kube-rbac-proxy/0.log"
Sep 11 20:41:02.231675 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:02.231644    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxbcp_dee611c8-1f4c-486b-a0c7-4584874acac9/ovn-controller/0.log"
Sep 11 20:41:02.244386 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:02.244361    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxbcp_dee611c8-1f4c-486b-a0c7-4584874acac9/ovn-acl-logging/0.log"
Sep 11 20:41:02.262308 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:02.262283    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxbcp_dee611c8-1f4c-486b-a0c7-4584874acac9/kube-rbac-proxy-node/0.log"
Sep 11 20:41:02.278657 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:02.278639    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxbcp_dee611c8-1f4c-486b-a0c7-4584874acac9/kube-rbac-proxy-ovn-metrics/0.log"
Sep 11 20:41:02.297402 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:02.297384    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxbcp_dee611c8-1f4c-486b-a0c7-4584874acac9/northd/0.log"
Sep 11 20:41:02.314242 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:02.314213    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxbcp_dee611c8-1f4c-486b-a0c7-4584874acac9/nbdb/0.log"
Sep 11 20:41:02.331565 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:02.331546    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxbcp_dee611c8-1f4c-486b-a0c7-4584874acac9/sbdb/0.log"
Sep 11 20:41:02.387372 ip-10-0-130-146 kubenswrapper[2585]: I0911 20:41:02.387342    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vxbcp_dee611c8-1f4c-486b-a0c7-4584874acac9/ovnkube-controller/0.log"